-- Logs begin at Wed 2022-07-06 12:57:07 UTC, end at Wed 2022-07-06 14:08:00 UTC. -- Jul 06 13:36:45.088317 dv-cinder-819149-8-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jul 06 13:36:45.095878 dv-cinder-819149-8-iscsi devstack@n-api.service[109856]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jul 06 13:36:45.098629 dv-cinder-819149-8-iscsi devstack@n-api.service[109856]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Jul 6 13:36:45 2022] *** Jul 06 13:36:45.098629 dv-cinder-819149-8-iscsi devstack@n-api.service[109856]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 06 13:36:45.098629 dv-cinder-819149-8-iscsi devstack@n-api.service[109856]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 06 13:36:45.098629 dv-cinder-819149-8-iscsi devstack@n-api.service[109856]: nodename: dv-cinder-819149-8-iscsi Jul 06 13:36:45.098629 dv-cinder-819149-8-iscsi devstack@n-api.service[109856]: machine: x86_64 Jul 06 13:36:45.098629 dv-cinder-819149-8-iscsi devstack@n-api.service[109856]: clock source: unix Jul 06 13:36:45.098629 dv-cinder-819149-8-iscsi devstack@n-api.service[109856]: pcre jit disabled Jul 06 13:36:45.098629 dv-cinder-819149-8-iscsi devstack@n-api.service[109856]: detected number of CPU cores: 4 Jul 06 13:36:45.098629 dv-cinder-819149-8-iscsi devstack@n-api.service[109856]: current working directory: / Jul 06 13:36:45.098629 dv-cinder-819149-8-iscsi devstack@n-api.service[109856]: detected binary path: /usr/bin/uwsgi-core Jul 06 13:36:45.098629 dv-cinder-819149-8-iscsi devstack@n-api.service[109856]: your processes number limit is 47680 Jul 06 13:36:45.099290 dv-cinder-819149-8-iscsi devstack@n-api.service[109856]: your memory page size is 4096 bytes Jul 06 13:36:45.099290 dv-cinder-819149-8-iscsi devstack@n-api.service[109856]: detected max file descriptor number: 2048 Jul 06 13:36:45.099290 dv-cinder-819149-8-iscsi devstack@n-api.service[109856]: lock engine: pthread robust mutexes Jul 06 13:36:45.099290 dv-cinder-819149-8-iscsi devstack@n-api.service[109856]: thunder lock: enabled Jul 06 13:36:45.099290 dv-cinder-819149-8-iscsi devstack@n-api.service[109856]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jul 06 13:36:45.099290 dv-cinder-819149-8-iscsi devstack@n-api.service[109856]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jul 06 13:36:45.142088 dv-cinder-819149-8-iscsi devstack@n-api.service[109856]: Python main interpreter initialized at 0x562f713de9c0 Jul 06 13:36:45.142088 dv-cinder-819149-8-iscsi devstack@n-api.service[109856]: python threads support enabled Jul 06 13:36:45.142088 dv-cinder-819149-8-iscsi devstack@n-api.service[109856]: your server socket listen backlog is limited to 100 connections Jul 06 13:36:45.142088 dv-cinder-819149-8-iscsi devstack@n-api.service[109856]: your mercy for graceful operations on workers is 90 seconds Jul 06 13:36:45.142410 dv-cinder-819149-8-iscsi devstack@n-api.service[109856]: mapped 403077 bytes (393 KB) for 2 cores Jul 06 13:36:45.142485 dv-cinder-819149-8-iscsi devstack@n-api.service[109856]: *** Operational MODE: preforking *** Jul 06 13:36:45.142742 dv-cinder-819149-8-iscsi devstack@n-api.service[109856]: *** uWSGI is running in multiple interpreter mode *** Jul 06 13:36:45.142742 dv-cinder-819149-8-iscsi devstack@n-api.service[109856]: spawned uWSGI master process (pid: 109856) Jul 06 13:36:45.142930 dv-cinder-819149-8-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jul 06 13:36:45.143465 dv-cinder-819149-8-iscsi devstack@n-api.service[109856]: spawned uWSGI worker 1 (pid: 109857, cores: 1) Jul 06 13:36:45.143795 dv-cinder-819149-8-iscsi devstack@n-api.service[109856]: spawned uWSGI worker 2 (pid: 109858, cores: 1) Jul 06 13:36:45.143975 dv-cinder-819149-8-iscsi devstack@n-api.service[109856]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 06 13:36:45.804531 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 06 13:36:45.826393 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 06 13:36:46.938580 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 06 13:36:46.938580 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: from cryptography.utils import int_from_bytes Jul 06 13:36:46.939171 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 06 13:36:46.939171 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: from cryptography.utils import int_from_bytes Jul 06 13:36:46.961717 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 06 13:36:46.961717 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: from cryptography.utils import int_from_bytes Jul 06 13:36:46.962188 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 06 13:36:46.962188 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: from cryptography.utils import int_from_bytes Jul 06 13:36:49.443301 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 06 13:36:49.443960 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 06 13:36:49.444108 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 06 13:36:49.444445 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 06 13:36:49.444701 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 06 13:36:49.445123 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:36:49.445454 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:36:49.445783 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:36:49.446104 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:36:49.446192 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 06 13:36:49.446568 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:36:49.446641 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 06 13:36:49.446747 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:36:49.446955 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 06 13:36:49.447052 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:36:49.447320 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 06 13:36:49.447414 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:36:49.447573 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 06 13:36:49.447686 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:36:49.447951 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:36:49.448036 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:36:49.448270 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:36:49.448357 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:36:49.448598 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:36:49.448689 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-819149-8-iscsi {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:36:49.448900 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:36:49.449043 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:36:49.449228 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:36:49.449314 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:36:49.449541 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:36:49.449626 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:36:49.449863 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:36:49.450031 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:36:49.450172 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:36:49.450282 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:36:49.450495 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:36:49.450595 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:36:49.450750 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:36:49.450844 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:36:49.451063 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:36:49.451289 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:36:49.451391 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-819149-8-iscsi {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:36:49.451695 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:36:49.451797 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:36:49.452002 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:36:49.452087 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:36:49.452312 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:36:49.452397 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:36:49.452633 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:36:49.452719 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:36:49.452936 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:36:49.453057 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:36:49.453270 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:36:49.453356 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:36:49.453573 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:36:49.453674 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:36:49.453887 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:36:49.454074 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:36:49.454210 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:36:49.454384 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:36:49.454519 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:36:49.454688 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:36:49.454919 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-819149-8-iscsi {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:36:49.455009 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:36:49.455239 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:36:49.455332 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:36:49.455556 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:36:49.455640 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:36:49.455868 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:36:49.455961 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:36:49.456210 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:36:49.456294 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:36:49.456515 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:36:49.456611 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:36:49.456840 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:36:49.456952 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:36:49.457173 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:36:49.457275 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:36:49.457527 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:36:49.457632 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-819149-8-iscsi {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:36:49.457916 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:36:49.458086 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:36:49.458294 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:36:49.458603 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:36:49.458705 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:36:49.459039 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:36:49.459124 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:36:49.459350 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:36:49.459450 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:36:49.459656 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:36:49.459748 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:36:49.459974 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:36:49.460059 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:36:49.460313 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:36:49.460412 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:36:49.460623 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:36:49.460711 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:36:49.460948 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:36:49.461056 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:36:49.461282 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:36:49.461376 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:36:49.461593 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:36:49.461687 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:36:49.461847 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:36:49.461933 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:36:49.462155 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:36:49.462249 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:36:49.462478 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:36:49.462573 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:36:49.462787 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:36:49.462919 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:36:49.463104 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:36:49.463191 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:36:49.463357 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:36:49.463492 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:36:49.463609 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:36:49.463695 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:36:49.463930 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:36:49.464024 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:36:49.464231 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:36:49.464332 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:36:49.464549 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:36:49.464642 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:36:49.464857 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:36:49.464950 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:36:49.465193 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:36:49.465280 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:36:49.465444 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:36:49.465540 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:36:49.465693 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:36:49.465779 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:36:49.466010 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:36:49.466095 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:36:49.466328 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:36:49.466421 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:36:49.466636 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:36:49.466727 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:36:49.466944 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:36:49.467048 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:36:49.467245 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:36:49.467331 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:36:49.467549 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:36:49.467645 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:36:49.467854 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:36:49.467940 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:36:49.468157 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:36:49.468243 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:36:49.468460 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:36:49.468552 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.20 {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:36:49.468762 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:36:49.468847 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.20 {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:36:49.469103 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:36:49.469193 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:36:49.469418 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:36:49.469502 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:36:49.469736 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:36:49.469833 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:36:49.470042 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:36:49.470128 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:36:49.470360 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:36:49.470491 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:36:49.470686 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:36:49.470781 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.20 {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:36:49.470985 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.20 {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:36:49.471077 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:36:49.471293 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:36:49.471377 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:36:49.471600 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:36:49.471694 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:36:49.471922 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:36:49.472008 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:36:49.472226 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:36:49.472316 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:36:49.472538 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:36:49.472636 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:36:49.472792 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:36:49.472877 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:36:49.473129 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:36:49.473219 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:36:49.473677 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:36:49.473988 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:36:49.474086 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:36:49.474311 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:36:49.474403 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:36:49.474626 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:36:49.474726 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:36:49.474940 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:36:49.475024 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:36:49.475191 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:36:49.475282 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:36:49.475494 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:36:49.475588 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:36:49.475802 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:36:49.475887 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:36:49.476121 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:36:49.476205 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:36:49.476427 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:36:49.476588 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:36:49.476731 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:36:49.476816 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:36:49.477056 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:36:49.477152 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:36:49.477359 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:36:49.477459 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:36:49.477662 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:36:49.477753 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:36:49.477965 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:36:49.478110 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:36:49.478270 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:36:49.478355 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:36:49.478570 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:36:49.478662 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:36:49.478874 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:36:49.478958 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:36:49.479174 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:36:49.479260 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:36:49.479478 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:36:49.479565 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:36:49.479781 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:36:49.479877 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:36:49.480086 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:36:49.480171 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:36:49.480404 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:36:49.480488 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:36:49.480707 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:36:49.480793 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:36:49.481026 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:36:49.481115 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:36:49.481337 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:36:49.481421 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:36:49.481639 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:36:49.481735 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:36:49.481941 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:36:49.482035 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:36:49.482258 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:36:49.482342 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:36:49.482559 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:36:49.482643 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:36:49.482861 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:36:49.482953 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:36:49.483177 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:36:49.483263 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:36:49.483479 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:36:49.483564 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:36:49.483778 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:36:49.483865 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:36:49.484094 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:36:49.484179 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:36:49.484399 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:36:49.484488 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:36:49.484699 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:36:49.484785 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:36:49.485019 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:36:49.485106 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:36:49.485325 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:36:49.485421 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:36:49.485631 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:36:49.485723 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:36:49.485939 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:36:49.486024 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:36:49.486239 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:36:49.486331 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:36:49.486592 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:36:49.486860 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:36:49.486954 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:36:49.487178 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:36:49.487276 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:36:49.487484 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:36:49.487571 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:36:49.487790 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:36:49.487876 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:36:49.488096 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:36:49.488187 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:36:49.488400 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:36:49.488487 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:36:49.488705 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:36:49.488798 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:36:49.489551 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:36:49.489876 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:36:49.490032 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.490206 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:36:49.490379 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.490516 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:36:49.490732 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.490825 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:36:49.491058 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.491152 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:36:49.491399 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.491493 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:36:49.491739 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.491842 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.492067 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.492165 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.492386 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.492472 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.492710 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.492795 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.493064 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.493154 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.493387 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.493472 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.493707 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.493794 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.494020 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.494113 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.494338 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.494434 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.494658 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.494742 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.494969 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.495053 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.495282 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.495366 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.495596 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.495690 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.495917 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.496008 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.496231 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.496323 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.496554 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.496641 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.496869 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.496954 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.497217 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.497330 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.497532 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.497638 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.497839 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.497924 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.498158 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.498243 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.498489 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.498584 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.498808 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.498897 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.499122 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.499221 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.499441 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.499534 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.499759 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.499844 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.500075 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.500172 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.500406 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.500500 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.500722 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.500862 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.501055 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.501157 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.501370 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.501463 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.501682 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.501775 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.501995 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.502097 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.502311 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.502397 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.502620 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.502705 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.502935 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.503020 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.503244 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.503340 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.503557 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.503651 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.503868 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.503962 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.504178 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.504264 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.504534 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.505399 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.505551 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.505714 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.505801 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.506029 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.506137 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.506489 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.506677 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.506768 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.506999 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.507091 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.507316 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.507437 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.507635 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.507733 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.507947 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.508041 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.508253 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.508355 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.508557 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.508649 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.508862 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.508962 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.509198 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.509311 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.509511 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.509608 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.509830 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.509923 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.510149 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.510249 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.510455 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.510553 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.510762 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.510866 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.511082 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.511171 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.511391 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.511489 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.511698 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.511793 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.512009 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.512099 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.512314 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.512399 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.512621 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.512714 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.512928 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.513045 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.513270 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.513355 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.513579 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.513675 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.513898 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.514030 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.514216 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.514302 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.514532 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.514625 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.514835 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.514919 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.515145 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.515238 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.515460 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.515560 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.515772 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.515869 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.516085 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.516172 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.516397 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.516491 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.516709 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.516796 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.517055 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.517143 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.517371 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.517528 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.517684 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.517769 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.518004 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.518102 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.518314 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.518401 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.518628 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.518721 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.518937 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.519022 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.519244 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.519338 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.519550 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.519636 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.519855 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.519939 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.520182 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.520368 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.520812 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.520909 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.521150 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.521241 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.521463 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.521552 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.521779 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.521864 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.522087 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.522188 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.522392 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.522487 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.522696 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.522781 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.522999 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.523102 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.523302 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.523398 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.523623 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.523709 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.523933 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.524028 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.524238 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.524324 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.524540 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.524638 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.524847 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.524940 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.525225 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.525313 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.525533 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.525620 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.525874 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.525962 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.526212 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.526307 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.526530 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.526616 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.526847 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.526933 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.527155 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.527240 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.527472 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.527556 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.527783 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.527876 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.528094 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.528190 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.528407 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.528492 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.528716 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.528803 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.529053 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.529142 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.529367 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.529462 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.529673 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.529766 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.529983 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.530074 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.530310 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.530413 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.530621 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.530706 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.530939 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.531024 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.531243 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.531336 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.531559 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.531644 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.531874 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.531959 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.532188 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.532282 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.532502 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.532587 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.532815 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.532906 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.533145 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.533243 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.533462 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.533547 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.533772 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.533858 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.534081 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.534208 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.534391 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.534483 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.534702 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.534795 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.535012 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.535098 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.535320 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.535404 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.535626 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.535710 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.536211 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.536471 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.536570 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.536819 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.536903 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.537160 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.537271 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.537468 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.537556 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.537781 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.537866 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.538110 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.538206 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.538443 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.538528 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.538753 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.538851 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.539065 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.539152 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.539374 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.539466 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.539682 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.539774 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.539990 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.540084 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.540307 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.540393 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.540610 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.540694 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.540914 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.541047 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.541249 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.541346 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.541561 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.541653 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.541873 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.541959 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.542178 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.542268 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.542479 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.542572 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.542791 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.542875 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.543096 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.543181 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.543399 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.543493 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.543702 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.543836 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.544057 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.544220 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.544356 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.544447 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.544622 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.544708 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.544938 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.545059 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.545278 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.545385 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.545579 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.545664 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.545882 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.545966 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.546190 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.546275 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.546495 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.546587 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.547073 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.547160 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.547375 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.547461 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.547678 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.547771 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.548016 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.548100 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.548321 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.548406 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.548627 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.548720 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.548940 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.549057 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.549278 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.549366 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.549586 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.549669 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.549898 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.549992 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.550207 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.550291 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.550518 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.550602 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.550828 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.550921 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.551138 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.551221 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.552210 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.552401 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.552528 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.552756 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.552843 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.553102 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.553191 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.553428 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.553513 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.553749 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.553844 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.554061 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.554149 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.554366 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.554460 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.554676 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.554762 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.554981 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.555250 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.555335 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.555590 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.555680 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.555910 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.556151 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.556239 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.556486 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.556582 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.556805 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.556890 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.557150 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.557240 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.557473 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.557574 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.557792 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.557878 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.558125 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.558221 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.558439 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.558534 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.558750 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.558836 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.559059 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.559154 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.559369 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.559454 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.559672 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.559769 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.559974 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.560059 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.560277 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.560361 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.560585 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.560682 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.560888 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.560973 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.561216 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.561305 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.561519 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.561605 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.561821 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.561915 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.562124 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.562213 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.562426 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.562519 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.562729 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.562820 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.563032 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.563116 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.563335 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.563420 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.563648 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.563734 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.563951 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.564079 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.564258 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.564345 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.564563 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.564649 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.564865 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.564958 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.565195 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.565283 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.565502 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.565589 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.565843 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.565937 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.566148 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.566234 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.566484 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.566571 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.566791 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.566885 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.567692 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.567997 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.568178 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.568304 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.568512 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.568631 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.568831 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.568936 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.569174 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.569262 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.569497 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.569584 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.569816 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.569908 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.570128 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.570220 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.570447 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.570538 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.570758 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.570853 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.571068 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.571153 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.571379 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.571466 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.571686 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.571771 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.571989 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.572073 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.572297 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.572382 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.572600 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.572687 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.572915 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.573041 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.573244 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.573341 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.573548 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.573633 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.573853 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.573946 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.574161 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.574258 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.574467 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.574551 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.574771 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.574868 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.575075 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.575159 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.575375 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.575465 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.575685 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.575778 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.575986 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.576078 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.576290 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.576381 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.576590 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.576686 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.576901 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.576987 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.577231 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.577315 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.577533 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.577627 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.577854 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.577946 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.578160 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.578296 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.578461 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.578548 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.578764 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.578849 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.579070 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.579162 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.579370 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.579456 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.579671 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.579756 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.579978 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.580071 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.580298 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.580383 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.580606 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.580691 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.580905 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.581029 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.581239 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.581323 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.581540 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.581635 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.581844 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.581937 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.582142 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.582272 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.582448 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.582532 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.583259 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.583561 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.583740 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.583862 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.584068 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.584153 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.584388 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.584475 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.584705 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.584800 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.585066 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.585168 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.585372 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.585459 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.585677 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.585770 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.585980 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.586066 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.586289 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.586375 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.586611 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.586702 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.586941 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.587033 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.587265 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.587350 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.587578 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.587663 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.587896 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.587994 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.588208 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.588295 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.588518 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.588605 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.588832 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.588925 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.589161 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.589260 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.589470 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.589566 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.589776 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.589873 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.590086 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.590171 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.590394 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.590481 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.590697 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.590791 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.591003 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.591087 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.591313 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.591397 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.591624 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.591718 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.591937 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.592028 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.592254 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.592384 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.592575 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.592662 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.592878 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.592963 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.593212 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.593298 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.593523 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.593610 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.593831 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.593918 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.594142 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.594226 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.594447 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.594532 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.594758 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.594843 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.595067 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.595152 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.595377 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.595470 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.595688 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.595779 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.595997 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.596091 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.596302 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.596395 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.596613 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.596697 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.596918 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.597042 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.597246 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.597332 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.597552 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.597637 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.597864 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.597966 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.598166 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.598840 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.599016 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.599319 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.599542 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.599630 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.599874 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.599960 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.600193 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.600330 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.600514 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.600643 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.600827 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.600955 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.601286 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.601392 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.601595 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.601682 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.601904 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.601989 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.602212 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.602298 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.602522 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.602619 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.602826 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.602912 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.603141 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.603226 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.603461 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.603547 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.603767 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.603852 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.604121 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.604213 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.604425 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.604510 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.604726 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.604812 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.605119 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.605224 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.605433 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.605518 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.605733 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.605817 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.606035 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.606129 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.606338 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.606424 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.606656 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.606739 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.606955 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.607047 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.607263 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.607347 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.607590 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.607675 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.607900 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.607986 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.608224 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.608316 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.608648 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.608733 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.608957 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.609187 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.609290 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.609375 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.609630 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.609716 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.609951 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.610045 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.610278 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.610371 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.610582 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.610677 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.610892 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.610977 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.611202 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.611302 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.611522 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.611608 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.611836 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.611927 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.612143 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.612229 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.612455 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.612598 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.612758 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.612853 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.613102 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.613193 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.613420 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.613504 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.613729 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.613830 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.614650 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.615120 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.615231 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.615459 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.615555 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.615786 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.615874 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.616115 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.616200 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.616477 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.616561 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.616782 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.616869 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.617111 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.617211 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.617423 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.617519 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.617726 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.617812 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.618029 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.618114 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.618351 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.618446 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.618655 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.618743 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.618966 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.619053 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.619277 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.619371 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.619584 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.619670 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.619885 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.619971 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.620187 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.620274 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.620499 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.620591 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.620802 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.620887 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.621134 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.621223 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.621443 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.621540 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.621760 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.621852 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.622079 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.622179 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.622369 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.622453 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.622688 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.622773 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.622996 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.623083 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.623297 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.623389 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.623597 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.623682 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.623898 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.623985 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.624220 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.624306 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.624526 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.624619 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.624831 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.624916 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.625162 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.625262 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.625496 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.625654 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.625801 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.625887 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.626121 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.626228 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.626442 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.626535 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.626757 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.626843 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.627074 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.627168 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.627401 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.627489 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.627705 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.627797 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.628009 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.628095 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.628319 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.628408 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.628624 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.628709 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.628928 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.629032 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.629259 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.629353 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.630115 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.630558 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.630644 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.630864 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.630967 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.631169 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.631256 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.631494 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.631582 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.631802 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.631890 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.632108 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.632193 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.632420 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.632516 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.632723 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.632809 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.633048 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.633151 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.633357 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.633443 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.633684 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.633777 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.633996 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.634081 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.634301 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.634385 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.634609 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.634697 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.634916 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.635001 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.635257 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.635350 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.635559 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.635643 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.635878 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.635963 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.636195 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.636289 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.636512 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.636598 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.636828 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.636914 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.637169 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.637273 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.637484 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.637577 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.637800 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.637887 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.638113 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.638206 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.638423 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.638509 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.638745 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.638836 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.639050 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.639146 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.639365 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.639461 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.639684 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.639883 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.639983 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.640211 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.640298 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.640529 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.640614 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.640842 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.640935 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.641187 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.641445 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.641531 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.641779 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.641866 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.642097 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.642184 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.642405 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.642490 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.642715 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.642809 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.643026 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.643121 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.643339 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.643431 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.643654 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.643753 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.643967 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.644103 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.644285 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.644399 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.644600 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.644703 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.644913 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.645025 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.645278 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.645437 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.645598 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.645759 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.646075 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.646166 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.646391 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.646485 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.646697 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.646786 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.647010 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.647104 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.647326 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.647421 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.647638 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.647762 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.647948 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.648035 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.648257 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.648357 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.648569 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.648655 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.648878 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.648963 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.649216 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.649317 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.649524 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.649611 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.649832 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.649916 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.650140 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.650226 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.650452 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.650545 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.650767 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.650852 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.651079 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.651166 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.651387 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.651479 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.651699 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.651785 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.652012 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.652106 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.652348 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.652529 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.652671 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.652841 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.652970 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.653221 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.653308 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.653551 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.653649 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.653878 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.654124 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.654212 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.654442 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.654528 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.654777 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.654872 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.655100 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.655187 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.655405 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.655491 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.655715 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.655816 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.656024 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.656118 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.656328 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.656414 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.656648 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.656742 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.656956 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.657068 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.657284 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.657382 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.657595 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.657687 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.657901 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.657986 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.658225 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.658539 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.658633 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.658847 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.658939 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.659170 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.659255 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.659482 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.659568 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.659819 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.660020 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.660140 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.660374 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.660468 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.660718 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.660879 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.661217 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.661524 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.661609 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.661840 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.661928 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.662149 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.662244 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.662455 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.662541 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.662758 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.662845 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.663066 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.663153 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.663374 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.663469 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.663676 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.663762 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.663985 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.664071 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.664287 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.664386 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.664612 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.664698 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.664917 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.665049 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.665245 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.665345 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.665548 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.665635 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.665857 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.665943 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.666162 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.666257 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.666462 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.666554 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.666765 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.666851 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.667068 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.667156 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.667378 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.667463 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.667678 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.667771 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.667985 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.668072 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.668288 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.668374 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.668592 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.668676 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.668893 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.668979 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.669229 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.669346 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.669534 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.669623 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.669847 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.669935 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.670157 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.670251 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.670466 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.670564 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.670770 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.670855 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.671078 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.671163 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.671398 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.671493 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.671975 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.672067 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.672285 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.672371 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.672591 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.672685 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.672910 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.673027 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.673250 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.673481 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.673568 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.673821 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.673904 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.674145 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.674231 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.674483 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.674578 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.674816 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.674903 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.675127 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.675348 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.675434 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.675689 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.675782 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.676014 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.676100 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.676854 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.676948 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.677215 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.677595 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.677761 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.677849 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.678087 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.678173 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.678404 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.678492 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.678720 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.678806 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.679027 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.679120 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.679338 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.679433 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.679646 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.679733 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.679958 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.680052 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.680273 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.680358 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.680578 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.680664 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.680890 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.680985 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.681228 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.681326 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.681545 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.681632 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.681861 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.681949 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.682175 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.682262 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.682487 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.682579 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.682795 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.682889 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.683105 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.683191 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.683415 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.683500 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.683723 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.683810 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.684038 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.684124 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.684366 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.684461 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.684680 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.684766 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.684985 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.685089 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.685326 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.685428 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.685642 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.685777 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.685957 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.686045 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.686271 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.686434 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.686591 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.686689 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.686922 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.687009 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.687242 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.687329 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.687548 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.687633 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.687866 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.687959 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.688177 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.688265 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.688504 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.688590 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.688841 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.688926 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.689221 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.689551 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.689637 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.689880 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.689968 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.690198 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.690294 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.690527 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.690614 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.690832 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.690918 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.691147 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.691241 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.691466 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.691553 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.691777 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.691862 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.692775 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.693109 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.693199 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.693425 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.693525 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.693733 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.693828 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.694038 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.694165 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.694342 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.694429 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.694644 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.694732 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.694954 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.695039 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.695256 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.695343 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.695562 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.695648 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.695862 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.695947 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.696164 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.696264 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.696467 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.696555 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.696768 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.696855 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.697099 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.697189 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.697405 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.697500 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.697706 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.697792 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.698007 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.698101 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.698310 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.698395 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.698609 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.698695 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.698914 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.699011 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.699221 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.699307 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.699533 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.699626 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.699841 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.699936 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.700148 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.700242 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.700452 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.700538 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.700760 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.700854 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.701108 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.701210 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.701432 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.701517 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.701746 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.701834 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.702055 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.702141 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.702382 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.702467 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.702691 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.702776 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.703001 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.703086 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.703311 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.703397 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.703621 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.703708 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.703929 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.704015 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.704237 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.704322 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.704548 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.704634 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.704875 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.704962 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.705205 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.705309 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.705519 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.705605 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.705832 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.705964 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.706143 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.706237 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.706455 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.706540 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.706764 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.706858 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.707089 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.707187 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.707395 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.707481 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.708230 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.708376 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.708543 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.708851 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.709141 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.709232 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.709472 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.709558 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.709791 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.709878 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.710113 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.710199 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.710431 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.710517 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.710743 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.710829 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.711066 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.711152 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.711377 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.711475 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.711699 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.711795 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.712013 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.712099 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.712328 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.712427 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.712648 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.712734 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.712962 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.713063 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.713297 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.713404 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.713605 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.713692 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.713846 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=109858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 06 13:36:49.713934 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.714256 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.714585 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.714939 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.715256 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.715603 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.715936 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.716252 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.716568 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.716879 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:36:49.717152 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=109857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 06 13:36:49.782625 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: INFO dbcounter [None req-c279d895-3ad9-4bf6-ad86-e058cff63605 None None] Registered counter for database nova_api Jul 06 13:36:49.784954 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: INFO dbcounter [None req-da93fd1a-ea8e-46bf-be06-5b882ee36977 None None] Registered counter for database nova_api Jul 06 13:36:49.895731 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG oslo_db.sqlalchemy.engines [None req-c279d895-3ad9-4bf6-ad86-e058cff63605 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109858) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 06 13:36:49.901081 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG oslo_db.sqlalchemy.engines [None req-da93fd1a-ea8e-46bf-be06-5b882ee36977 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109857) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 06 13:36:49.902005 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG dbcounter [-] [109858] Writer thread running {{(pid=109858) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 06 13:36:49.907412 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG dbcounter [-] [109857] Writer thread running {{(pid=109857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 06 13:36:49.957048 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.context [None req-c279d895-3ad9-4bf6-ad86-e058cff63605 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),85888416-be16-475e-b2e8-70b53709e325(cell1) {{(pid=109858) load_cells /opt/stack/nova/nova/context.py:464}} Jul 06 13:36:49.961910 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG oslo_concurrency.lockutils [None req-c279d895-3ad9-4bf6-ad86-e058cff63605 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:36:49.963498 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG oslo_concurrency.lockutils [None req-c279d895-3ad9-4bf6-ad86-e058cff63605 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:36:49.964297 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG oslo_concurrency.lockutils [None req-c279d895-3ad9-4bf6-ad86-e058cff63605 None None] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:36:49.965063 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.context [None req-da93fd1a-ea8e-46bf-be06-5b882ee36977 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),85888416-be16-475e-b2e8-70b53709e325(cell1) {{(pid=109857) load_cells /opt/stack/nova/nova/context.py:464}} Jul 06 13:36:49.966413 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG oslo_concurrency.lockutils [None req-c279d895-3ad9-4bf6-ad86-e058cff63605 None None] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:36:49.968365 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: INFO dbcounter [None req-c279d895-3ad9-4bf6-ad86-e058cff63605 None None] Registered counter for database nova_cell0 Jul 06 13:36:49.968965 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG oslo_concurrency.lockutils [None req-da93fd1a-ea8e-46bf-be06-5b882ee36977 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:36:49.970576 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG oslo_concurrency.lockutils [None req-da93fd1a-ea8e-46bf-be06-5b882ee36977 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:36:49.971384 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG oslo_concurrency.lockutils [None req-da93fd1a-ea8e-46bf-be06-5b882ee36977 None None] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:36:49.972243 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: INFO dbcounter [None req-c279d895-3ad9-4bf6-ad86-e058cff63605 None None] Registered counter for database nova_cell1 Jul 06 13:36:49.974014 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG oslo_concurrency.lockutils [None req-da93fd1a-ea8e-46bf-be06-5b882ee36977 None None] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:36:49.975980 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: INFO dbcounter [None req-da93fd1a-ea8e-46bf-be06-5b882ee36977 None None] Registered counter for database nova_cell0 Jul 06 13:36:49.979816 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG oslo_db.sqlalchemy.engines [None req-c279d895-3ad9-4bf6-ad86-e058cff63605 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109858) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 06 13:36:49.980047 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: INFO dbcounter [None req-da93fd1a-ea8e-46bf-be06-5b882ee36977 None None] Registered counter for database nova_cell1 Jul 06 13:36:49.982642 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG oslo_db.sqlalchemy.engines [None req-c279d895-3ad9-4bf6-ad86-e058cff63605 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109858) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 06 13:36:49.987132 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG oslo_db.sqlalchemy.engines [None req-da93fd1a-ea8e-46bf-be06-5b882ee36977 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109857) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 06 13:36:49.987482 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG dbcounter [-] [109858] Writer thread running {{(pid=109858) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 06 13:36:49.990948 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG oslo_db.sqlalchemy.engines [None req-da93fd1a-ea8e-46bf-be06-5b882ee36977 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109857) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 06 13:36:49.994293 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG dbcounter [-] [109857] Writer thread running {{(pid=109857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 06 13:36:50.128594 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG dbcounter [-] [109858] Writer thread running {{(pid=109858) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 06 13:36:50.141202 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: INFO dbcounter [None req-c279d895-3ad9-4bf6-ad86-e058cff63605 None None] Registered counter for database nova_cell0 Jul 06 13:36:50.143842 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG dbcounter [-] [109857] Writer thread running {{(pid=109857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 06 13:36:50.150712 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG oslo_db.sqlalchemy.engines [None req-c279d895-3ad9-4bf6-ad86-e058cff63605 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109858) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 06 13:36:50.154739 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: INFO dbcounter [None req-da93fd1a-ea8e-46bf-be06-5b882ee36977 None None] Registered counter for database nova_cell0 Jul 06 13:36:50.155094 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG dbcounter [-] [109858] Writer thread running {{(pid=109858) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 06 13:36:50.162021 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG oslo_db.sqlalchemy.engines [None req-da93fd1a-ea8e-46bf-be06-5b882ee36977 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109857) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 06 13:36:50.166292 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG dbcounter [-] [109857] Writer thread running {{(pid=109857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 06 13:36:50.503919 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: WARNING keystonemiddleware.auth_token [None req-c279d895-3ad9-4bf6-ad86-e058cff63605 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 06 13:36:50.506195 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: WARNING keystonemiddleware.auth_token [None req-da93fd1a-ea8e-46bf-be06-5b882ee36977 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 06 13:36:50.511410 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: WARNING keystonemiddleware.auth_token [None req-c279d895-3ad9-4bf6-ad86-e058cff63605 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 06 13:36:50.513551 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: WARNING keystonemiddleware.auth_token [None req-da93fd1a-ea8e-46bf-be06-5b882ee36977 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 06 13:36:50.858462 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: WARNING keystonemiddleware.auth_token [None req-c279d895-3ad9-4bf6-ad86-e058cff63605 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 06 13:36:50.864437 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: WARNING keystonemiddleware.auth_token [None req-c279d895-3ad9-4bf6-ad86-e058cff63605 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 06 13:36:50.869689 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x562f713de9c0 pid: 109858 (default app) Jul 06 13:36:50.871762 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi [None req-c279d895-3ad9-4bf6-ad86-e058cff63605 None None] Calling method '>' {{(pid=109858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:36:50.872754 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: WARNING keystonemiddleware.auth_token [None req-da93fd1a-ea8e-46bf-be06-5b882ee36977 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 06 13:36:50.872963 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: INFO nova.api.openstack.requestlog [None req-c279d895-3ad9-4bf6-ad86-e058cff63605 None None] 10.222.0.20 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001733 Jul 06 13:36:50.873410 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: [pid: 109858|app: 0|req: 1/1] 10.222.0.20 () {50 vars in 788 bytes} [Wed Jul 6 13:36:50 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 06 13:36:50.878727 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: WARNING keystonemiddleware.auth_token [None req-da93fd1a-ea8e-46bf-be06-5b882ee36977 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 06 13:36:50.885018 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x562f713de9c0 pid: 109857 (default app) Jul 06 13:38:06.059931 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi [None req-c279d895-3ad9-4bf6-ad86-e058cff63605 None None] Calling method '>' {{(pid=109858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:38:06.060982 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: INFO nova.api.openstack.requestlog [None req-c279d895-3ad9-4bf6-ad86-e058cff63605 None None] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001479 Jul 06 13:38:06.062178 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: [pid: 109858|app: 0|req: 2/2] 10.222.0.20 () {54 vars in 930 bytes} [Wed Jul 6 13:38:06 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 06 13:38:06.075744 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG dbcounter [-] [109857] Writing DB stats nova_api:SELECT=3 {{(pid=109857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:38:06.076661 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG dbcounter [-] [109857] Writing DB stats nova_cell0:SELECT=3 {{(pid=109857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:38:06.077413 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG dbcounter [-] [109857] Writing DB stats nova_cell1:SELECT=3 {{(pid=109857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:38:06.078502 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG dbcounter [-] [109857] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=109857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:38:06.537953 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi [None req-5cd26a65-9fe7-4208-a7ff-999cce1439ac admin admin] Calling method '>' {{(pid=109857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:38:06.568205 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: INFO nova.api.openstack.requestlog [None req-5cd26a65-9fe7-4208-a7ff-999cce1439ac admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.498034 Jul 06 13:38:06.569167 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: [pid: 109857|app: 0|req: 1/3] 10.222.0.20 () {60 vars in 1291 bytes} [Wed Jul 6 13:38:06 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:38:08.699424 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi [None req-c279d895-3ad9-4bf6-ad86-e058cff63605 None None] Calling method '>' {{(pid=109858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:38:08.700433 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: INFO nova.api.openstack.requestlog [None req-c279d895-3ad9-4bf6-ad86-e058cff63605 None None] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001425 Jul 06 13:38:08.700828 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: [pid: 109858|app: 0|req: 3/4] 10.222.0.20 () {54 vars in 930 bytes} [Wed Jul 6 13:38:08 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 06 13:38:08.763839 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi [None req-b6dcfc17-4e40-403f-8092-894d61af42be admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 1, "name": "cirros256", "swap": 0, "ram": 256, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "c1", "vcpus": 1, "rxtx_factor": 1.0}} {{(pid=109857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 06 13:38:08.782958 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 06 13:38:08.782958 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: warnings.warn(msg) Jul 06 13:38:08.814340 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: INFO nova.api.openstack.requestlog [None req-b6dcfc17-4e40-403f-8092-894d61af42be admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.106669 Jul 06 13:38:08.814845 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: [pid: 109857|app: 0|req: 2/5] 10.222.0.20 () {64 vars in 1282 bytes} [Wed Jul 6 13:38:08 2022] POST /compute/v2.1/flavors => generated 407 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 06 13:38:08.829693 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG dbcounter [-] [109858] Writing DB stats nova_api:SELECT=3 {{(pid=109858) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:38:08.830614 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG dbcounter [-] [109858] Writing DB stats nova_cell1:SELECT=3 {{(pid=109858) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:38:08.832520 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG dbcounter [-] [109858] Writing DB stats nova_cell0:SELECT=3 {{(pid=109858) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:38:08.833644 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG dbcounter [-] [109858] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=109858) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:38:09.051281 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi [None req-aa79f007-eea3-4a3f-9c86-9b7b4e34e1dc admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 06 13:38:09.053676 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 06 13:38:09.053676 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: warnings.warn(msg) Jul 06 13:38:09.117668 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: INFO nova.api.openstack.requestlog [None req-aa79f007-eea3-4a3f-9c86-9b7b4e34e1dc admin admin] 10.222.0.20 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.293334 Jul 06 13:38:09.118349 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: [pid: 109858|app: 0|req: 4/6] 10.222.0.20 () {64 vars in 1335 bytes} [Wed Jul 6 13:38:08 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:38:11.249645 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi [None req-b6dcfc17-4e40-403f-8092-894d61af42be admin admin] Calling method '>' {{(pid=109857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:38:11.250680 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: INFO nova.api.openstack.requestlog [None req-b6dcfc17-4e40-403f-8092-894d61af42be admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001499 Jul 06 13:38:11.251090 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: [pid: 109857|app: 0|req: 3/7] 10.222.0.20 () {54 vars in 930 bytes} [Wed Jul 6 13:38:11 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 06 13:38:11.355615 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi [None req-54723f15-4fd4-4d53-a11a-858d639b9a3c admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "name": "ds512M", "vcpus": 1, "rxtx_factor": 1.0, "swap": 0, "disk": 5, "id": "d1"}} {{(pid=109858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 06 13:38:11.373338 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 06 13:38:11.373338 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: warnings.warn(msg) Jul 06 13:38:11.391079 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: INFO nova.api.openstack.requestlog [None req-54723f15-4fd4-4d53-a11a-858d639b9a3c admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.133843 Jul 06 13:38:11.391635 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: [pid: 109858|app: 0|req: 5/8] 10.222.0.20 () {64 vars in 1282 bytes} [Wed Jul 6 13:38:11 2022] POST /compute/v2.1/flavors => generated 404 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 06 13:38:11.403840 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi [None req-1abde165-126e-4565-aca4-76cf89dcf974 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 06 13:38:11.405425 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 06 13:38:11.405425 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: warnings.warn(msg) Jul 06 13:38:11.437533 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: INFO nova.api.openstack.requestlog [None req-1abde165-126e-4565-aca4-76cf89dcf974 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.037329 Jul 06 13:38:11.438269 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: [pid: 109857|app: 0|req: 4/9] 10.222.0.20 () {64 vars in 1335 bytes} [Wed Jul 6 13:38:11 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:38:13.558310 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi [None req-54723f15-4fd4-4d53-a11a-858d639b9a3c admin admin] Calling method '>' {{(pid=109858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:38:13.559260 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: INFO nova.api.openstack.requestlog [None req-54723f15-4fd4-4d53-a11a-858d639b9a3c admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001453 Jul 06 13:38:13.559651 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: [pid: 109858|app: 0|req: 6/10] 10.222.0.20 () {54 vars in 930 bytes} [Wed Jul 6 13:38:13 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 06 13:38:13.621646 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi [None req-179555db-4ef4-4839-ab7f-4cb6c9e3c965 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 10, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "id": "d2", "name": "ds1G", "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "vcpus": 1, "ram": 1024}} {{(pid=109857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 06 13:38:13.640888 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: INFO nova.api.openstack.requestlog [None req-179555db-4ef4-4839-ab7f-4cb6c9e3c965 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.074449 Jul 06 13:38:13.641944 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: [pid: 109857|app: 0|req: 5/11] 10.222.0.20 () {64 vars in 1282 bytes} [Wed Jul 6 13:38:13 2022] POST /compute/v2.1/flavors => generated 404 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 06 13:38:13.653992 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi [None req-5f802038-d75b-4238-9a21-d0e4d3e2408a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 06 13:38:13.678818 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: INFO nova.api.openstack.requestlog [None req-5f802038-d75b-4238-9a21-d0e4d3e2408a admin admin] 10.222.0.20 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028814 Jul 06 13:38:13.679501 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: [pid: 109858|app: 0|req: 7/12] 10.222.0.20 () {64 vars in 1335 bytes} [Wed Jul 6 13:38:13 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:38:15.795032 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi [None req-179555db-4ef4-4839-ab7f-4cb6c9e3c965 admin admin] Calling method '>' {{(pid=109857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:38:15.796040 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: INFO nova.api.openstack.requestlog [None req-179555db-4ef4-4839-ab7f-4cb6c9e3c965 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001476 Jul 06 13:38:15.796439 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: [pid: 109857|app: 0|req: 6/13] 10.222.0.20 () {54 vars in 930 bytes} [Wed Jul 6 13:38:15 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 06 13:38:15.855903 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi [None req-de1d2baa-96bd-40a0-b127-9b2c486f43ad admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d3", "swap": 0, "vcpus": 2, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 2048, "disk": 10, "rxtx_factor": 1.0, "name": "ds2G", "os-flavor-access:is_public": true}} {{(pid=109858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 06 13:38:15.873457 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: INFO nova.api.openstack.requestlog [None req-de1d2baa-96bd-40a0-b127-9b2c486f43ad admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.070714 Jul 06 13:38:15.873997 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: [pid: 109858|app: 0|req: 8/14] 10.222.0.20 () {64 vars in 1282 bytes} [Wed Jul 6 13:38:15 2022] POST /compute/v2.1/flavors => generated 404 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 06 13:38:15.885793 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi [None req-e0b3f27d-a029-4da2-9a6d-599d5d3151cf admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 06 13:38:15.909462 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: INFO nova.api.openstack.requestlog [None req-e0b3f27d-a029-4da2-9a6d-599d5d3151cf admin admin] 10.222.0.20 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026616 Jul 06 13:38:15.910072 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: [pid: 109857|app: 0|req: 7/15] 10.222.0.20 () {64 vars in 1335 bytes} [Wed Jul 6 13:38:15 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:38:18.002300 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi [None req-de1d2baa-96bd-40a0-b127-9b2c486f43ad admin admin] Calling method '>' {{(pid=109858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:38:18.003862 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: INFO nova.api.openstack.requestlog [None req-de1d2baa-96bd-40a0-b127-9b2c486f43ad admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002009 Jul 06 13:38:18.004414 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: [pid: 109858|app: 0|req: 9/16] 10.222.0.20 () {54 vars in 930 bytes} [Wed Jul 6 13:38:18 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 06 13:38:18.069856 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi [None req-96bafe3c-8731-4bed-8a33-4c0ce437f128 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d4", "vcpus": 4, "rxtx_factor": 1.0, "swap": 0, "os-flavor-access:is_public": true, "ram": 4096, "name": "ds4G", "disk": 20, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=109857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 06 13:38:18.087231 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: INFO nova.api.openstack.requestlog [None req-96bafe3c-8731-4bed-8a33-4c0ce437f128 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.077264 Jul 06 13:38:18.087779 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: [pid: 109857|app: 0|req: 8/17] 10.222.0.20 () {64 vars in 1282 bytes} [Wed Jul 6 13:38:18 2022] POST /compute/v2.1/flavors => generated 404 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 06 13:38:18.099794 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi [None req-80dacfd9-8065-4107-af4b-94c4ce77114f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 06 13:38:18.122745 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: INFO nova.api.openstack.requestlog [None req-80dacfd9-8065-4107-af4b-94c4ce77114f admin admin] 10.222.0.20 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026823 Jul 06 13:38:18.123317 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: [pid: 109858|app: 0|req: 10/18] 10.222.0.20 () {64 vars in 1335 bytes} [Wed Jul 6 13:38:18 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 06 13:38:20.242125 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi [None req-96bafe3c-8731-4bed-8a33-4c0ce437f128 admin admin] Calling method '>' {{(pid=109857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:38:20.243148 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: INFO nova.api.openstack.requestlog [None req-96bafe3c-8731-4bed-8a33-4c0ce437f128 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001435 Jul 06 13:38:20.243548 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: [pid: 109857|app: 0|req: 9/19] 10.222.0.20 () {54 vars in 930 bytes} [Wed Jul 6 13:38:20 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 06 13:38:20.304970 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi [None req-4e281355-d78e-4c8b-9cf1-ac5006fd81f7 admin admin] Calling method '>' {{(pid=109858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:38:20.328886 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: INFO nova.api.openstack.requestlog [None req-4e281355-d78e-4c8b-9cf1-ac5006fd81f7 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.079240 Jul 06 13:38:20.329835 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: [pid: 109858|app: 0|req: 11/20] 10.222.0.20 () {60 vars in 1291 bytes} [Wed Jul 6 13:38:20 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 06 13:38:22.465864 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi [None req-96bafe3c-8731-4bed-8a33-4c0ce437f128 admin admin] Calling method '>' {{(pid=109857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:38:22.466914 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: INFO nova.api.openstack.requestlog [None req-96bafe3c-8731-4bed-8a33-4c0ce437f128 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001521 Jul 06 13:38:22.467351 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: [pid: 109857|app: 0|req: 10/21] 10.222.0.20 () {54 vars in 930 bytes} [Wed Jul 6 13:38:22 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 06 13:38:22.528456 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi [None req-fe03e437-c67d-4f80-b247-5e88190b3853 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 1, "swap": 0, "os-flavor-access:is_public": true, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "id": "1", "name": "m1.tiny", "ram": 512}} {{(pid=109858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 06 13:38:22.547517 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: INFO nova.api.openstack.requestlog [None req-fe03e437-c67d-4f80-b247-5e88190b3853 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.074405 Jul 06 13:38:22.548356 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: [pid: 109858|app: 0|req: 12/22] 10.222.0.20 () {64 vars in 1282 bytes} [Wed Jul 6 13:38:22 2022] POST /compute/v2.1/flavors => generated 402 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 06 13:38:22.563238 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi [None req-8a427b1b-c514-49d5-836f-5b47e378b2f7 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 06 13:38:22.591946 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: INFO nova.api.openstack.requestlog [None req-8a427b1b-c514-49d5-836f-5b47e378b2f7 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.033433 Jul 06 13:38:22.592470 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: [pid: 109857|app: 0|req: 11/23] 10.222.0.20 () {64 vars in 1332 bytes} [Wed Jul 6 13:38:22 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:38:24.761161 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi [None req-fe03e437-c67d-4f80-b247-5e88190b3853 admin admin] Calling method '>' {{(pid=109858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:38:24.762179 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: INFO nova.api.openstack.requestlog [None req-fe03e437-c67d-4f80-b247-5e88190b3853 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001493 Jul 06 13:38:24.762583 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: [pid: 109858|app: 0|req: 13/24] 10.222.0.20 () {54 vars in 930 bytes} [Wed Jul 6 13:38:24 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 06 13:38:24.827355 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi [None req-57db353c-e07e-48ab-bd76-54ab32778269 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "disk": 20, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "os-flavor-access:is_public": true, "ram": 2048, "name": "m1.small", "swap": 0, "id": "2"}} {{(pid=109857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 06 13:38:24.849093 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: INFO nova.api.openstack.requestlog [None req-57db353c-e07e-48ab-bd76-54ab32778269 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.078473 Jul 06 13:38:24.849717 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: [pid: 109857|app: 0|req: 12/25] 10.222.0.20 () {64 vars in 1282 bytes} [Wed Jul 6 13:38:24 2022] POST /compute/v2.1/flavors => generated 405 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 06 13:38:24.861777 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi [None req-23e949f1-28ff-4615-925d-f69fde459ddd admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 06 13:38:24.883986 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: INFO nova.api.openstack.requestlog [None req-23e949f1-28ff-4615-925d-f69fde459ddd admin admin] 10.222.0.20 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.025917 Jul 06 13:38:24.884555 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: [pid: 109858|app: 0|req: 14/26] 10.222.0.20 () {64 vars in 1332 bytes} [Wed Jul 6 13:38:24 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:38:27.071684 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi [None req-57db353c-e07e-48ab-bd76-54ab32778269 admin admin] Calling method '>' {{(pid=109857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:38:27.073074 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: INFO nova.api.openstack.requestlog [None req-57db353c-e07e-48ab-bd76-54ab32778269 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001922 Jul 06 13:38:27.073599 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: [pid: 109857|app: 0|req: 13/27] 10.222.0.20 () {54 vars in 930 bytes} [Wed Jul 6 13:38:27 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 06 13:38:27.133569 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi [None req-396d5aa2-58c1-4d69-8dbe-798fe03799c8 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.medium", "swap": 0, "vcpus": 2, "ram": 4096, "disk": 40, "id": "3"}} {{(pid=109858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 06 13:38:27.152278 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: INFO nova.api.openstack.requestlog [None req-396d5aa2-58c1-4d69-8dbe-798fe03799c8 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.071601 Jul 06 13:38:27.152831 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: [pid: 109858|app: 0|req: 15/28] 10.222.0.20 () {64 vars in 1282 bytes} [Wed Jul 6 13:38:27 2022] POST /compute/v2.1/flavors => generated 406 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 06 13:38:27.169088 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi [None req-cc5cfff9-b2d2-4642-b9a4-602608cccfd2 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 06 13:38:27.195848 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: INFO nova.api.openstack.requestlog [None req-cc5cfff9-b2d2-4642-b9a4-602608cccfd2 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031351 Jul 06 13:38:27.196602 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: [pid: 109857|app: 0|req: 14/29] 10.222.0.20 () {64 vars in 1332 bytes} [Wed Jul 6 13:38:27 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:38:29.350841 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi [None req-396d5aa2-58c1-4d69-8dbe-798fe03799c8 admin admin] Calling method '>' {{(pid=109858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:38:29.351875 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: INFO nova.api.openstack.requestlog [None req-396d5aa2-58c1-4d69-8dbe-798fe03799c8 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001457 Jul 06 13:38:29.352270 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: [pid: 109858|app: 0|req: 16/30] 10.222.0.20 () {54 vars in 930 bytes} [Wed Jul 6 13:38:29 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 06 13:38:29.409786 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi [None req-c1c266a0-c2bc-4b9c-aa17-7573abcda251 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "swap": 0, "vcpus": 4, "disk": 80, "id": "4", "ram": 8192, "rxtx_factor": 1.0, "name": "m1.large"}} {{(pid=109857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 06 13:38:29.427546 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: INFO nova.api.openstack.requestlog [None req-c1c266a0-c2bc-4b9c-aa17-7573abcda251 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.069423 Jul 06 13:38:29.428086 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: [pid: 109857|app: 0|req: 15/31] 10.222.0.20 () {64 vars in 1282 bytes} [Wed Jul 6 13:38:29 2022] POST /compute/v2.1/flavors => generated 405 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 06 13:38:29.440008 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi [None req-4b7059ec-db84-4ee3-a29a-89516c53000d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 06 13:38:29.462752 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: INFO nova.api.openstack.requestlog [None req-4b7059ec-db84-4ee3-a29a-89516c53000d admin admin] 10.222.0.20 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026476 Jul 06 13:38:29.463340 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: [pid: 109858|app: 0|req: 17/32] 10.222.0.20 () {64 vars in 1332 bytes} [Wed Jul 6 13:38:29 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:38:31.569680 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi [None req-c1c266a0-c2bc-4b9c-aa17-7573abcda251 admin admin] Calling method '>' {{(pid=109857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:38:31.571325 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: INFO nova.api.openstack.requestlog [None req-c1c266a0-c2bc-4b9c-aa17-7573abcda251 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002100 Jul 06 13:38:31.571722 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: [pid: 109857|app: 0|req: 16/33] 10.222.0.20 () {54 vars in 930 bytes} [Wed Jul 6 13:38:31 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 06 13:38:31.632475 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi [None req-ad23488d-f6df-441e-b32a-c8ed5fc932e0 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "disk": 160, "id": "5", "swap": 0, "os-flavor-access:is_public": true, "ram": 16384, "vcpus": 8, "rxtx_factor": 1.0, "name": "m1.xlarge"}} {{(pid=109858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 06 13:38:31.651371 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: INFO nova.api.openstack.requestlog [None req-ad23488d-f6df-441e-b32a-c8ed5fc932e0 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.073790 Jul 06 13:38:31.658043 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: [pid: 109858|app: 0|req: 18/34] 10.222.0.20 () {64 vars in 1282 bytes} [Wed Jul 6 13:38:31 2022] POST /compute/v2.1/flavors => generated 408 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 06 13:38:31.664156 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi [None req-72dcc7d9-7163-4884-af1a-dcd36fbf285c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 06 13:38:31.692134 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: INFO nova.api.openstack.requestlog [None req-72dcc7d9-7163-4884-af1a-dcd36fbf285c admin admin] 10.222.0.20 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031586 Jul 06 13:38:31.692917 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: [pid: 109857|app: 0|req: 17/35] 10.222.0.20 () {64 vars in 1332 bytes} [Wed Jul 6 13:38:31 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 06 13:38:56.290055 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi [None req-ad23488d-f6df-441e-b32a-c8ed5fc932e0 admin admin] Calling method '>' {{(pid=109858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:38:56.291140 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: INFO nova.api.openstack.requestlog [None req-ad23488d-f6df-441e-b32a-c8ed5fc932e0 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001507 Jul 06 13:38:56.291616 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: [pid: 109858|app: 0|req: 19/36] 10.222.0.20 () {54 vars in 930 bytes} [Wed Jul 6 13:38:56 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 06 13:38:56.302829 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG dbcounter [-] [109857] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=10,nova_api:SAVEPOINT=5,nova_api:RELEASE=5 {{(pid=109857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:38:56.354709 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi [None req-26efd4e6-c5db-4292-b535-ed52cc8ba6de admin admin] Calling method '>' {{(pid=109857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:38:56.371946 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: INFO nova.api.openstack.requestlog [None req-26efd4e6-c5db-4292-b535-ed52cc8ba6de admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.074416 Jul 06 13:38:56.372473 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: [pid: 109857|app: 0|req: 18/37] 10.222.0.20 () {60 vars in 1291 bytes} [Wed Jul 6 13:38:56 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 06 13:38:57.356842 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi [None req-ad23488d-f6df-441e-b32a-c8ed5fc932e0 admin admin] Calling method '>' {{(pid=109858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:38:57.357903 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: INFO nova.api.openstack.requestlog [None req-ad23488d-f6df-441e-b32a-c8ed5fc932e0 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001443 Jul 06 13:38:57.358322 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: [pid: 109858|app: 0|req: 20/38] 10.222.0.20 () {56 vars in 1074 bytes} [Wed Jul 6 13:38:57 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 06 13:38:57.546625 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi [None req-b1177eb9-09c6-48f6-a7dc-deabd8ca823b admin admin] Calling method '>' {{(pid=109857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:38:57.552359 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: INFO nova.api.openstack.wsgi [None req-b1177eb9-09c6-48f6-a7dc-deabd8ca823b admin admin] HTTP exception thrown: Flavor 42 could not be found. Jul 06 13:38:57.555615 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi [None req-b1177eb9-09c6-48f6-a7dc-deabd8ca823b admin admin] Request method failure captured: Jul 06 13:38:57.555615 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jul 06 13:38:57.555615 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: Accept: application/json Jul 06 13:38:57.555615 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: Accept-Encoding: gzip, deflate Jul 06 13:38:57.555615 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: Connection: keep-alive Jul 06 13:38:57.555615 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: Content-Length: 0 Jul 06 13:38:57.555615 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: Host: 10.222.0.20 Jul 06 13:38:57.555615 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: Openstack-Api-Version: compute 2.90 Jul 06 13:38:57.555615 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: Openstack-System-Scope: None Jul 06 13:38:57.555615 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: User-Agent: python-novaclient Jul 06 13:38:57.555615 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: X-Auth-Token: gAAAAABixZBxwdcdUC4fyc5E7tjkFmOvTgYPQy2-e6F2x921mI_gb49f7fAbuzTXQ3ZG5EBTGY7jlhRYtW0fYgpg1JNc7gVI4xb-C8uSH0TD7xepOq_Zj8CiHS14Sm5Xx-K9NQXKo_LovJqPER7UYEv9h6Twuh9q81uzrYc_DVPnR6qEx_I0tBg Jul 06 13:38:57.555615 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: X-Domain-Id: None Jul 06 13:38:57.555615 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: X-Domain-Name: None Jul 06 13:38:57.555615 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: X-Identity-Status: Confirmed Jul 06 13:38:57.555615 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: X-Is-Admin-Project: True Jul 06 13:38:57.555615 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: X-Openstack-Nova-Api-Version: 2.90 Jul 06 13:38:57.555615 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: X-Project-Domain-Id: default Jul 06 13:38:57.555615 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: X-Project-Domain-Name: Default Jul 06 13:38:57.555615 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: X-Project-Id: 775434dcf39c43beaa4ed6a50089f763 Jul 06 13:38:57.555615 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: X-Project-Name: admin Jul 06 13:38:57.555615 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: X-Role: admin,reader,member Jul 06 13:38:57.555615 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: X-Roles: admin,reader,member Jul 06 13:38:57.557227 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_775434dcf39c43beaa4ed6a50089f763"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/775434dcf39c43beaa4ed6a50089f763"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/775434dcf39c43beaa4ed6a50089f763"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/775434dcf39c43beaa4ed6a50089f763"}]}] Jul 06 13:38:57.557227 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: X-Tenant: admin Jul 06 13:38:57.557227 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: X-Tenant-Id: 775434dcf39c43beaa4ed6a50089f763 Jul 06 13:38:57.557227 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: X-Tenant-Name: admin Jul 06 13:38:57.557227 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: X-User: admin Jul 06 13:38:57.557227 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: X-User-Domain-Id: default Jul 06 13:38:57.557227 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: X-User-Domain-Name: Default Jul 06 13:38:57.557227 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: X-User-Id: c17e13a3d58f4ceab768f46d43e2cab5 Jul 06 13:38:57.557227 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: X-User-Name: admin Jul 06 13:38:57.557227 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: method: > Jul 06 13:38:57.557227 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: exception: Flavor 42 could not be found. Jul 06 13:38:57.557227 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: action_args: {'id': '42'} Jul 06 13:38:57.557227 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: {{(pid=109857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 06 13:38:57.557227 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 06 13:38:57.558236 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 06 13:38:57.558236 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 06 13:38:57.558236 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 06 13:38:57.558236 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 06 13:38:57.558236 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 06 13:38:57.558236 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 06 13:38:57.558236 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 06 13:38:57.558236 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 06 13:38:57.558236 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 06 13:38:57.558236 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 06 13:38:57.558236 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 06 13:38:57.558236 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 06 13:38:57.558236 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jul 06 13:38:57.558236 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: ERROR nova.api.openstack.wsgi Jul 06 13:38:57.558236 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 06 13:38:57.558236 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: ERROR nova.api.openstack.wsgi Jul 06 13:38:57.558236 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 06 13:38:57.558236 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 06 13:38:57.558236 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 06 13:38:57.559553 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 06 13:38:57.559553 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 06 13:38:57.559553 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 06 13:38:57.559553 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 06 13:38:57.559553 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 06 13:38:57.559553 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 06 13:38:57.559553 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jul 06 13:38:57.559553 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: ERROR nova.api.openstack.wsgi Jul 06 13:38:57.559553 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 06 13:38:57.559553 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: ERROR nova.api.openstack.wsgi Jul 06 13:38:57.559553 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 06 13:38:57.559553 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 06 13:38:57.559553 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 06 13:38:57.559553 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 06 13:38:57.559553 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 06 13:38:57.559553 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jul 06 13:38:57.559553 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: ERROR nova.api.openstack.wsgi Jul 06 13:38:57.559553 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi [None req-b1177eb9-09c6-48f6-a7dc-deabd8ca823b admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=109857) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 06 13:38:57.560858 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: INFO nova.api.openstack.requestlog [None req-b1177eb9-09c6-48f6-a7dc-deabd8ca823b admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.060886 Jul 06 13:38:57.560858 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: [pid: 109857|app: 0|req: 19/39] 10.222.0.20 () {60 vars in 1190 bytes} [Wed Jul 6 13:38:57 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 06 13:38:57.567166 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi [None req-5f3512d4-6ef5-4152-9b89-944480282b29 admin admin] Calling method '>' {{(pid=109858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:38:57.570121 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG dbcounter [-] [109858] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=109858) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:38:57.590719 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: INFO nova.api.openstack.requestlog [None req-5f3512d4-6ef5-4152-9b89-944480282b29 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.027599 Jul 06 13:38:57.591273 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: [pid: 109858|app: 0|req: 21/40] 10.222.0.20 () {60 vars in 1210 bytes} [Wed Jul 6 13:38:57 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 06 13:38:57.601133 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi [None req-2ab68846-37fc-4cd6-b5da-95a98449b17b admin admin] Calling method '>' {{(pid=109857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:38:57.622037 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: INFO nova.api.openstack.requestlog [None req-2ab68846-37fc-4cd6-b5da-95a98449b17b admin admin] 10.222.0.20 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.024586 Jul 06 13:38:57.622585 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: [pid: 109857|app: 0|req: 20/41] 10.222.0.20 () {60 vars in 1210 bytes} [Wed Jul 6 13:38:57 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 06 13:38:57.633249 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi [None req-78f9c36a-73d5-4fca-8618-06029f0b393e admin admin] Calling method '>' {{(pid=109858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:38:57.639519 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: INFO nova.api.openstack.wsgi [None req-78f9c36a-73d5-4fca-8618-06029f0b393e admin admin] HTTP exception thrown: Flavor 42 could not be found. Jul 06 13:38:57.643504 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi [None req-78f9c36a-73d5-4fca-8618-06029f0b393e admin admin] Request method failure captured: Jul 06 13:38:57.643504 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jul 06 13:38:57.643504 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: Accept: application/json Jul 06 13:38:57.643504 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: Accept-Encoding: gzip, deflate Jul 06 13:38:57.643504 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: Connection: keep-alive Jul 06 13:38:57.643504 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: Content-Length: 0 Jul 06 13:38:57.643504 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: Host: 10.222.0.20 Jul 06 13:38:57.643504 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: Openstack-Api-Version: compute 2.90 Jul 06 13:38:57.643504 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: Openstack-System-Scope: None Jul 06 13:38:57.643504 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: User-Agent: python-novaclient Jul 06 13:38:57.643504 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: X-Auth-Token: gAAAAABixZBxwdcdUC4fyc5E7tjkFmOvTgYPQy2-e6F2x921mI_gb49f7fAbuzTXQ3ZG5EBTGY7jlhRYtW0fYgpg1JNc7gVI4xb-C8uSH0TD7xepOq_Zj8CiHS14Sm5Xx-K9NQXKo_LovJqPER7UYEv9h6Twuh9q81uzrYc_DVPnR6qEx_I0tBg Jul 06 13:38:57.643504 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: X-Domain-Id: None Jul 06 13:38:57.643504 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: X-Domain-Name: None Jul 06 13:38:57.643504 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: X-Identity-Status: Confirmed Jul 06 13:38:57.643504 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: X-Is-Admin-Project: True Jul 06 13:38:57.643504 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: X-Openstack-Nova-Api-Version: 2.90 Jul 06 13:38:57.643504 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: X-Project-Domain-Id: default Jul 06 13:38:57.643504 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: X-Project-Domain-Name: Default Jul 06 13:38:57.643504 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: X-Project-Id: 775434dcf39c43beaa4ed6a50089f763 Jul 06 13:38:57.643504 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: X-Project-Name: admin Jul 06 13:38:57.643504 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: X-Role: admin,reader,member Jul 06 13:38:57.643504 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: X-Roles: admin,reader,member Jul 06 13:38:57.644834 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_775434dcf39c43beaa4ed6a50089f763"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/775434dcf39c43beaa4ed6a50089f763"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/775434dcf39c43beaa4ed6a50089f763"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/775434dcf39c43beaa4ed6a50089f763"}]}] Jul 06 13:38:57.644834 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: X-Tenant: admin Jul 06 13:38:57.644834 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: X-Tenant-Id: 775434dcf39c43beaa4ed6a50089f763 Jul 06 13:38:57.644834 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: X-Tenant-Name: admin Jul 06 13:38:57.644834 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: X-User: admin Jul 06 13:38:57.644834 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: X-User-Domain-Id: default Jul 06 13:38:57.644834 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: X-User-Domain-Name: Default Jul 06 13:38:57.644834 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: X-User-Id: c17e13a3d58f4ceab768f46d43e2cab5 Jul 06 13:38:57.644834 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: X-User-Name: admin Jul 06 13:38:57.644834 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: method: > Jul 06 13:38:57.644834 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: exception: Flavor 42 could not be found. Jul 06 13:38:57.644834 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: action_args: {'id': '42'} Jul 06 13:38:57.644834 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: {{(pid=109858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 06 13:38:57.644834 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 06 13:38:57.645689 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 06 13:38:57.645689 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 06 13:38:57.645689 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 06 13:38:57.645689 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 06 13:38:57.645689 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 06 13:38:57.645689 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 06 13:38:57.645689 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 06 13:38:57.645689 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 06 13:38:57.645689 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 06 13:38:57.645689 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 06 13:38:57.645689 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 06 13:38:57.645689 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 06 13:38:57.645689 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jul 06 13:38:57.645689 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: ERROR nova.api.openstack.wsgi Jul 06 13:38:57.645689 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 06 13:38:57.645689 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: ERROR nova.api.openstack.wsgi Jul 06 13:38:57.645689 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 06 13:38:57.645689 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 06 13:38:57.645689 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 06 13:38:57.646908 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 06 13:38:57.646908 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 06 13:38:57.646908 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 06 13:38:57.646908 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 06 13:38:57.646908 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 06 13:38:57.646908 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 06 13:38:57.646908 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jul 06 13:38:57.646908 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: ERROR nova.api.openstack.wsgi Jul 06 13:38:57.646908 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 06 13:38:57.646908 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: ERROR nova.api.openstack.wsgi Jul 06 13:38:57.646908 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 06 13:38:57.646908 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 06 13:38:57.646908 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 06 13:38:57.646908 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 06 13:38:57.646908 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 06 13:38:57.646908 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jul 06 13:38:57.646908 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: ERROR nova.api.openstack.wsgi Jul 06 13:38:57.646908 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi [None req-78f9c36a-73d5-4fca-8618-06029f0b393e admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=109858) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 06 13:38:57.648118 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: INFO nova.api.openstack.requestlog [None req-78f9c36a-73d5-4fca-8618-06029f0b393e admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.016205 Jul 06 13:38:57.648118 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: [pid: 109858|app: 0|req: 22/42] 10.222.0.20 () {60 vars in 1190 bytes} [Wed Jul 6 13:38:57 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 06 13:38:58.465732 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi [None req-2ab68846-37fc-4cd6-b5da-95a98449b17b admin admin] Calling method '>' {{(pid=109857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:38:58.466738 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: INFO nova.api.openstack.requestlog [None req-2ab68846-37fc-4cd6-b5da-95a98449b17b admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001456 Jul 06 13:38:58.467130 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: [pid: 109857|app: 0|req: 21/43] 10.222.0.20 () {56 vars in 1074 bytes} [Wed Jul 6 13:38:58 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 06 13:38:58.655724 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi [None req-a93cebfc-8f16-4f11-b132-dfbbbaa4e50a admin admin] Calling method '>' {{(pid=109858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:38:58.661753 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: INFO nova.api.openstack.wsgi [None req-a93cebfc-8f16-4f11-b132-dfbbbaa4e50a admin admin] HTTP exception thrown: Flavor 84 could not be found. Jul 06 13:38:58.663260 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi [None req-a93cebfc-8f16-4f11-b132-dfbbbaa4e50a admin admin] Request method failure captured: Jul 06 13:38:58.663260 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jul 06 13:38:58.663260 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: Accept: application/json Jul 06 13:38:58.663260 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: Accept-Encoding: gzip, deflate Jul 06 13:38:58.663260 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: Connection: keep-alive Jul 06 13:38:58.663260 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: Content-Length: 0 Jul 06 13:38:58.663260 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: Host: 10.222.0.20 Jul 06 13:38:58.663260 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: Openstack-Api-Version: compute 2.90 Jul 06 13:38:58.663260 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: Openstack-System-Scope: None Jul 06 13:38:58.663260 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: User-Agent: python-novaclient Jul 06 13:38:58.663260 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: X-Auth-Token: gAAAAABixZByB-S_Z5Z5y8crJ4djQMLJ9QFMRy730bMJ7mxQRJMNME7BRIvl9WTxTsSij2a7h8-LXl9MeyjKF_Ey2Z_nz3AUM-_jFfKNpo4P-TPsDbkbRIVnX53eqvN24qA6EkiKxzyXYcdngifrVtw_R3Wckn1VpN_v4s5d40btU3CBB6ywtXQ Jul 06 13:38:58.663260 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: X-Domain-Id: None Jul 06 13:38:58.663260 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: X-Domain-Name: None Jul 06 13:38:58.663260 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: X-Identity-Status: Confirmed Jul 06 13:38:58.663260 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: X-Is-Admin-Project: True Jul 06 13:38:58.663260 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: X-Openstack-Nova-Api-Version: 2.90 Jul 06 13:38:58.663260 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: X-Project-Domain-Id: default Jul 06 13:38:58.663260 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: X-Project-Domain-Name: Default Jul 06 13:38:58.663260 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: X-Project-Id: 775434dcf39c43beaa4ed6a50089f763 Jul 06 13:38:58.663260 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: X-Project-Name: admin Jul 06 13:38:58.663260 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: X-Role: admin,reader,member Jul 06 13:38:58.663260 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: X-Roles: admin,reader,member Jul 06 13:38:58.664653 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_775434dcf39c43beaa4ed6a50089f763"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/775434dcf39c43beaa4ed6a50089f763"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/775434dcf39c43beaa4ed6a50089f763"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/775434dcf39c43beaa4ed6a50089f763"}]}] Jul 06 13:38:58.664653 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: X-Tenant: admin Jul 06 13:38:58.664653 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: X-Tenant-Id: 775434dcf39c43beaa4ed6a50089f763 Jul 06 13:38:58.664653 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: X-Tenant-Name: admin Jul 06 13:38:58.664653 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: X-User: admin Jul 06 13:38:58.664653 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: X-User-Domain-Id: default Jul 06 13:38:58.664653 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: X-User-Domain-Name: Default Jul 06 13:38:58.664653 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: X-User-Id: c17e13a3d58f4ceab768f46d43e2cab5 Jul 06 13:38:58.664653 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: X-User-Name: admin Jul 06 13:38:58.664653 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: method: > Jul 06 13:38:58.664653 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: exception: Flavor 84 could not be found. Jul 06 13:38:58.664653 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: action_args: {'id': '84'} Jul 06 13:38:58.664653 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: {{(pid=109858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 06 13:38:58.664653 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 06 13:38:58.665509 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 06 13:38:58.665509 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 06 13:38:58.665509 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 06 13:38:58.665509 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 06 13:38:58.665509 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 06 13:38:58.665509 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 06 13:38:58.665509 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 06 13:38:58.665509 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 06 13:38:58.665509 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 06 13:38:58.665509 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 06 13:38:58.665509 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 06 13:38:58.665509 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 06 13:38:58.665509 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jul 06 13:38:58.665509 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: ERROR nova.api.openstack.wsgi Jul 06 13:38:58.665509 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 06 13:38:58.665509 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: ERROR nova.api.openstack.wsgi Jul 06 13:38:58.665509 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 06 13:38:58.665509 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 06 13:38:58.665509 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 06 13:38:58.666839 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 06 13:38:58.666839 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 06 13:38:58.666839 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 06 13:38:58.666839 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 06 13:38:58.666839 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 06 13:38:58.666839 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 06 13:38:58.666839 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jul 06 13:38:58.666839 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: ERROR nova.api.openstack.wsgi Jul 06 13:38:58.666839 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 06 13:38:58.666839 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: ERROR nova.api.openstack.wsgi Jul 06 13:38:58.666839 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 06 13:38:58.666839 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 06 13:38:58.666839 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 06 13:38:58.666839 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 06 13:38:58.666839 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 06 13:38:58.666839 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jul 06 13:38:58.666839 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: ERROR nova.api.openstack.wsgi Jul 06 13:38:58.666839 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi [None req-a93cebfc-8f16-4f11-b132-dfbbbaa4e50a admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=109858) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 06 13:38:58.668154 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: INFO nova.api.openstack.requestlog [None req-a93cebfc-8f16-4f11-b132-dfbbbaa4e50a admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.061070 Jul 06 13:38:58.668154 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: [pid: 109858|app: 0|req: 23/44] 10.222.0.20 () {60 vars in 1190 bytes} [Wed Jul 6 13:38:58 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 06 13:38:58.674679 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi [None req-606e5299-3f29-4550-8ee1-e7d482a9673e admin admin] Calling method '>' {{(pid=109857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:38:58.688150 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: INFO nova.api.openstack.requestlog [None req-606e5299-3f29-4550-8ee1-e7d482a9673e admin admin] 10.222.0.20 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017539 Jul 06 13:38:58.688675 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: [pid: 109857|app: 0|req: 22/45] 10.222.0.20 () {60 vars in 1210 bytes} [Wed Jul 6 13:38:58 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 06 13:38:58.697995 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi [None req-c4662a6a-2b4e-44f1-a0c0-7f6743619d44 admin admin] Calling method '>' {{(pid=109858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:38:58.712169 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: INFO nova.api.openstack.requestlog [None req-c4662a6a-2b4e-44f1-a0c0-7f6743619d44 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017693 Jul 06 13:38:58.712691 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: [pid: 109858|app: 0|req: 24/46] 10.222.0.20 () {60 vars in 1210 bytes} [Wed Jul 6 13:38:58 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 06 13:38:58.722338 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi [None req-ec4c9bad-f3d9-4781-9793-f0c652516757 admin admin] Calling method '>' {{(pid=109857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:38:58.727567 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: INFO nova.api.openstack.wsgi [None req-ec4c9bad-f3d9-4781-9793-f0c652516757 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jul 06 13:38:58.729095 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi [None req-ec4c9bad-f3d9-4781-9793-f0c652516757 admin admin] Request method failure captured: Jul 06 13:38:58.729095 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jul 06 13:38:58.729095 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: Accept: application/json Jul 06 13:38:58.729095 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: Accept-Encoding: gzip, deflate Jul 06 13:38:58.729095 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: Connection: keep-alive Jul 06 13:38:58.729095 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: Content-Length: 0 Jul 06 13:38:58.729095 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: Host: 10.222.0.20 Jul 06 13:38:58.729095 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: Openstack-Api-Version: compute 2.90 Jul 06 13:38:58.729095 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: Openstack-System-Scope: None Jul 06 13:38:58.729095 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: User-Agent: python-novaclient Jul 06 13:38:58.729095 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: X-Auth-Token: gAAAAABixZByB-S_Z5Z5y8crJ4djQMLJ9QFMRy730bMJ7mxQRJMNME7BRIvl9WTxTsSij2a7h8-LXl9MeyjKF_Ey2Z_nz3AUM-_jFfKNpo4P-TPsDbkbRIVnX53eqvN24qA6EkiKxzyXYcdngifrVtw_R3Wckn1VpN_v4s5d40btU3CBB6ywtXQ Jul 06 13:38:58.729095 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: X-Domain-Id: None Jul 06 13:38:58.729095 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: X-Domain-Name: None Jul 06 13:38:58.729095 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: X-Identity-Status: Confirmed Jul 06 13:38:58.729095 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: X-Is-Admin-Project: True Jul 06 13:38:58.729095 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: X-Openstack-Nova-Api-Version: 2.90 Jul 06 13:38:58.729095 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: X-Project-Domain-Id: default Jul 06 13:38:58.729095 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: X-Project-Domain-Name: Default Jul 06 13:38:58.729095 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: X-Project-Id: 775434dcf39c43beaa4ed6a50089f763 Jul 06 13:38:58.729095 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: X-Project-Name: admin Jul 06 13:38:58.729095 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: X-Role: admin,reader,member Jul 06 13:38:58.729095 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: X-Roles: admin,reader,member Jul 06 13:38:58.730587 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_775434dcf39c43beaa4ed6a50089f763"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/775434dcf39c43beaa4ed6a50089f763"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/775434dcf39c43beaa4ed6a50089f763"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/775434dcf39c43beaa4ed6a50089f763"}]}] Jul 06 13:38:58.730587 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: X-Tenant: admin Jul 06 13:38:58.730587 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: X-Tenant-Id: 775434dcf39c43beaa4ed6a50089f763 Jul 06 13:38:58.730587 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: X-Tenant-Name: admin Jul 06 13:38:58.730587 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: X-User: admin Jul 06 13:38:58.730587 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: X-User-Domain-Id: default Jul 06 13:38:58.730587 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: X-User-Domain-Name: Default Jul 06 13:38:58.730587 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: X-User-Id: c17e13a3d58f4ceab768f46d43e2cab5 Jul 06 13:38:58.730587 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: X-User-Name: admin Jul 06 13:38:58.730587 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: method: > Jul 06 13:38:58.730587 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: exception: Flavor 84 could not be found. Jul 06 13:38:58.730587 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: action_args: {'id': '84'} Jul 06 13:38:58.730587 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: {{(pid=109857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 06 13:38:58.730587 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 06 13:38:58.731525 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 06 13:38:58.731525 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 06 13:38:58.731525 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 06 13:38:58.731525 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 06 13:38:58.731525 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 06 13:38:58.731525 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 06 13:38:58.731525 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 06 13:38:58.731525 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 06 13:38:58.731525 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 06 13:38:58.731525 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 06 13:38:58.731525 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 06 13:38:58.731525 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 06 13:38:58.731525 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jul 06 13:38:58.731525 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: ERROR nova.api.openstack.wsgi Jul 06 13:38:58.731525 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 06 13:38:58.731525 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: ERROR nova.api.openstack.wsgi Jul 06 13:38:58.731525 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 06 13:38:58.731525 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 06 13:38:58.731525 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 06 13:38:58.732586 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 06 13:38:58.732586 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 06 13:38:58.732586 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 06 13:38:58.732586 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 06 13:38:58.732586 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 06 13:38:58.732586 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 06 13:38:58.732586 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jul 06 13:38:58.732586 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: ERROR nova.api.openstack.wsgi Jul 06 13:38:58.732586 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 06 13:38:58.732586 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: ERROR nova.api.openstack.wsgi Jul 06 13:38:58.732586 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 06 13:38:58.732586 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 06 13:38:58.732586 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 06 13:38:58.732586 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 06 13:38:58.732586 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 06 13:38:58.732586 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jul 06 13:38:58.732586 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: ERROR nova.api.openstack.wsgi Jul 06 13:38:58.732586 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi [None req-ec4c9bad-f3d9-4781-9793-f0c652516757 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=109857) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 06 13:38:58.733651 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: INFO nova.api.openstack.requestlog [None req-ec4c9bad-f3d9-4781-9793-f0c652516757 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.012333 Jul 06 13:38:58.733651 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: [pid: 109857|app: 0|req: 23/47] 10.222.0.20 () {60 vars in 1190 bytes} [Wed Jul 6 13:38:58 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Jul 06 13:38:59.542053 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi [None req-c4662a6a-2b4e-44f1-a0c0-7f6743619d44 admin admin] Calling method '>' {{(pid=109858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:38:59.543058 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: INFO nova.api.openstack.requestlog [None req-c4662a6a-2b4e-44f1-a0c0-7f6743619d44 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001416 Jul 06 13:38:59.543449 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: [pid: 109858|app: 0|req: 25/48] 10.222.0.20 () {56 vars in 1074 bytes} [Wed Jul 6 13:38:59 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 06 13:38:59.741333 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi [None req-50d115eb-cd5c-4a8c-a537-bf2d049af269 admin admin] Calling method '>' {{(pid=109857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:38:59.746988 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: INFO nova.api.openstack.wsgi [None req-50d115eb-cd5c-4a8c-a537-bf2d049af269 admin admin] HTTP exception thrown: Flavor 451 could not be found. Jul 06 13:38:59.748468 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi [None req-50d115eb-cd5c-4a8c-a537-bf2d049af269 admin admin] Request method failure captured: Jul 06 13:38:59.748468 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jul 06 13:38:59.748468 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: Accept: application/json Jul 06 13:38:59.748468 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: Accept-Encoding: gzip, deflate Jul 06 13:38:59.748468 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: Connection: keep-alive Jul 06 13:38:59.748468 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: Content-Length: 0 Jul 06 13:38:59.748468 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: Host: 10.222.0.20 Jul 06 13:38:59.748468 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: Openstack-Api-Version: compute 2.90 Jul 06 13:38:59.748468 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: Openstack-System-Scope: None Jul 06 13:38:59.748468 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: User-Agent: python-novaclient Jul 06 13:38:59.748468 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: X-Auth-Token: gAAAAABixZBzy_8EWmiw2aIa31KcbQERXR1rMaGLIaIk4mRd9ja7jg-n3QA7PGZhgSaLy6Jj3W3oUDv0eqL1bBAcufU9__gr94lohfGTtlyjUTWK7_y3eGUp-gGstwZ1HmB31H3zD-hvtYXTRFSyiRO806z76FY7QLLp4GmvPjxJFf2SjU9hofQ Jul 06 13:38:59.748468 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: X-Domain-Id: None Jul 06 13:38:59.748468 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: X-Domain-Name: None Jul 06 13:38:59.748468 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: X-Identity-Status: Confirmed Jul 06 13:38:59.748468 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: X-Is-Admin-Project: True Jul 06 13:38:59.748468 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: X-Openstack-Nova-Api-Version: 2.90 Jul 06 13:38:59.748468 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: X-Project-Domain-Id: default Jul 06 13:38:59.748468 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: X-Project-Domain-Name: Default Jul 06 13:38:59.748468 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: X-Project-Id: 775434dcf39c43beaa4ed6a50089f763 Jul 06 13:38:59.748468 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: X-Project-Name: admin Jul 06 13:38:59.748468 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: X-Role: admin,reader,member Jul 06 13:38:59.748468 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: X-Roles: admin,reader,member Jul 06 13:38:59.750044 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_775434dcf39c43beaa4ed6a50089f763"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/775434dcf39c43beaa4ed6a50089f763"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/775434dcf39c43beaa4ed6a50089f763"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/775434dcf39c43beaa4ed6a50089f763"}]}] Jul 06 13:38:59.750044 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: X-Tenant: admin Jul 06 13:38:59.750044 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: X-Tenant-Id: 775434dcf39c43beaa4ed6a50089f763 Jul 06 13:38:59.750044 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: X-Tenant-Name: admin Jul 06 13:38:59.750044 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: X-User: admin Jul 06 13:38:59.750044 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: X-User-Domain-Id: default Jul 06 13:38:59.750044 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: X-User-Domain-Name: Default Jul 06 13:38:59.750044 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: X-User-Id: c17e13a3d58f4ceab768f46d43e2cab5 Jul 06 13:38:59.750044 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: X-User-Name: admin Jul 06 13:38:59.750044 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: method: > Jul 06 13:38:59.750044 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: exception: Flavor 451 could not be found. Jul 06 13:38:59.750044 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: action_args: {'id': '451'} Jul 06 13:38:59.750044 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: {{(pid=109857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 06 13:38:59.750044 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 06 13:38:59.750984 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 06 13:38:59.750984 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 06 13:38:59.750984 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 06 13:38:59.750984 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 06 13:38:59.750984 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 06 13:38:59.750984 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 06 13:38:59.750984 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 06 13:38:59.750984 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 06 13:38:59.750984 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 06 13:38:59.750984 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 06 13:38:59.750984 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 06 13:38:59.750984 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 06 13:38:59.750984 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jul 06 13:38:59.750984 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: ERROR nova.api.openstack.wsgi Jul 06 13:38:59.750984 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 06 13:38:59.750984 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: ERROR nova.api.openstack.wsgi Jul 06 13:38:59.750984 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 06 13:38:59.750984 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 06 13:38:59.750984 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 06 13:38:59.752394 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 06 13:38:59.752394 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 06 13:38:59.752394 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 06 13:38:59.752394 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 06 13:38:59.752394 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 06 13:38:59.752394 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 06 13:38:59.752394 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jul 06 13:38:59.752394 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: ERROR nova.api.openstack.wsgi Jul 06 13:38:59.752394 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 06 13:38:59.752394 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: ERROR nova.api.openstack.wsgi Jul 06 13:38:59.752394 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 06 13:38:59.752394 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 06 13:38:59.752394 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 06 13:38:59.752394 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 06 13:38:59.752394 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 06 13:38:59.752394 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jul 06 13:38:59.752394 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: ERROR nova.api.openstack.wsgi Jul 06 13:38:59.752394 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi [None req-50d115eb-cd5c-4a8c-a537-bf2d049af269 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=109857) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 06 13:38:59.753764 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: INFO nova.api.openstack.requestlog [None req-50d115eb-cd5c-4a8c-a537-bf2d049af269 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.059150 Jul 06 13:38:59.753764 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: [pid: 109857|app: 0|req: 24/49] 10.222.0.20 () {60 vars in 1193 bytes} [Wed Jul 6 13:38:59 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 06 13:38:59.759696 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi [None req-c014fc5c-3247-4934-a2dd-9aece41db917 admin admin] Calling method '>' {{(pid=109858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:38:59.773052 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: INFO nova.api.openstack.requestlog [None req-c014fc5c-3247-4934-a2dd-9aece41db917 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.016854 Jul 06 13:38:59.773564 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: [pid: 109858|app: 0|req: 26/50] 10.222.0.20 () {60 vars in 1210 bytes} [Wed Jul 6 13:38:59 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 06 13:38:59.782552 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi [None req-4f6167c0-d190-4d4e-9739-9446da37c040 admin admin] Calling method '>' {{(pid=109857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:38:59.797646 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: INFO nova.api.openstack.requestlog [None req-4f6167c0-d190-4d4e-9739-9446da37c040 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018480 Jul 06 13:38:59.798154 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: [pid: 109857|app: 0|req: 25/51] 10.222.0.20 () {60 vars in 1210 bytes} [Wed Jul 6 13:38:59 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 06 13:38:59.808061 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi [None req-be00f57d-98bf-493c-8e2a-9dfde5cfd93e admin admin] Calling method '>' {{(pid=109858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:38:59.813302 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: INFO nova.api.openstack.wsgi [None req-be00f57d-98bf-493c-8e2a-9dfde5cfd93e admin admin] HTTP exception thrown: Flavor 451 could not be found. Jul 06 13:38:59.815142 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi [None req-be00f57d-98bf-493c-8e2a-9dfde5cfd93e admin admin] Request method failure captured: Jul 06 13:38:59.815142 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jul 06 13:38:59.815142 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: Accept: application/json Jul 06 13:38:59.815142 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: Accept-Encoding: gzip, deflate Jul 06 13:38:59.815142 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: Connection: keep-alive Jul 06 13:38:59.815142 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: Content-Length: 0 Jul 06 13:38:59.815142 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: Host: 10.222.0.20 Jul 06 13:38:59.815142 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: Openstack-Api-Version: compute 2.90 Jul 06 13:38:59.815142 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: Openstack-System-Scope: None Jul 06 13:38:59.815142 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: User-Agent: python-novaclient Jul 06 13:38:59.815142 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: X-Auth-Token: gAAAAABixZBzy_8EWmiw2aIa31KcbQERXR1rMaGLIaIk4mRd9ja7jg-n3QA7PGZhgSaLy6Jj3W3oUDv0eqL1bBAcufU9__gr94lohfGTtlyjUTWK7_y3eGUp-gGstwZ1HmB31H3zD-hvtYXTRFSyiRO806z76FY7QLLp4GmvPjxJFf2SjU9hofQ Jul 06 13:38:59.815142 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: X-Domain-Id: None Jul 06 13:38:59.815142 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: X-Domain-Name: None Jul 06 13:38:59.815142 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: X-Identity-Status: Confirmed Jul 06 13:38:59.815142 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: X-Is-Admin-Project: True Jul 06 13:38:59.815142 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: X-Openstack-Nova-Api-Version: 2.90 Jul 06 13:38:59.815142 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: X-Project-Domain-Id: default Jul 06 13:38:59.815142 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: X-Project-Domain-Name: Default Jul 06 13:38:59.815142 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: X-Project-Id: 775434dcf39c43beaa4ed6a50089f763 Jul 06 13:38:59.815142 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: X-Project-Name: admin Jul 06 13:38:59.815142 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: X-Role: admin,reader,member Jul 06 13:38:59.815142 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: X-Roles: admin,reader,member Jul 06 13:38:59.816658 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_775434dcf39c43beaa4ed6a50089f763"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/775434dcf39c43beaa4ed6a50089f763"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/775434dcf39c43beaa4ed6a50089f763"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/775434dcf39c43beaa4ed6a50089f763"}]}] Jul 06 13:38:59.816658 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: X-Tenant: admin Jul 06 13:38:59.816658 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: X-Tenant-Id: 775434dcf39c43beaa4ed6a50089f763 Jul 06 13:38:59.816658 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: X-Tenant-Name: admin Jul 06 13:38:59.816658 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: X-User: admin Jul 06 13:38:59.816658 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: X-User-Domain-Id: default Jul 06 13:38:59.816658 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: X-User-Domain-Name: Default Jul 06 13:38:59.816658 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: X-User-Id: c17e13a3d58f4ceab768f46d43e2cab5 Jul 06 13:38:59.816658 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: X-User-Name: admin Jul 06 13:38:59.816658 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: method: > Jul 06 13:38:59.816658 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: exception: Flavor 451 could not be found. Jul 06 13:38:59.816658 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: action_args: {'id': '451'} Jul 06 13:38:59.816658 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: {{(pid=109858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 06 13:38:59.816658 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 06 13:38:59.817677 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 06 13:38:59.817677 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 06 13:38:59.817677 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 06 13:38:59.817677 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 06 13:38:59.817677 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 06 13:38:59.817677 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 06 13:38:59.817677 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 06 13:38:59.817677 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 06 13:38:59.817677 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 06 13:38:59.817677 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 06 13:38:59.817677 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 06 13:38:59.817677 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 06 13:38:59.817677 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jul 06 13:38:59.817677 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: ERROR nova.api.openstack.wsgi Jul 06 13:38:59.817677 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 06 13:38:59.817677 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: ERROR nova.api.openstack.wsgi Jul 06 13:38:59.817677 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 06 13:38:59.817677 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 06 13:38:59.817677 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 06 13:38:59.819331 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 06 13:38:59.819331 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 06 13:38:59.819331 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 06 13:38:59.819331 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 06 13:38:59.819331 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 06 13:38:59.819331 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 06 13:38:59.819331 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jul 06 13:38:59.819331 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: ERROR nova.api.openstack.wsgi Jul 06 13:38:59.819331 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 06 13:38:59.819331 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: ERROR nova.api.openstack.wsgi Jul 06 13:38:59.819331 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 06 13:38:59.819331 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 06 13:38:59.819331 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 06 13:38:59.819331 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 06 13:38:59.819331 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 06 13:38:59.819331 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jul 06 13:38:59.819331 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: ERROR nova.api.openstack.wsgi Jul 06 13:38:59.819331 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi [None req-be00f57d-98bf-493c-8e2a-9dfde5cfd93e admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=109858) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 06 13:38:59.820613 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: INFO nova.api.openstack.requestlog [None req-be00f57d-98bf-493c-8e2a-9dfde5cfd93e admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.011944 Jul 06 13:38:59.820613 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: [pid: 109858|app: 0|req: 27/52] 10.222.0.20 () {60 vars in 1193 bytes} [Wed Jul 6 13:38:59 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 06 13:39:00.634181 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi [None req-4f6167c0-d190-4d4e-9739-9446da37c040 admin admin] Calling method '>' {{(pid=109857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:39:00.635186 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: INFO nova.api.openstack.requestlog [None req-4f6167c0-d190-4d4e-9739-9446da37c040 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001429 Jul 06 13:39:00.635577 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: [pid: 109857|app: 0|req: 26/53] 10.222.0.20 () {56 vars in 1074 bytes} [Wed Jul 6 13:39:00 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 06 13:39:00.830246 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi [None req-632372f0-dab0-4693-9d72-7ec2b53594f7 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=109858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 06 13:39:00.847972 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: INFO nova.api.openstack.requestlog [None req-632372f0-dab0-4693-9d72-7ec2b53594f7 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.069311 Jul 06 13:39:00.848441 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: [pid: 109858|app: 0|req: 28/54] 10.222.0.20 () {64 vars in 1235 bytes} [Wed Jul 6 13:39:00 2022] POST /compute/v2.1/flavors => generated 404 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 06 13:39:01.673409 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi [None req-4f6167c0-d190-4d4e-9739-9446da37c040 admin admin] Calling method '>' {{(pid=109857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:39:01.674949 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: INFO nova.api.openstack.requestlog [None req-4f6167c0-d190-4d4e-9739-9446da37c040 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001935 Jul 06 13:39:01.675359 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: [pid: 109857|app: 0|req: 27/55] 10.222.0.20 () {56 vars in 1074 bytes} [Wed Jul 6 13:39:01 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 06 13:39:01.864486 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi [None req-b2039651-a877-4481-a50a-2f67b7e5235b admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=109858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 06 13:39:01.881888 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: INFO nova.api.openstack.requestlog [None req-b2039651-a877-4481-a50a-2f67b7e5235b admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.068505 Jul 06 13:39:01.882429 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: [pid: 109858|app: 0|req: 29/56] 10.222.0.20 () {64 vars in 1235 bytes} [Wed Jul 6 13:39:01 2022] POST /compute/v2.1/flavors => generated 405 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 06 13:39:02.697774 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi [None req-4f6167c0-d190-4d4e-9739-9446da37c040 admin admin] Calling method '>' {{(pid=109857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:39:02.698842 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: INFO nova.api.openstack.requestlog [None req-4f6167c0-d190-4d4e-9739-9446da37c040 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001533 Jul 06 13:39:02.699230 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: [pid: 109857|app: 0|req: 28/57] 10.222.0.20 () {56 vars in 1074 bytes} [Wed Jul 6 13:39:02 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 06 13:39:02.885266 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi [None req-71759b11-4710-4e47-8a41-64b43d3679fd admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=109858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 06 13:39:02.902872 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: INFO nova.api.openstack.requestlog [None req-71759b11-4710-4e47-8a41-64b43d3679fd admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.068066 Jul 06 13:39:02.903475 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: [pid: 109858|app: 0|req: 30/58] 10.222.0.20 () {64 vars in 1235 bytes} [Wed Jul 6 13:39:02 2022] POST /compute/v2.1/flavors => generated 407 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 06 13:39:03.715393 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi [None req-4f6167c0-d190-4d4e-9739-9446da37c040 admin admin] Calling method '>' {{(pid=109857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:39:03.716386 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: INFO nova.api.openstack.requestlog [None req-4f6167c0-d190-4d4e-9739-9446da37c040 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001395 Jul 06 13:39:03.716774 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: [pid: 109857|app: 0|req: 29/59] 10.222.0.20 () {56 vars in 1074 bytes} [Wed Jul 6 13:39:03 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 06 13:39:03.904659 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi [None req-39286959-04be-452f-967d-299a10b5f453 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=109858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 06 13:39:03.923324 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: INFO nova.api.openstack.requestlog [None req-39286959-04be-452f-967d-299a10b5f453 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.069943 Jul 06 13:39:03.924794 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: [pid: 109858|app: 0|req: 31/60] 10.222.0.20 () {64 vars in 1235 bytes} [Wed Jul 6 13:39:03 2022] POST /compute/v2.1/flavors => generated 409 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 06 13:39:04.735337 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi [None req-4f6167c0-d190-4d4e-9739-9446da37c040 admin admin] Calling method '>' {{(pid=109857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:39:04.736973 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: INFO nova.api.openstack.requestlog [None req-4f6167c0-d190-4d4e-9739-9446da37c040 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001932 Jul 06 13:39:04.737538 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: [pid: 109857|app: 0|req: 30/61] 10.222.0.20 () {56 vars in 1074 bytes} [Wed Jul 6 13:39:04 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 06 13:39:04.931313 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi [None req-5dd3b8b7-94c1-4f74-9b9a-b572f6fe4e73 admin admin] Calling method '>' {{(pid=109858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:39:04.950376 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: INFO nova.api.openstack.requestlog [None req-5dd3b8b7-94c1-4f74-9b9a-b572f6fe4e73 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.069806 Jul 06 13:39:04.950879 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: [pid: 109858|app: 0|req: 32/62] 10.222.0.20 () {60 vars in 1202 bytes} [Wed Jul 6 13:39:04 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 06 13:39:51.685236 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi [None req-4f6167c0-d190-4d4e-9739-9446da37c040 admin admin] Calling method '>' {{(pid=109857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:39:51.686321 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: INFO nova.api.openstack.requestlog [None req-4f6167c0-d190-4d4e-9739-9446da37c040 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001564 Jul 06 13:39:51.686791 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: [pid: 109857|app: 0|req: 31/63] 10.222.0.20 () {54 vars in 930 bytes} [Wed Jul 6 13:39:51 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 06 13:39:51.697293 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG dbcounter [-] [109858] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=109858) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:39:51.744754 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi [None req-6b335e02-dd7f-4657-8891-411474cbbe97 admin admin] Calling method '>' {{(pid=109858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:39:51.763528 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: INFO nova.api.openstack.requestlog [None req-6b335e02-dd7f-4657-8891-411474cbbe97 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.070702 Jul 06 13:39:51.764061 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: [pid: 109858|app: 0|req: 33/64] 10.222.0.20 () {60 vars in 1291 bytes} [Wed Jul 6 13:39:51 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 06 13:39:51.787606 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi [None req-5ca7527b-34fa-4d36-a685-01913fdb77b8 admin admin] Calling method '>' {{(pid=109857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:39:51.791012 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG dbcounter [-] [109857] Writing DB stats nova_api:SELECT=14 {{(pid=109857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:39:51.796326 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: INFO nova.api.openstack.requestlog [None req-5ca7527b-34fa-4d36-a685-01913fdb77b8 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012281 Jul 06 13:39:51.796850 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: [pid: 109857|app: 0|req: 32/65] 10.222.0.20 () {60 vars in 1282 bytes} [Wed Jul 6 13:39:51 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 06 13:39:51.808439 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi [None req-752ceda6-2e66-4bc7-82b3-d1293afdf106 admin admin] Calling method '>' {{(pid=109858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:39:51.816161 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: INFO nova.api.openstack.requestlog [None req-752ceda6-2e66-4bc7-82b3-d1293afdf106 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011207 Jul 06 13:39:51.816668 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: [pid: 109858|app: 0|req: 34/66] 10.222.0.20 () {60 vars in 1285 bytes} [Wed Jul 6 13:39:51 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:39:51.827880 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi [None req-4079cf6a-cabf-4891-96ef-4edfac54d71c admin admin] Calling method '>' {{(pid=109857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:39:51.836131 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: INFO nova.api.openstack.requestlog [None req-4079cf6a-cabf-4891-96ef-4edfac54d71c admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012020 Jul 06 13:39:51.836643 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: [pid: 109857|app: 0|req: 33/67] 10.222.0.20 () {60 vars in 1285 bytes} [Wed Jul 6 13:39:51 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 06 13:39:51.854881 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi [None req-2eede80b-a396-46a1-b5f1-a515db422547 admin admin] Calling method '>' {{(pid=109858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:39:51.864627 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: INFO nova.api.openstack.requestlog [None req-2eede80b-a396-46a1-b5f1-a515db422547 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.020344 Jul 06 13:39:51.865244 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: [pid: 109858|app: 0|req: 35/68] 10.222.0.20 () {60 vars in 1282 bytes} [Wed Jul 6 13:39:51 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:43:15.426397 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi [None req-4079cf6a-cabf-4891-96ef-4edfac54d71c admin admin] Calling method '>' {{(pid=109857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:43:15.427411 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: INFO nova.api.openstack.requestlog [None req-4079cf6a-cabf-4891-96ef-4edfac54d71c admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001691 Jul 06 13:43:15.427808 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: [pid: 109857|app: 0|req: 34/69] 10.222.0.20 () {56 vars in 1074 bytes} [Wed Jul 6 13:43:15 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 06 13:43:15.570098 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG dbcounter [-] [109858] Writing DB stats nova_api:SELECT=6 {{(pid=109858) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:43:15.684182 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi [None req-f26d77ce-b9b8-4915-ac34-087971eef94a admin admin] Calling method '>' {{(pid=109858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:43:15.686137 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 06 13:43:15.686137 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: warnings.warn(msg) Jul 06 13:43:15.687349 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG oslo_concurrency.lockutils [None req-f26d77ce-b9b8-4915-ac34-087971eef94a admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:43:15.687815 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG oslo_concurrency.lockutils [None req-f26d77ce-b9b8-4915-ac34-087971eef94a admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:43:15.688597 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG oslo_concurrency.lockutils [None req-f26d77ce-b9b8-4915-ac34-087971eef94a admin admin] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:43:15.689043 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG oslo_concurrency.lockutils [None req-f26d77ce-b9b8-4915-ac34-087971eef94a admin admin] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:43:15.722077 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: INFO nova.api.openstack.requestlog [None req-f26d77ce-b9b8-4915-ac34-087971eef94a admin admin] 10.222.0.20 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.153475 Jul 06 13:43:15.722628 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: [pid: 109858|app: 0|req: 36/70] 10.222.0.20 () {60 vars in 1193 bytes} [Wed Jul 6 13:43:15 2022] GET /compute/v2.1/os-services => generated 791 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 06 13:43:16.555282 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi [None req-4079cf6a-cabf-4891-96ef-4edfac54d71c admin admin] Calling method '>' {{(pid=109857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:43:16.556324 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: INFO nova.api.openstack.requestlog [None req-4079cf6a-cabf-4891-96ef-4edfac54d71c admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001451 Jul 06 13:43:16.556717 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: [pid: 109857|app: 0|req: 35/71] 10.222.0.20 () {56 vars in 1074 bytes} [Wed Jul 6 13:43:16 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 06 13:43:16.747559 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi [None req-f669424e-8bdd-4936-b01f-02ad3857d031 admin admin] Calling method '>' {{(pid=109858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:43:16.748747 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 06 13:43:16.748747 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: warnings.warn(msg) Jul 06 13:43:16.749964 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG oslo_concurrency.lockutils [None req-f669424e-8bdd-4936-b01f-02ad3857d031 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:43:16.750405 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG oslo_concurrency.lockutils [None req-f669424e-8bdd-4936-b01f-02ad3857d031 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:43:16.751195 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG oslo_concurrency.lockutils [None req-f669424e-8bdd-4936-b01f-02ad3857d031 admin admin] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:43:16.751622 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG oslo_concurrency.lockutils [None req-f669424e-8bdd-4936-b01f-02ad3857d031 admin admin] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:43:16.771261 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: INFO nova.api.openstack.requestlog [None req-f669424e-8bdd-4936-b01f-02ad3857d031 admin admin] 10.222.0.20 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.075758 Jul 06 13:43:16.771811 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: [pid: 109858|app: 0|req: 37/72] 10.222.0.20 () {60 vars in 1193 bytes} [Wed Jul 6 13:43:16 2022] GET /compute/v2.1/os-services => generated 791 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 06 13:43:28.009255 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi [None req-4079cf6a-cabf-4891-96ef-4edfac54d71c admin admin] Calling method '>' {{(pid=109857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:43:28.010314 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: INFO nova.api.openstack.requestlog [None req-4079cf6a-cabf-4891-96ef-4edfac54d71c admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001545 Jul 06 13:43:28.010710 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: [pid: 109857|app: 0|req: 36/73] 10.222.0.20 () {56 vars in 1074 bytes} [Wed Jul 6 13:43:28 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 06 13:43:28.162594 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG dbcounter [-] [109858] Writing DB stats nova_cell0:SELECT=4 {{(pid=109858) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:43:28.163297 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG dbcounter [-] [109858] Writing DB stats nova_cell1:SELECT=4 {{(pid=109858) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:43:28.163907 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG dbcounter [-] [109858] Writing DB stats nova_api:SELECT=8 {{(pid=109858) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:43:28.210695 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi [None req-4aa5cdf0-b607-4f33-87ec-fbfcb2782ff4 admin admin] Calling method '>' {{(pid=109858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:43:28.211877 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 06 13:43:28.211877 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: warnings.warn(msg) Jul 06 13:43:28.213077 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG oslo_concurrency.lockutils [None req-4aa5cdf0-b607-4f33-87ec-fbfcb2782ff4 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:43:28.213512 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG oslo_concurrency.lockutils [None req-4aa5cdf0-b607-4f33-87ec-fbfcb2782ff4 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:43:28.214280 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG oslo_concurrency.lockutils [None req-4aa5cdf0-b607-4f33-87ec-fbfcb2782ff4 admin admin] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:43:28.214699 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG oslo_concurrency.lockutils [None req-4aa5cdf0-b607-4f33-87ec-fbfcb2782ff4 admin admin] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:43:28.243846 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: INFO nova.api.openstack.requestlog [None req-4aa5cdf0-b607-4f33-87ec-fbfcb2782ff4 admin admin] 10.222.0.20 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.085587 Jul 06 13:43:28.244462 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: [pid: 109858|app: 0|req: 38/74] 10.222.0.20 () {60 vars in 1193 bytes} [Wed Jul 6 13:43:28 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 06 13:43:29.120081 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: DEBUG nova.api.openstack.wsgi [None req-4079cf6a-cabf-4891-96ef-4edfac54d71c admin admin] Calling method '>' {{(pid=109857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:43:29.121109 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: INFO nova.api.openstack.requestlog [None req-4079cf6a-cabf-4891-96ef-4edfac54d71c admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001443 Jul 06 13:43:29.121499 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: [pid: 109857|app: 0|req: 37/75] 10.222.0.20 () {56 vars in 1074 bytes} [Wed Jul 6 13:43:29 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 06 13:43:29.313470 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG nova.api.openstack.wsgi [None req-b616300b-e261-49e6-8ae3-df95e9659778 admin admin] Calling method '>' {{(pid=109858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:43:29.314629 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 06 13:43:29.314629 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: warnings.warn(msg) Jul 06 13:43:29.315807 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG oslo_concurrency.lockutils [None req-b616300b-e261-49e6-8ae3-df95e9659778 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:43:29.316244 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG oslo_concurrency.lockutils [None req-b616300b-e261-49e6-8ae3-df95e9659778 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:43:29.317041 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG oslo_concurrency.lockutils [None req-b616300b-e261-49e6-8ae3-df95e9659778 admin admin] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:43:29.317475 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: DEBUG oslo_concurrency.lockutils [None req-b616300b-e261-49e6-8ae3-df95e9659778 admin admin] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:43:29.338976 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: INFO nova.api.openstack.requestlog [None req-b616300b-e261-49e6-8ae3-df95e9659778 admin admin] 10.222.0.20 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.077945 Jul 06 13:43:29.339464 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: [pid: 109858|app: 0|req: 39/76] 10.222.0.20 () {60 vars in 1193 bytes} [Wed Jul 6 13:43:29 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 06 13:44:27.065498 dv-cinder-819149-8-iscsi devstack@n-api.service[109856]: Wed Jul 6 13:44:27 2022 - graceful shutdown triggered... Jul 06 13:44:27.065278 dv-cinder-819149-8-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Jul 06 13:44:27.066439 dv-cinder-819149-8-iscsi devstack@n-api.service[109857]: Gracefully killing worker 1 (pid: 109857)... Jul 06 13:44:27.066796 dv-cinder-819149-8-iscsi devstack@n-api.service[109858]: Gracefully killing worker 2 (pid: 109858)... Jul 06 13:44:28.066319 dv-cinder-819149-8-iscsi devstack@n-api.service[109856]: worker 1 buried after 1 seconds Jul 06 13:44:28.066319 dv-cinder-819149-8-iscsi devstack@n-api.service[109856]: worker 2 buried after 1 seconds Jul 06 13:44:28.066319 dv-cinder-819149-8-iscsi devstack@n-api.service[109856]: goodbye to uWSGI. Jul 06 13:44:28.067818 dv-cinder-819149-8-iscsi systemd[1]: devstack@n-api.service: Succeeded. Jul 06 13:44:28.068380 dv-cinder-819149-8-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Jul 06 13:44:28.071156 dv-cinder-819149-8-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jul 06 13:44:28.081308 dv-cinder-819149-8-iscsi devstack@n-api.service[124350]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jul 06 13:44:28.083309 dv-cinder-819149-8-iscsi devstack@n-api.service[124350]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Jul 6 13:44:28 2022] *** Jul 06 13:44:28.083309 dv-cinder-819149-8-iscsi devstack@n-api.service[124350]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 06 13:44:28.083309 dv-cinder-819149-8-iscsi devstack@n-api.service[124350]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 06 13:44:28.083309 dv-cinder-819149-8-iscsi devstack@n-api.service[124350]: nodename: dv-cinder-819149-8-iscsi Jul 06 13:44:28.083309 dv-cinder-819149-8-iscsi devstack@n-api.service[124350]: machine: x86_64 Jul 06 13:44:28.083309 dv-cinder-819149-8-iscsi devstack@n-api.service[124350]: clock source: unix Jul 06 13:44:28.083309 dv-cinder-819149-8-iscsi devstack@n-api.service[124350]: pcre jit disabled Jul 06 13:44:28.083309 dv-cinder-819149-8-iscsi devstack@n-api.service[124350]: detected number of CPU cores: 4 Jul 06 13:44:28.083309 dv-cinder-819149-8-iscsi devstack@n-api.service[124350]: current working directory: / Jul 06 13:44:28.083309 dv-cinder-819149-8-iscsi devstack@n-api.service[124350]: detected binary path: /usr/bin/uwsgi-core Jul 06 13:44:28.083309 dv-cinder-819149-8-iscsi devstack@n-api.service[124350]: your processes number limit is 47680 Jul 06 13:44:28.084089 dv-cinder-819149-8-iscsi devstack@n-api.service[124350]: your memory page size is 4096 bytes Jul 06 13:44:28.084089 dv-cinder-819149-8-iscsi devstack@n-api.service[124350]: detected max file descriptor number: 2048 Jul 06 13:44:28.084089 dv-cinder-819149-8-iscsi devstack@n-api.service[124350]: lock engine: pthread robust mutexes Jul 06 13:44:28.084089 dv-cinder-819149-8-iscsi devstack@n-api.service[124350]: thunder lock: enabled Jul 06 13:44:28.084089 dv-cinder-819149-8-iscsi devstack@n-api.service[124350]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jul 06 13:44:28.084089 dv-cinder-819149-8-iscsi devstack@n-api.service[124350]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jul 06 13:44:28.128463 dv-cinder-819149-8-iscsi devstack@n-api.service[124350]: Python main interpreter initialized at 0x55a2daaa09c0 Jul 06 13:44:28.128463 dv-cinder-819149-8-iscsi devstack@n-api.service[124350]: python threads support enabled Jul 06 13:44:28.128463 dv-cinder-819149-8-iscsi devstack@n-api.service[124350]: your server socket listen backlog is limited to 100 connections Jul 06 13:44:28.128463 dv-cinder-819149-8-iscsi devstack@n-api.service[124350]: your mercy for graceful operations on workers is 90 seconds Jul 06 13:44:28.128910 dv-cinder-819149-8-iscsi devstack@n-api.service[124350]: mapped 403077 bytes (393 KB) for 2 cores Jul 06 13:44:28.128910 dv-cinder-819149-8-iscsi devstack@n-api.service[124350]: *** Operational MODE: preforking *** Jul 06 13:44:28.129216 dv-cinder-819149-8-iscsi devstack@n-api.service[124350]: *** uWSGI is running in multiple interpreter mode *** Jul 06 13:44:28.129216 dv-cinder-819149-8-iscsi devstack@n-api.service[124350]: spawned uWSGI master process (pid: 124350) Jul 06 13:44:28.129425 dv-cinder-819149-8-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jul 06 13:44:28.130127 dv-cinder-819149-8-iscsi devstack@n-api.service[124350]: spawned uWSGI worker 1 (pid: 124367, cores: 1) Jul 06 13:44:28.130400 dv-cinder-819149-8-iscsi devstack@n-api.service[124350]: spawned uWSGI worker 2 (pid: 124368, cores: 1) Jul 06 13:44:28.130509 dv-cinder-819149-8-iscsi devstack@n-api.service[124350]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 06 13:44:28.798285 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 06 13:44:28.806892 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 06 13:44:30.000954 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 06 13:44:30.000954 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: from cryptography.utils import int_from_bytes Jul 06 13:44:30.001724 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 06 13:44:30.001724 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: from cryptography.utils import int_from_bytes Jul 06 13:44:30.001903 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 06 13:44:30.001903 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: from cryptography.utils import int_from_bytes Jul 06 13:44:30.001903 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 06 13:44:30.001903 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: from cryptography.utils import int_from_bytes Jul 06 13:44:32.316944 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 06 13:44:32.317481 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 06 13:44:32.317797 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 06 13:44:32.318163 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 06 13:44:32.318546 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 06 13:44:32.318806 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:44:32.319139 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:44:32.319462 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:44:32.319790 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 06 13:44:32.320167 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:44:32.320253 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 06 13:44:32.320336 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:44:32.320408 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 06 13:44:32.320484 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:44:32.320716 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:44:32.320839 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 06 13:44:32.321022 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 06 13:44:32.321134 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:44:32.321398 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:44:32.321497 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:44:32.321649 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:44:32.321768 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:44:32.321966 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:44:32.322065 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:44:32.322292 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-819149-8-iscsi {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:44:32.322393 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:44:32.322613 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:44:32.322703 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:44:32.322921 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:44:32.323028 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:44:32.323768 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:44:32.323988 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:44:32.324089 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:44:32.324385 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:44:32.324476 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:44:32.324723 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:44:32.324820 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:44:32.324994 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:44:32.325128 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:44:32.325343 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:44:32.325628 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:44:32.325744 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-819149-8-iscsi {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:44:32.326748 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:44:32.326859 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:44:32.326941 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:44:32.327022 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:44:32.327100 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:44:32.327188 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:44:32.327288 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:44:32.327382 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:44:32.327470 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:44:32.327563 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:44:32.327653 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:44:32.327743 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:44:32.327858 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:44:32.327952 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:44:32.328213 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:44:32.328382 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:44:32.328510 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:44:32.328617 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:44:32.328843 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:44:32.329023 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:44:32.329275 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:44:32.329404 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-819149-8-iscsi {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:44:32.329569 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:44:32.329709 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:44:32.329847 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:44:32.329974 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:44:32.330245 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:44:32.330388 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:44:32.330520 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:44:32.330629 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:44:32.330787 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:44:32.330927 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:44:32.331160 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:44:32.331311 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:44:32.331455 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:44:32.331584 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:44:32.331774 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:44:32.331919 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-819149-8-iscsi {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:44:32.332082 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:44:32.332220 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:44:32.332407 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:44:32.332546 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:44:32.332726 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:44:32.332865 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:44:32.333071 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:44:32.333222 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:44:32.333394 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:44:32.333538 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:44:32.333698 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:44:32.333836 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:44:32.334007 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:44:32.334133 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:44:32.334317 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:44:32.334449 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:44:32.334635 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:44:32.334773 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:44:32.334939 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:44:32.335079 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:44:32.335246 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:44:32.335384 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:44:32.335518 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:44:32.335647 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:44:32.335793 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:44:32.335932 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:44:32.336099 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:44:32.336238 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:44:32.336420 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:44:32.336568 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:44:32.336742 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:44:32.336878 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:44:32.337026 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:44:32.337158 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:44:32.337296 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:44:32.337440 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:44:32.337580 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:44:32.337716 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:44:32.337879 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:44:32.338019 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:44:32.338193 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:44:32.338330 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:44:32.338503 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:44:32.338617 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:44:32.339424 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:44:32.339542 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:44:32.339757 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:44:32.340007 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:44:32.340112 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:44:32.340250 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:44:32.340351 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:44:32.340576 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:44:32.340679 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:44:32.340902 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:44:32.341035 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:44:32.341243 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:44:32.341342 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:44:32.341556 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:44:32.341678 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:44:32.341868 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:44:32.341971 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:44:32.342183 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:44:32.342341 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:44:32.342484 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:44:32.342624 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:44:32.342790 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:44:32.342923 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:44:32.343100 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:44:32.343243 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.20 {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:44:32.343459 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:44:32.343589 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.20 {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:44:32.343724 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:44:32.343851 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:44:32.344089 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:44:32.344251 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:44:32.344381 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:44:32.344515 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:44:32.344655 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:44:32.344782 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:44:32.344941 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:44:32.345218 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:44:32.345356 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:44:32.345490 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.20 {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:44:32.345617 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:44:32.345744 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.20 {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:44:32.345897 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:44:32.346045 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:44:32.346207 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:44:32.346426 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:44:32.346568 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:44:32.346696 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:44:32.346833 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:44:32.347007 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:44:32.347144 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:44:32.347271 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:44:32.347406 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:44:32.347544 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:44:32.347679 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:44:32.347809 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:44:32.347971 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:44:32.348104 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:44:32.348294 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:44:32.349136 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:44:32.349257 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:44:32.349336 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:44:32.349409 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:44:32.349507 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:44:32.349595 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:44:32.353265 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:44:32.353408 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:44:32.353524 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:44:32.353644 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:44:32.353755 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:44:32.353873 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:44:32.353991 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:44:32.354115 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:44:32.354235 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:44:32.354399 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:44:32.354514 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:44:32.354624 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:44:32.354744 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:44:32.354868 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:44:32.355041 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:44:32.355175 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:44:32.355308 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:44:32.355415 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:44:32.355514 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:44:32.355598 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:44:32.355687 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:44:32.355770 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:44:32.355851 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:44:32.355942 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:44:32.356033 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:44:32.356112 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:44:32.356182 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:44:32.356271 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:44:32.356354 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:44:32.356442 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:44:32.356541 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:44:32.356634 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:44:32.356716 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:44:32.356810 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:44:32.356897 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:44:32.356969 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:44:32.357066 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:44:32.357151 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:44:32.357242 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:44:32.357347 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:44:32.357438 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:44:32.357528 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:44:32.357619 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:44:32.357702 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:44:32.357779 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:44:32.357859 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:44:32.357938 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:44:32.358028 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:44:32.358120 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:44:32.358210 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:44:32.358293 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:44:32.358392 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:44:32.358485 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:44:32.358599 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:44:32.358845 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:44:32.358941 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:44:32.359021 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:44:32.359112 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:44:32.359204 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:44:32.359300 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:44:32.359393 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:44:32.359494 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:44:32.359494 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:44:32.359645 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:44:32.359740 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:44:32.359852 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:44:32.359944 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:44:32.360034 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:44:32.360112 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:44:32.360191 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:44:32.360262 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:44:32.360344 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:44:32.360574 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:44:32.360697 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:44:32.360790 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:44:32.360881 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:44:32.360971 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:44:32.361097 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:44:32.361191 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:44:32.361373 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:44:32.361483 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:44:32.361683 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:44:32.361786 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:44:32.361990 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:44:32.362082 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:44:32.362298 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:44:32.362410 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:44:32.362607 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:44:32.362718 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.362912 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:44:32.363031 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.363216 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:44:32.363374 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.363537 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:44:32.363691 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.363862 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:44:32.364029 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.364177 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:44:32.364363 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.364487 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:44:32.364685 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.364796 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:44:32.365021 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.365141 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:44:32.365342 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.365483 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.365672 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.365818 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.365990 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.366164 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.366305 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.366483 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.366621 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.366819 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.366946 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.367156 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.367262 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.367480 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.367579 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.367797 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.367894 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.368116 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.368216 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.368446 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.368543 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.368855 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.369118 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.369215 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.369305 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.369399 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.369483 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.369713 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.369811 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.370082 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.370227 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.370430 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.370663 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.370768 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.370878 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.371081 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.371209 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.371409 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.371534 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.371734 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.371837 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.372049 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.372161 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.372363 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.372493 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.372680 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.372810 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.373029 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.373164 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.373361 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.373487 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.373677 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.373810 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.373997 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.374133 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.374312 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.374462 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.374626 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.374790 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.374940 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.375107 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.375254 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.375426 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.375573 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.375739 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.375893 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.376065 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.376205 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.376404 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.376544 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.376722 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.376867 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.377065 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.377219 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.377386 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.377526 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.377701 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.377848 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.378016 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.378147 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.378331 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.378463 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.378646 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.378780 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.378961 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.379080 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.379265 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.379404 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.379573 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.379721 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.379896 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.380053 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.380226 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.380365 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.380536 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.380778 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.380978 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.381245 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.381557 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.381718 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.381874 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.382023 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.382164 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.382306 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.382453 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.382607 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.382778 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.383000 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.383185 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.383332 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.383473 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.383702 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.383864 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.384015 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.384157 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.384298 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.384545 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.384864 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.385212 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.385343 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.386063 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.386381 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.386495 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.386690 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.386794 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.387015 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.387127 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.387333 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.387442 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.387649 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.387760 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.387965 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.388105 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.388357 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.388461 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.388594 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.388769 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.388911 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.389245 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.389349 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.389690 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.389784 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.390026 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.390122 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.390338 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.390536 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.390680 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.390879 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.391010 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.391286 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.391390 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.391593 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.391706 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.391907 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.392009 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.392217 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.392325 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.392523 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.392636 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.392829 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.392984 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.393166 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.393311 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.393461 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.393612 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.393750 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.393933 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.394035 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.394308 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.394418 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.394627 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.394728 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.394949 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.395041 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.395261 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.395362 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.395569 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.395669 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.395874 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.395971 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.396180 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.396290 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.396525 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.396627 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.396835 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.396935 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.397204 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.397318 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.397532 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.397624 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.397846 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.397937 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.398161 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.398261 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.398476 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.398580 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.398788 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.398879 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.399098 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.399198 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.399413 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.399509 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.399726 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.399825 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.400057 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.400158 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.400361 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.400453 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.400674 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.400774 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.401012 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.401125 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.401927 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.402036 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.402258 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.402485 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.402578 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.402837 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.402930 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.403169 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.403260 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.403484 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.403583 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.403816 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.403906 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.404145 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.404242 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.404463 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.404549 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.404783 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.404881 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.405127 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.405222 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.405446 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.405547 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.405758 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.405858 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.406070 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.406162 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.406383 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.406484 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.406696 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.406795 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.407021 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.407126 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.407333 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.407426 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.407652 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.407744 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.407964 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.408064 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.408285 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.408376 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.408598 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.408698 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.408917 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.409071 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.409249 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.409343 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.409565 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.409660 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.409893 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.409994 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.410223 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.410315 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.410533 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.410624 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.410846 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.410938 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.411169 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.411262 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.411481 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.411573 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.411792 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.411885 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.412106 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.412198 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.412413 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.412506 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.412718 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.412818 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.413050 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.413146 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.413370 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.413482 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.413682 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.413775 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.413993 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.414084 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.414299 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.414400 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.414614 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.414714 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.414924 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.415033 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.415232 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.415335 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.415537 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.415629 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.415853 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.415962 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.416172 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.416274 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.416483 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.416591 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.416858 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.417392 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.418154 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.418154 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.418300 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.418614 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.418921 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.419233 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.419542 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.419892 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.420206 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.420513 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.420833 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.421373 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.421592 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.421911 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.422225 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.422538 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.422862 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.423179 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.423492 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.423810 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.424121 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.424435 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.424792 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.425082 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.425202 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.425390 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.425632 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.425729 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.425984 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.426062 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.426542 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.426635 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.426883 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.426977 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.427181 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.427264 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.427547 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.427771 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.427862 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.428108 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.428217 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.428422 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.428531 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.428744 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.428862 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.429161 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.429275 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.429393 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.429567 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.429726 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.429902 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.430057 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.430193 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.430402 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.430510 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.430710 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.430840 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.431023 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.431171 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.431330 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.431465 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.431636 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.431795 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.431949 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.432112 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.432255 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.432471 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.432590 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.432818 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.433026 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.433315 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.433433 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.433626 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.433726 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.433933 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.434084 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.434250 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.434405 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.434559 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.434679 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.434931 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.435109 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.435265 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.435421 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.435543 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.435660 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.435763 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.435982 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.436076 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.436307 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.436408 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.436634 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.436743 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.436938 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.437054 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.437274 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.437378 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.437593 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.437694 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.437911 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.438004 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.438224 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.438316 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.438538 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.438639 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.438864 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.438958 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.439177 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.439272 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.439484 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.439577 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.439795 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.439897 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.440103 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.440207 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.440407 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.440502 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.440710 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.440810 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.441054 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.441316 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.441417 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.441643 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.441743 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.441956 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.442055 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.442267 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.442360 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.442581 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.442674 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.442893 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.442992 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.443196 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.443445 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.443543 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.443786 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.443885 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.444098 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.444298 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.444401 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.444616 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.444718 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.445005 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.445146 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.445321 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.445412 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.445630 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.445732 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.445933 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.446025 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.446241 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.446331 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.446550 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.446651 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.446855 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.446947 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.447161 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.447261 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.447467 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.447572 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.447772 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.447902 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.448652 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.448900 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.449073 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.449281 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.449401 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.449603 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.449703 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.449922 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.450070 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.450230 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.450349 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.450535 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.450636 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.450848 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.450951 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.451154 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.451246 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.451460 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.451552 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.451772 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.451875 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.452097 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.452197 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.452415 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.452507 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.452720 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.452821 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.453073 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.453350 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.453445 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.453698 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.453807 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.454005 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.454107 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.454345 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.454482 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.454698 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.454906 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.455029 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.455339 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.455472 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.455648 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.455955 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.456055 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.456270 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.456410 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.456581 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.456730 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.456886 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.457096 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.457225 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.457420 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.457540 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.457735 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.457886 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.458047 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.458148 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.458357 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.458451 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.458709 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.458822 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.459018 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.459158 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.459368 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.459487 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.459677 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.459809 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.460000 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.460129 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.460351 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.460480 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.460630 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.460753 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.460941 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.461120 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.461272 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.461392 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.461578 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.461705 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.461885 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.462005 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.462198 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.462323 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.462503 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.462623 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.462808 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.462933 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.463109 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.463228 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.465044 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.465212 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.465212 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.465436 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.465532 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.465635 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.465729 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.465822 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.465908 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.465908 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.466066 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.466221 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.466317 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.466403 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.466487 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.466682 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.466783 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.466985 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.467079 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.467327 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.467417 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.467641 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.467734 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.467956 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.468061 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.468272 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.468370 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.468587 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.468689 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.468902 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.468993 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.469235 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.469541 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.469853 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.470157 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.470293 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.470465 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.470601 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.470780 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.470987 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.471089 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.471167 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.471376 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.471479 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.471721 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.471829 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.472034 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.472156 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.472340 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.472439 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.472646 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.472759 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.472949 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.473070 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.473286 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.473398 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.473605 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.473789 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.473917 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.474087 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.474359 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.474462 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.474678 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.474784 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.474996 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.475102 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.475303 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.475396 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.475615 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.475728 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.475930 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.476030 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.476235 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.476325 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.476550 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.476651 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.476854 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.476946 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.477187 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.477302 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.477494 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.477615 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.477798 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.477926 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.478119 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.478242 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.478434 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.478548 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.478746 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.478849 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.479064 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.479166 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.479499 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.479609 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.479930 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.480137 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.480266 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.480650 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.480766 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.480905 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.481120 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.481230 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.481553 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.481659 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.481972 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.482073 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.482291 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.482418 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.482603 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.482723 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.482942 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.483034 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.483258 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.483351 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.483619 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.483732 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.483941 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.484036 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.484254 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.484354 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.484571 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.484675 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.484875 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.484968 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.485208 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.485309 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.485515 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.485609 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.485841 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.485934 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.486151 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.486244 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.486463 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.486572 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.486780 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.486872 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.487086 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.487185 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.487415 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.487509 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.487741 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.487834 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.488057 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.488192 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.488381 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.488507 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.488793 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.488887 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.489158 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.489475 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.489796 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.489908 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.490116 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.490210 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.490422 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.490523 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.490762 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.490857 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.491042 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.491125 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.492021 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.492229 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.492417 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.492647 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.492815 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.492981 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.493190 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.493345 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.493496 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.493666 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.493890 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.494058 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.494218 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.494369 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.494527 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.494686 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.494845 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.495041 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.495195 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.495370 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.495522 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.495673 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.495785 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.495913 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.496015 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.496015 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.496179 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.496371 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.496702 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.500904 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.500904 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.501123 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.501221 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.501309 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.501456 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.501543 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.501618 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.501690 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.501762 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.501840 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.501923 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.502003 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.502076 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.502076 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.502224 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.502307 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.502387 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.502460 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.502538 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.502610 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.502690 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.502776 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.502856 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.502936 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.503009 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.503089 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.503169 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.503251 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.503324 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.503394 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.503472 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.503555 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.503648 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.503731 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.503731 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.503868 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.503940 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.504019 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.504101 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.504174 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.504245 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.504315 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.504385 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.504456 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.504541 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.504622 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.504701 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.504894 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.505047 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.505410 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.505517 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.505593 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.505718 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.505889 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.506100 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.506197 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.506364 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.506489 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.506698 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.506831 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.507038 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.507146 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.507357 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.507460 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.507671 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.507764 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.507997 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.508100 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.508331 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.508427 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.508623 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.508717 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.508952 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.509074 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.509295 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.509401 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.509615 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.509715 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.509924 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.510024 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.510247 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.510347 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.511066 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.511245 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.511411 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.511505 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.511713 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.511902 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.512027 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.512228 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.512361 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.512550 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.512680 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.512873 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.513198 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.513295 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.513536 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.513782 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.513882 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.514111 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.514273 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.514435 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.514601 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.514759 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.514983 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.515073 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.515563 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.515673 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.515758 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.515830 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.515901 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.515979 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.517960 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.518079 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.518165 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.518248 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.518323 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.518394 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.518481 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.518565 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.518646 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.518719 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.518791 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.518863 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.518943 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.519024 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.519104 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.519179 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.519258 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.519358 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.519446 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.519521 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.519594 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.519672 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.519752 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.519826 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.519995 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.520605 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.520706 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.520782 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.520855 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.520936 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.521907 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.522014 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.522098 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.522179 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.522252 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.522335 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.522409 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.522481 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.522553 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.522625 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.522696 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.522780 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.522855 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.522934 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.523539 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.523636 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.523722 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.523805 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.523878 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.523950 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.524021 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.524092 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.524479 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.524572 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.524776 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.524878 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.525079 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.525188 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.525399 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.525889 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.525988 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.526072 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.526072 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.526265 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.527111 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.527215 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.527314 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.527611 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.527709 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.527904 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.528026 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.528194 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.528297 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.528552 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.528648 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.528815 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.528892 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.529185 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.529296 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.529499 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.529595 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.529806 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.529903 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.530191 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.530300 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.530377 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.530456 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.530718 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.530813 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.530989 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.531091 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.531298 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.531548 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.531648 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.531881 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.531995 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.532242 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.532351 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.532548 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.532733 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.532839 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.533117 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.533284 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.533442 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.533623 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.533785 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.533903 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.534098 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.534199 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.534439 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.534608 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.534702 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.534913 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.535020 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.535253 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.535362 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.535582 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.536120 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.536120 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.536292 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.536376 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.536464 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.536538 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.536609 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.536958 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.537080 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.537169 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.537257 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.537508 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.537604 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.537803 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.537898 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.538094 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.538196 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.538485 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.538586 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.538661 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.538869 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.538974 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.539051 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.539264 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.539366 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.539557 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.539672 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.539859 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.540017 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.540183 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.540304 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.540568 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.540684 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.540762 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.540986 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.541131 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.541329 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.541445 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.541637 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.541733 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.542039 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.542225 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.542319 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.542394 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.542727 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.542827 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.543010 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.543111 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.543293 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.543394 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.543617 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.543717 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.543942 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.544049 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.544250 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.544557 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.544655 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.544876 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.544975 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.545277 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.545447 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.545612 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.545998 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.546245 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.546416 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.546571 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.546904 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.547071 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.547226 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.547378 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.547532 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.547532 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.547830 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.547991 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.548156 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.548308 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.548480 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.548722 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.548891 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.549080 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.549247 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.549408 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.549561 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.549727 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.549895 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.550047 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.550207 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.550370 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.550579 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.550836 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.551006 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.551006 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.551552 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.551716 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.551870 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.552030 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.552191 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.552350 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.552510 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.552751 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.552930 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.553148 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.553305 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.553457 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.553609 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.553761 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.553921 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.554087 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.554087 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.554378 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.554537 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.554697 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.554869 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.555029 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.555188 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.555341 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.555503 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.555656 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.555823 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.556184 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.556427 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.556595 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.556757 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.556911 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.557100 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.557271 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.557933 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.558095 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.558256 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.558409 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.558612 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.558901 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.559063 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.559216 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.559369 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.559537 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.559690 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.559856 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.560010 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.560162 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.560314 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.560557 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.560721 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.560987 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.561170 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.561323 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.561474 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.561639 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.561801 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.561975 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.562159 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.562324 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.562487 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.562646 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.562896 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.563064 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.563227 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.563380 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.563543 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.563696 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.563847 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.564006 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.564167 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.564345 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.564509 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.564662 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.564822 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.564975 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.565216 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.565373 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.565538 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.565700 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.565854 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.566006 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.566377 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.566645 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.566807 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.566968 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.567122 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.567274 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.567427 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.567427 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.567742 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.567905 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.568058 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.568209 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.568209 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.568508 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.568680 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.568834 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.569104 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.569276 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.569441 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.569611 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.569766 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.569919 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.570071 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.570223 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.570385 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.570596 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.570762 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.570928 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.571194 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.571356 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.571520 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.571721 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.571878 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.572035 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.572035 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.572347 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.572510 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.572673 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.572882 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.573836 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.574027 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.574027 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.574027 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.574487 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.574641 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.574793 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.574945 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.575111 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.575265 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.575418 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.575577 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.575731 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.575896 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.576058 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.576217 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.576624 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.576857 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.577042 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.577222 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.577384 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.577537 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.577690 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.577843 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.578002 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.578180 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.578333 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.578491 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.578650 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.578802 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.578961 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.579146 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.579431 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.579593 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.579747 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.579914 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.580077 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.580240 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.580413 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.580567 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.580719 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.580871 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.581082 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.581357 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.581518 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.581672 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.581824 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.581985 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.582160 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.582315 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.582486 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.582638 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.582798 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.582952 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.583119 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.583297 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.583541 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.583701 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.583854 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.584016 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.584170 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.584332 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.584484 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.584648 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.584807 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.584973 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.585151 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.585306 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.585470 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.585632 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.585793 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.585961 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.586128 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.586284 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.586674 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.586867 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.587109 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.587270 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.587424 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.587583 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.587735 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.587735 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.588040 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.588194 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.588354 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.588514 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.588702 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.588969 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.589208 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.589395 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.589670 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.589838 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.590000 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.590154 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.590322 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.590478 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.590638 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.590799 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.590953 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.591115 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.591294 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.591600 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 06 13:44:32.591764 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.591764 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.591764 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.591764 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.591764 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.591764 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.591764 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.591764 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.592952 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.592952 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.592952 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.592952 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.592952 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.592952 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.592952 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.592952 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.594396 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.594396 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.594396 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.594396 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.594396 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.594396 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.594396 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.595418 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.595418 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.595418 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.595879 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.595879 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.596178 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.596898 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.596898 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.597465 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.597465 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.597776 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.598105 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.598432 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.598748 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.599082 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.599399 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.599791 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.600026 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.600340 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.600655 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.600974 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.601967 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.601967 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.601967 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.602445 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.602641 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.602969 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.603243 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.603561 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.603917 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.604512 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.605078 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.605470 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.605787 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:44:32.606040 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 06 13:44:32.743190 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO dbcounter [None req-d197cdef-77ea-4113-8ebd-e5c0a25e0bb7 None None] Registered counter for database nova_api Jul 06 13:44:32.763877 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO dbcounter [None req-8e103b2f-8519-4c2a-a95d-d066e7c5df0c None None] Registered counter for database nova_api Jul 06 13:44:32.764770 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_db.sqlalchemy.engines [None req-d197cdef-77ea-4113-8ebd-e5c0a25e0bb7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124368) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 06 13:44:32.772096 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG dbcounter [-] [124368] Writer thread running {{(pid=124368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 06 13:44:32.783647 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_db.sqlalchemy.engines [None req-8e103b2f-8519-4c2a-a95d-d066e7c5df0c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124367) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 06 13:44:32.790704 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG dbcounter [-] [124367] Writer thread running {{(pid=124367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 06 13:44:32.829086 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.context [None req-d197cdef-77ea-4113-8ebd-e5c0a25e0bb7 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),85888416-be16-475e-b2e8-70b53709e325(cell1) {{(pid=124368) load_cells /opt/stack/nova/nova/context.py:464}} Jul 06 13:44:32.833108 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-d197cdef-77ea-4113-8ebd-e5c0a25e0bb7 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:44:32.834675 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-d197cdef-77ea-4113-8ebd-e5c0a25e0bb7 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:44:32.835466 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-d197cdef-77ea-4113-8ebd-e5c0a25e0bb7 None None] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:44:32.837424 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-d197cdef-77ea-4113-8ebd-e5c0a25e0bb7 None None] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:44:32.839532 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO dbcounter [None req-d197cdef-77ea-4113-8ebd-e5c0a25e0bb7 None None] Registered counter for database nova_cell0 Jul 06 13:44:32.843636 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO dbcounter [None req-d197cdef-77ea-4113-8ebd-e5c0a25e0bb7 None None] Registered counter for database nova_cell1 Jul 06 13:44:32.850214 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.context [None req-8e103b2f-8519-4c2a-a95d-d066e7c5df0c None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),85888416-be16-475e-b2e8-70b53709e325(cell1) {{(pid=124367) load_cells /opt/stack/nova/nova/context.py:464}} Jul 06 13:44:32.852004 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-8e103b2f-8519-4c2a-a95d-d066e7c5df0c None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:44:32.852504 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_db.sqlalchemy.engines [None req-d197cdef-77ea-4113-8ebd-e5c0a25e0bb7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124368) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 06 13:44:32.853290 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_db.sqlalchemy.engines [None req-d197cdef-77ea-4113-8ebd-e5c0a25e0bb7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124368) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 06 13:44:32.853632 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-8e103b2f-8519-4c2a-a95d-d066e7c5df0c None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:44:32.854573 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-8e103b2f-8519-4c2a-a95d-d066e7c5df0c None None] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:44:32.856574 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-8e103b2f-8519-4c2a-a95d-d066e7c5df0c None None] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:44:32.858611 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO dbcounter [None req-8e103b2f-8519-4c2a-a95d-d066e7c5df0c None None] Registered counter for database nova_cell0 Jul 06 13:44:32.859932 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG dbcounter [-] [124368] Writer thread running {{(pid=124368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 06 13:44:32.862689 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO dbcounter [None req-8e103b2f-8519-4c2a-a95d-d066e7c5df0c None None] Registered counter for database nova_cell1 Jul 06 13:44:32.865381 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG dbcounter [-] [124368] Writer thread running {{(pid=124368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 06 13:44:32.869891 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_db.sqlalchemy.engines [None req-8e103b2f-8519-4c2a-a95d-d066e7c5df0c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124367) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 06 13:44:32.871958 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_db.sqlalchemy.engines [None req-8e103b2f-8519-4c2a-a95d-d066e7c5df0c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124367) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 06 13:44:32.878580 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG dbcounter [-] [124367] Writer thread running {{(pid=124367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 06 13:44:32.879879 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG dbcounter [-] [124367] Writer thread running {{(pid=124367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 06 13:44:33.012328 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO dbcounter [None req-d197cdef-77ea-4113-8ebd-e5c0a25e0bb7 None None] Registered counter for database nova_cell0 Jul 06 13:44:33.018944 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_db.sqlalchemy.engines [None req-d197cdef-77ea-4113-8ebd-e5c0a25e0bb7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124368) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 06 13:44:33.023334 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG dbcounter [-] [124368] Writer thread running {{(pid=124368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 06 13:44:33.027700 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO dbcounter [None req-8e103b2f-8519-4c2a-a95d-d066e7c5df0c None None] Registered counter for database nova_cell0 Jul 06 13:44:33.034330 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_db.sqlalchemy.engines [None req-8e103b2f-8519-4c2a-a95d-d066e7c5df0c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124367) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 06 13:44:33.038715 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG dbcounter [-] [124367] Writer thread running {{(pid=124367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 06 13:44:33.340368 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: WARNING keystonemiddleware.auth_token [None req-d197cdef-77ea-4113-8ebd-e5c0a25e0bb7 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 06 13:44:33.347615 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: WARNING keystonemiddleware.auth_token [None req-d197cdef-77ea-4113-8ebd-e5c0a25e0bb7 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 06 13:44:33.362591 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: WARNING keystonemiddleware.auth_token [None req-8e103b2f-8519-4c2a-a95d-d066e7c5df0c None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 06 13:44:33.369892 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: WARNING keystonemiddleware.auth_token [None req-8e103b2f-8519-4c2a-a95d-d066e7c5df0c None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 06 13:44:33.692754 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: WARNING keystonemiddleware.auth_token [None req-d197cdef-77ea-4113-8ebd-e5c0a25e0bb7 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 06 13:44:33.699755 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: WARNING keystonemiddleware.auth_token [None req-d197cdef-77ea-4113-8ebd-e5c0a25e0bb7 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 06 13:44:33.705736 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55a2daaa09c0 pid: 124368 (default app) Jul 06 13:44:33.713356 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: WARNING keystonemiddleware.auth_token [None req-8e103b2f-8519-4c2a-a95d-d066e7c5df0c None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 06 13:44:33.719952 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: WARNING keystonemiddleware.auth_token [None req-8e103b2f-8519-4c2a-a95d-d066e7c5df0c None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 06 13:44:33.725249 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55a2daaa09c0 pid: 124367 (default app) Jul 06 13:45:14.616909 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG dbcounter [-] [124368] Writing DB stats nova_api:SELECT=3 {{(pid=124368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:45:14.620049 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG dbcounter [-] [124368] Writing DB stats nova_cell1:SELECT=3 {{(pid=124368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:45:14.621226 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG dbcounter [-] [124368] Writing DB stats nova_cell0:SELECT=3 {{(pid=124368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:45:14.622426 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG dbcounter [-] [124368] Writing DB stats nova_cell0:SELECT=3 {{(pid=124368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:45:15.818138 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG dbcounter [-] [124367] Writing DB stats nova_api:SELECT=3 {{(pid=124367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:45:15.819279 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG dbcounter [-] [124367] Writing DB stats nova_cell0:SELECT=3 {{(pid=124367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:45:15.820330 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG dbcounter [-] [124367] Writing DB stats nova_cell1:SELECT=3 {{(pid=124367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:45:15.823535 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG dbcounter [-] [124367] Writing DB stats nova_cell0:SELECT=3 {{(pid=124367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:45:16.432504 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-d10b3a0c-694f-4db3-a31c-9c217e8d830e tempest-VolumesGetTestJSON-252313682 tempest-VolumesGetTestJSON-252313682-project] Action: 'create', calling method: .version_select at 0x7ffbc59345e0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-219858198", "metadata": {"Type": "work"}}} {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 06 13:45:17.111551 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-2214d1fa-097b-4903-a965-72516082fbe9 tempest-VolumesSnapshotsTestJSON-1217350311 tempest-VolumesSnapshotsTestJSON-1217350311-project] Action: 'create', calling method: .version_select at 0x7ffbc5931550>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1622101775"}} {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 06 13:45:18.154087 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-2214d1fa-097b-4903-a965-72516082fbe9 tempest-VolumesSnapshotsTestJSON-1217350311 tempest-VolumesSnapshotsTestJSON-1217350311-project] 10.222.0.20 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 2.342916 Jul 06 13:45:18.154721 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 1/1] 10.222.0.20 () {60 vars in 1154 bytes} [Wed Jul 6 13:45:15 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 2346 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jul 06 13:45:18.167513 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-73e908a7-6ada-4dac-a421-cb2e819244e7 tempest-VolumesSnapshotsTestJSON-1217350311 tempest-VolumesSnapshotsTestJSON-1217350311-project] Calling method '.version_select at 0x7ffbc57f8430>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:45:18.193056 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-d10b3a0c-694f-4db3-a31c-9c217e8d830e tempest-VolumesGetTestJSON-252313682 tempest-VolumesGetTestJSON-252313682-project] 10.222.0.20 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 3.590832 Jul 06 13:45:18.198904 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 1/2] 10.222.0.20 () {60 vars in 1155 bytes} [Wed Jul 6 13:45:14 2022] POST /compute/v2.1/os-volumes => generated 352 bytes in 3601 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jul 06 13:45:18.215904 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-81350597-3d0a-4296-91aa-fbd6907261de tempest-VolumesGetTestJSON-252313682 tempest-VolumesGetTestJSON-252313682-project] Calling method '.version_select at 0x7ffbc57f84c0>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:45:18.286093 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-73e908a7-6ada-4dac-a421-cb2e819244e7 tempest-VolumesSnapshotsTestJSON-1217350311 tempest-VolumesSnapshotsTestJSON-1217350311-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/07ab59c4-ff68-4c97-adff-f5818fef19ac" status: 200 len: 345 microversion: 2.1 time: 0.123232 Jul 06 13:45:18.286635 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 2/3] 10.222.0.20 () {58 vars in 1244 bytes} [Wed Jul 6 13:45:18 2022] GET /compute/v2.1/os-volumes/07ab59c4-ff68-4c97-adff-f5818fef19ac => generated 345 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 06 13:45:18.363733 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-81350597-3d0a-4296-91aa-fbd6907261de tempest-VolumesGetTestJSON-252313682 tempest-VolumesGetTestJSON-252313682-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/8f621b99-c061-47d7-860d-4cb0986b03f8" status: 200 len: 352 microversion: 2.1 time: 0.156234 Jul 06 13:45:18.364299 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 2/4] 10.222.0.20 () {58 vars in 1244 bytes} [Wed Jul 6 13:45:18 2022] GET /compute/v2.1/os-volumes/8f621b99-c061-47d7-860d-4cb0986b03f8 => generated 352 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 06 13:45:19.301868 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-5046609f-e4b0-4ff8-9a85-88f676092484 tempest-VolumesSnapshotsTestJSON-1217350311 tempest-VolumesSnapshotsTestJSON-1217350311-project] Calling method '.version_select at 0x7ffbc57f8790>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:45:19.371605 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-5046609f-e4b0-4ff8-9a85-88f676092484 tempest-VolumesSnapshotsTestJSON-1217350311 tempest-VolumesSnapshotsTestJSON-1217350311-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/07ab59c4-ff68-4c97-adff-f5818fef19ac" status: 200 len: 346 microversion: 2.1 time: 0.075869 Jul 06 13:45:19.372175 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 3/5] 10.222.0.20 () {58 vars in 1244 bytes} [Wed Jul 6 13:45:19 2022] GET /compute/v2.1/os-volumes/07ab59c4-ff68-4c97-adff-f5818fef19ac => generated 346 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 06 13:45:19.379399 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-5505d919-6871-422c-984c-26e6a4d62566 tempest-VolumesGetTestJSON-252313682 tempest-VolumesGetTestJSON-252313682-project] Calling method '.version_select at 0x7ffbc57f85e0>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:45:19.396945 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-ab2a1d8f-3d5d-4c23-9518-e678a4497651 tempest-VolumesSnapshotsTestJSON-1217350311 tempest-VolumesSnapshotsTestJSON-1217350311-project] Action: 'create', calling method: .version_select at 0x7ffbc57f8af0>, body: {"snapshot": {"volume_id": "07ab59c4-ff68-4c97-adff-f5818fef19ac", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1807396075"}} {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 06 13:45:19.458193 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-5505d919-6871-422c-984c-26e6a4d62566 tempest-VolumesGetTestJSON-252313682 tempest-VolumesGetTestJSON-252313682-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/8f621b99-c061-47d7-860d-4cb0986b03f8" status: 200 len: 353 microversion: 2.1 time: 0.083674 Jul 06 13:45:19.465931 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 3/6] 10.222.0.20 () {58 vars in 1244 bytes} [Wed Jul 6 13:45:19 2022] GET /compute/v2.1/os-volumes/8f621b99-c061-47d7-860d-4cb0986b03f8 => generated 353 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 06 13:45:19.472446 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-6b3dd8b0-bf73-4335-919f-ae4fa0e00890 tempest-VolumesGetTestJSON-252313682 tempest-VolumesGetTestJSON-252313682-project] Calling method '.version_select at 0x7ffbc57f8c10>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:45:19.597494 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-6b3dd8b0-bf73-4335-919f-ae4fa0e00890 tempest-VolumesGetTestJSON-252313682 tempest-VolumesGetTestJSON-252313682-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/8f621b99-c061-47d7-860d-4cb0986b03f8" status: 200 len: 353 microversion: 2.1 time: 0.130229 Jul 06 13:45:19.598272 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 4/7] 10.222.0.20 () {58 vars in 1244 bytes} [Wed Jul 6 13:45:19 2022] GET /compute/v2.1/os-volumes/8f621b99-c061-47d7-860d-4cb0986b03f8 => generated 353 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 06 13:45:19.612287 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-21811fdf-3b03-4727-b8fd-1482136bb11e tempest-VolumesTestJSON-1577662730 tempest-VolumesTestJSON-1577662730-project] Calling method '.version_select at 0x7ffbc5811310>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:45:19.853793 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-21811fdf-3b03-4727-b8fd-1482136bb11e tempest-VolumesTestJSON-1577662730 tempest-VolumesTestJSON-1577662730-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/e0759d32-5b53-44e6-902a-6ef990eb90dd" status: 200 len: 351 microversion: 2.1 time: 0.246181 Jul 06 13:45:19.854686 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 5/8] 10.222.0.20 () {58 vars in 1244 bytes} [Wed Jul 6 13:45:19 2022] GET /compute/v2.1/os-volumes/e0759d32-5b53-44e6-902a-6ef990eb90dd => generated 351 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 06 13:45:19.860108 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-c33c81f1-4f00-402b-a063-64ccd3b02392 tempest-VolumesGetTestJSON-252313682 tempest-VolumesGetTestJSON-252313682-project] Calling method '.version_select at 0x7ffbc57f8dc0>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:45:19.924249 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-ab2a1d8f-3d5d-4c23-9518-e678a4497651 tempest-VolumesSnapshotsTestJSON-1217350311 tempest-VolumesSnapshotsTestJSON-1217350311-project] 10.222.0.20 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.544501 Jul 06 13:45:19.925486 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 4/9] 10.222.0.20 () {60 vars in 1161 bytes} [Wed Jul 6 13:45:19 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 06 13:45:19.936032 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-4188eb9d-066c-4047-8ab7-14202e2fcc6b tempest-VolumesSnapshotsTestJSON-1217350311 tempest-VolumesSnapshotsTestJSON-1217350311-project] Calling method '.version_select at 0x7ffbc580d790>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:45:20.077600 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-c33c81f1-4f00-402b-a063-64ccd3b02392 tempest-VolumesGetTestJSON-252313682 tempest-VolumesGetTestJSON-252313682-project] 10.222.0.20 "DELETE /compute/v2.1/os-volumes/8f621b99-c061-47d7-860d-4cb0986b03f8" status: 202 len: 0 microversion: 2.1 time: 0.221315 Jul 06 13:45:20.078305 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 6/10] 10.222.0.20 () {58 vars in 1247 bytes} [Wed Jul 6 13:45:19 2022] DELETE /compute/v2.1/os-volumes/8f621b99-c061-47d7-860d-4cb0986b03f8 => generated 0 bytes in 223 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 06 13:45:20.086760 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-d3194025-0cfe-40bb-b412-00f2f0c24320 tempest-VolumesGetTestJSON-252313682 tempest-VolumesGetTestJSON-252313682-project] Calling method '.version_select at 0x7ffbc57f8550>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:45:20.507692 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-4188eb9d-066c-4047-8ab7-14202e2fcc6b tempest-VolumesSnapshotsTestJSON-1217350311 tempest-VolumesSnapshotsTestJSON-1217350311-project] 10.222.0.20 "GET /compute/v2.1/os-snapshots/4045d919-b3bb-4bf0-b52a-d4406404fa4d" status: 200 len: 287 microversion: 2.1 time: 0.575911 Jul 06 13:45:20.510183 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 5/11] 10.222.0.20 () {58 vars in 1250 bytes} [Wed Jul 6 13:45:19 2022] GET /compute/v2.1/os-snapshots/4045d919-b3bb-4bf0-b52a-d4406404fa4d => generated 287 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 06 13:45:20.520907 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-8a1dd230-f5ac-456c-8246-f62d0247865f tempest-VolumesSnapshotsTestJSON-1217350311 tempest-VolumesSnapshotsTestJSON-1217350311-project] Calling method '.version_select at 0x7ffbc57f8e50>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:45:20.611341 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-d3194025-0cfe-40bb-b412-00f2f0c24320 tempest-VolumesGetTestJSON-252313682 tempest-VolumesGetTestJSON-252313682-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/8f621b99-c061-47d7-860d-4cb0986b03f8" status: 200 len: 352 microversion: 2.1 time: 0.528722 Jul 06 13:45:20.617030 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 7/12] 10.222.0.20 () {58 vars in 1244 bytes} [Wed Jul 6 13:45:20 2022] GET /compute/v2.1/os-volumes/8f621b99-c061-47d7-860d-4cb0986b03f8 => generated 352 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 06 13:45:20.760013 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-8a1dd230-f5ac-456c-8246-f62d0247865f tempest-VolumesSnapshotsTestJSON-1217350311 tempest-VolumesSnapshotsTestJSON-1217350311-project] 10.222.0.20 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.243079 Jul 06 13:45:20.760783 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 6/13] 10.222.0.20 () {58 vars in 1139 bytes} [Wed Jul 6 13:45:20 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 06 13:45:20.771874 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-9585b110-ded4-44ca-94f5-4003ad81d9ba tempest-VolumesSnapshotsTestJSON-1217350311 tempest-VolumesSnapshotsTestJSON-1217350311-project] Calling method '.version_select at 0x7ffbc5811550>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:45:20.830058 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-9585b110-ded4-44ca-94f5-4003ad81d9ba tempest-VolumesSnapshotsTestJSON-1217350311 tempest-VolumesSnapshotsTestJSON-1217350311-project] 10.222.0.20 "GET /compute/v2.1/os-snapshots/4045d919-b3bb-4bf0-b52a-d4406404fa4d" status: 200 len: 287 microversion: 2.1 time: 0.062784 Jul 06 13:45:20.834368 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 8/14] 10.222.0.20 () {58 vars in 1250 bytes} [Wed Jul 6 13:45:20 2022] GET /compute/v2.1/os-snapshots/4045d919-b3bb-4bf0-b52a-d4406404fa4d => generated 287 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 06 13:45:21.626014 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-2d84238d-f71d-47ac-82cb-427569fbd89f tempest-VolumesGetTestJSON-252313682 tempest-VolumesGetTestJSON-252313682-project] Calling method '.version_select at 0x7ffbc580d8b0>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:45:21.724765 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-2d84238d-f71d-47ac-82cb-427569fbd89f tempest-VolumesGetTestJSON-252313682 tempest-VolumesGetTestJSON-252313682-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/8f621b99-c061-47d7-860d-4cb0986b03f8" status: 200 len: 352 microversion: 2.1 time: 0.103576 Jul 06 13:45:21.725375 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 7/15] 10.222.0.20 () {58 vars in 1244 bytes} [Wed Jul 6 13:45:21 2022] GET /compute/v2.1/os-volumes/8f621b99-c061-47d7-860d-4cb0986b03f8 => generated 352 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 06 13:45:21.843508 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-085d1e3e-77dd-429e-a678-70005c851d67 tempest-VolumesSnapshotsTestJSON-1217350311 tempest-VolumesSnapshotsTestJSON-1217350311-project] Calling method '.version_select at 0x7ffbc57f8790>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:45:21.921799 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-085d1e3e-77dd-429e-a678-70005c851d67 tempest-VolumesSnapshotsTestJSON-1217350311 tempest-VolumesSnapshotsTestJSON-1217350311-project] 10.222.0.20 "GET /compute/v2.1/os-snapshots/4045d919-b3bb-4bf0-b52a-d4406404fa4d" status: 200 len: 287 microversion: 2.1 time: 0.082840 Jul 06 13:45:21.922812 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 9/16] 10.222.0.20 () {58 vars in 1250 bytes} [Wed Jul 6 13:45:21 2022] GET /compute/v2.1/os-snapshots/4045d919-b3bb-4bf0-b52a-d4406404fa4d => generated 287 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 06 13:45:22.739954 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-0fb022d8-0ab5-4535-bcc1-beafc711f6f5 tempest-VolumesGetTestJSON-252313682 tempest-VolumesGetTestJSON-252313682-project] Calling method '.version_select at 0x7ffbc580d160>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:45:22.875816 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-0fb022d8-0ab5-4535-bcc1-beafc711f6f5 tempest-VolumesGetTestJSON-252313682 tempest-VolumesGetTestJSON-252313682-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/8f621b99-c061-47d7-860d-4cb0986b03f8" status: 200 len: 352 microversion: 2.1 time: 0.140795 Jul 06 13:45:22.876390 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 8/17] 10.222.0.20 () {58 vars in 1244 bytes} [Wed Jul 6 13:45:22 2022] GET /compute/v2.1/os-volumes/8f621b99-c061-47d7-860d-4cb0986b03f8 => generated 352 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 06 13:45:22.936011 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-ff9d39dc-293b-46fd-89b7-b340fd9ff3a7 tempest-VolumesSnapshotsTestJSON-1217350311 tempest-VolumesSnapshotsTestJSON-1217350311-project] Calling method '.version_select at 0x7ffbc57f8b80>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:45:22.998994 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-ff9d39dc-293b-46fd-89b7-b340fd9ff3a7 tempest-VolumesSnapshotsTestJSON-1217350311 tempest-VolumesSnapshotsTestJSON-1217350311-project] 10.222.0.20 "GET /compute/v2.1/os-snapshots/4045d919-b3bb-4bf0-b52a-d4406404fa4d" status: 200 len: 287 microversion: 2.1 time: 0.069577 Jul 06 13:45:22.999741 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 10/18] 10.222.0.20 () {58 vars in 1250 bytes} [Wed Jul 6 13:45:22 2022] GET /compute/v2.1/os-snapshots/4045d919-b3bb-4bf0-b52a-d4406404fa4d => generated 287 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 06 13:45:23.892248 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-f61b69a5-1b53-47af-8455-ed899d374082 tempest-VolumesGetTestJSON-252313682 tempest-VolumesGetTestJSON-252313682-project] Calling method '.version_select at 0x7ffbc57f8700>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:45:23.995677 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-f61b69a5-1b53-47af-8455-ed899d374082 tempest-VolumesGetTestJSON-252313682 tempest-VolumesGetTestJSON-252313682-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/8f621b99-c061-47d7-860d-4cb0986b03f8" status: 200 len: 352 microversion: 2.1 time: 0.111142 Jul 06 13:45:24.002101 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 9/19] 10.222.0.20 () {58 vars in 1244 bytes} [Wed Jul 6 13:45:23 2022] GET /compute/v2.1/os-volumes/8f621b99-c061-47d7-860d-4cb0986b03f8 => generated 352 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 06 13:45:24.013053 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-671ef174-98ef-41b5-81f6-2665b4973922 tempest-VolumesSnapshotsTestJSON-1217350311 tempest-VolumesSnapshotsTestJSON-1217350311-project] Calling method '.version_select at 0x7ffbc58111f0>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:45:24.063169 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-671ef174-98ef-41b5-81f6-2665b4973922 tempest-VolumesSnapshotsTestJSON-1217350311 tempest-VolumesSnapshotsTestJSON-1217350311-project] 10.222.0.20 "GET /compute/v2.1/os-snapshots/4045d919-b3bb-4bf0-b52a-d4406404fa4d" status: 200 len: 287 microversion: 2.1 time: 0.055579 Jul 06 13:45:24.064230 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 11/20] 10.222.0.20 () {58 vars in 1250 bytes} [Wed Jul 6 13:45:24 2022] GET /compute/v2.1/os-snapshots/4045d919-b3bb-4bf0-b52a-d4406404fa4d => generated 287 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 06 13:45:25.008032 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-fa85ecb2-494d-4708-9729-19ab6972aa86 tempest-VolumesGetTestJSON-252313682 tempest-VolumesGetTestJSON-252313682-project] Calling method '.version_select at 0x7ffbc5811b80>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:45:25.112673 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-a2f7bffd-b101-4f6d-bcbd-1bb936c856ef tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-818044582", "imageRef": "b08481d9-1e39-41e8-97bd-b05a9c35b377", "flavorRef": "452", "networks": [{"uuid": "076be296-74e0-43c0-b50c-a77841c7b395"}]}} {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 06 13:45:25.174825 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-fa85ecb2-494d-4708-9729-19ab6972aa86 tempest-VolumesGetTestJSON-252313682 tempest-VolumesGetTestJSON-252313682-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/8f621b99-c061-47d7-860d-4cb0986b03f8" status: 200 len: 352 microversion: 2.1 time: 0.170924 Jul 06 13:45:25.180046 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 12/21] 10.222.0.20 () {58 vars in 1244 bytes} [Wed Jul 6 13:45:25 2022] GET /compute/v2.1/os-volumes/8f621b99-c061-47d7-860d-4cb0986b03f8 => generated 352 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 06 13:45:25.184814 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-c66bc1cb-8bad-4c40-82b1-89ab951c1cf2 tempest-VolumesSnapshotsTestJSON-1217350311 tempest-VolumesSnapshotsTestJSON-1217350311-project] Calling method '.version_select at 0x7ffbc57f8d30>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:45:25.237420 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-c66bc1cb-8bad-4c40-82b1-89ab951c1cf2 tempest-VolumesSnapshotsTestJSON-1217350311 tempest-VolumesSnapshotsTestJSON-1217350311-project] 10.222.0.20 "GET /compute/v2.1/os-snapshots/4045d919-b3bb-4bf0-b52a-d4406404fa4d" status: 200 len: 287 microversion: 2.1 time: 0.057992 Jul 06 13:45:25.237982 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 13/22] 10.222.0.20 () {58 vars in 1250 bytes} [Wed Jul 6 13:45:25 2022] GET /compute/v2.1/os-snapshots/4045d919-b3bb-4bf0-b52a-d4406404fa4d => generated 287 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 06 13:45:25.333254 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.network.neutron [None req-a2f7bffd-b101-4f6d-bcbd-1bb936c856ef tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] validate_networks() for [('076be296-74e0-43c0-b50c-a77841c7b395', None, None, None, None, None)] {{(pid=124367) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 06 13:45:26.189332 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-2e5a320c-b595-4615-90eb-a7e1dd126741 tempest-VolumesGetTestJSON-252313682 tempest-VolumesGetTestJSON-252313682-project] Calling method '.version_select at 0x7ffbc57f8670>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:45:26.299500 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-2e5a320c-b595-4615-90eb-a7e1dd126741 tempest-VolumesGetTestJSON-252313682 tempest-VolumesGetTestJSON-252313682-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/8f621b99-c061-47d7-860d-4cb0986b03f8" status: 200 len: 352 microversion: 2.1 time: 0.115511 Jul 06 13:45:26.300753 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 14/23] 10.222.0.20 () {58 vars in 1244 bytes} [Wed Jul 6 13:45:26 2022] GET /compute/v2.1/os-volumes/8f621b99-c061-47d7-860d-4cb0986b03f8 => generated 352 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 06 13:45:26.309538 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-15100149-c9f5-4b0d-8f2a-b82f544b6a1e tempest-VolumesSnapshotsTestJSON-1217350311 tempest-VolumesSnapshotsTestJSON-1217350311-project] Calling method '.version_select at 0x7ffbc5811ca0>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:45:26.356793 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-15100149-c9f5-4b0d-8f2a-b82f544b6a1e tempest-VolumesSnapshotsTestJSON-1217350311 tempest-VolumesSnapshotsTestJSON-1217350311-project] 10.222.0.20 "GET /compute/v2.1/os-snapshots/4045d919-b3bb-4bf0-b52a-d4406404fa4d" status: 200 len: 287 microversion: 2.1 time: 0.054581 Jul 06 13:45:26.358056 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 15/24] 10.222.0.20 () {58 vars in 1250 bytes} [Wed Jul 6 13:45:26 2022] GET /compute/v2.1/os-snapshots/4045d919-b3bb-4bf0-b52a-d4406404fa4d => generated 287 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 06 13:45:26.584110 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.virt.hardware [None req-a2f7bffd-b101-4f6d-bcbd-1bb936c856ef tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] Flavor limits 0:0:0 {{(pid=124367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 06 13:45:26.585206 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.virt.hardware [None req-a2f7bffd-b101-4f6d-bcbd-1bb936c856ef tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] Image limits 0:0:0 {{(pid=124367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 06 13:45:26.585855 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.virt.hardware [None req-a2f7bffd-b101-4f6d-bcbd-1bb936c856ef tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] Flavor pref 0:0:0 {{(pid=124367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 06 13:45:26.586504 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.virt.hardware [None req-a2f7bffd-b101-4f6d-bcbd-1bb936c856ef tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] Image pref 0:0:0 {{(pid=124367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 06 13:45:26.588028 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.virt.hardware [None req-a2f7bffd-b101-4f6d-bcbd-1bb936c856ef tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 06 13:45:26.615705 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-a2f7bffd-b101-4f6d-bcbd-1bb936c856ef tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:45:26.615995 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-a2f7bffd-b101-4f6d-bcbd-1bb936c856ef tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:45:26.616881 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-a2f7bffd-b101-4f6d-bcbd-1bb936c856ef tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:45:26.622450 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-a2f7bffd-b101-4f6d-bcbd-1bb936c856ef tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:45:26.698894 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.quota [None req-a2f7bffd-b101-4f6d-bcbd-1bb936c856ef tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] Getting quotas for project d48e24dbeaa241d7a97350fb2c8187b9. Resources: {'instances', 'cores', 'ram'} {{(pid=124367) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 06 13:45:26.708777 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.quota [None req-a2f7bffd-b101-4f6d-bcbd-1bb936c856ef tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] Getting quotas for user ad0781ce20e54c3a9b7c61e0cccf6918 and project d48e24dbeaa241d7a97350fb2c8187b9. Resources: {'instances', 'cores', 'ram'} {{(pid=124367) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 06 13:45:26.740519 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-a2f7bffd-b101-4f6d-bcbd-1bb936c856ef tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] Going to run 1 instances... {{(pid=124367) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 06 13:45:26.743313 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-a2f7bffd-b101-4f6d-bcbd-1bb936c856ef tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] [instance: 965c7a0f-fa3f-4f5c-92bf-94d8b646a9ae] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b08481d9-1e39-41e8-97bd-b05a9c35b377',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124367) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 06 13:45:26.897308 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-a2f7bffd-b101-4f6d-bcbd-1bb936c856ef tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.947536 Jul 06 13:45:26.898579 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 10/25] 10.222.0.20 () {60 vars in 1146 bytes} [Wed Jul 6 13:45:24 2022] POST /compute/v2.1/servers => generated 380 bytes in 1949 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 06 13:45:26.909591 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-1f579f19-ba2b-4b73-9438-e313ed7ba932 tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] Calling method '>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:45:26.910350 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-1f579f19-ba2b-4b73-9438-e313ed7ba932 tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] [instance: 965c7a0f-fa3f-4f5c-92bf-94d8b646a9ae] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:45:27.312949 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-d9e9c030-a78a-4aad-96e3-8a082b098dc7 tempest-VolumesGetTestJSON-252313682 tempest-VolumesGetTestJSON-252313682-project] Calling method '.version_select at 0x7ffbc570cf70>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:45:27.372050 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-1f579f19-ba2b-4b73-9438-e313ed7ba932 tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad0781ce20e54c3a9b7c61e0cccf6918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd48e24dbeaa241d7a97350fb2c8187b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:45:27.414418 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-d9e9c030-a78a-4aad-96e3-8a082b098dc7 tempest-VolumesGetTestJSON-252313682 tempest-VolumesGetTestJSON-252313682-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/8f621b99-c061-47d7-860d-4cb0986b03f8" status: 200 len: 352 microversion: 2.1 time: 0.106281 Jul 06 13:45:27.416127 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-1f579f19-ba2b-4b73-9438-e313ed7ba932 tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] 10.222.0.20 "GET /compute/v2.1/servers/965c7a0f-fa3f-4f5c-92bf-94d8b646a9ae" status: 200 len: 1214 microversion: 2.1 time: 0.506893 Jul 06 13:45:27.426057 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 11/26] 10.222.0.20 () {58 vars in 1244 bytes} [Wed Jul 6 13:45:27 2022] GET /compute/v2.1/os-volumes/8f621b99-c061-47d7-860d-4cb0986b03f8 => generated 352 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 06 13:45:27.426940 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 16/27] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:45:26 2022] GET /compute/v2.1/servers/965c7a0f-fa3f-4f5c-92bf-94d8b646a9ae => generated 1214 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:45:27.433384 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-8ee14662-b7b1-4d16-9b31-1c809000483d tempest-VolumesSnapshotsTestJSON-1217350311 tempest-VolumesSnapshotsTestJSON-1217350311-project] Calling method '.version_select at 0x7ffbc46a0700>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:45:27.462325 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-adc4aaa5-4e54-4052-b5f0-13872fb1a21b tempest-VolumesTestJSON-1577662730 tempest-VolumesTestJSON-1577662730-project] Calling method '.version_select at 0x7ffbc57cfee0>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:45:27.495459 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-8ee14662-b7b1-4d16-9b31-1c809000483d tempest-VolumesSnapshotsTestJSON-1217350311 tempest-VolumesSnapshotsTestJSON-1217350311-project] 10.222.0.20 "GET /compute/v2.1/os-snapshots/4045d919-b3bb-4bf0-b52a-d4406404fa4d" status: 200 len: 288 microversion: 2.1 time: 0.071808 Jul 06 13:45:27.496879 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 12/28] 10.222.0.20 () {58 vars in 1250 bytes} [Wed Jul 6 13:45:27 2022] GET /compute/v2.1/os-snapshots/4045d919-b3bb-4bf0-b52a-d4406404fa4d => generated 288 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 06 13:45:27.507745 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-15b84960-484c-4d8e-b5cd-cdaff900dc2b tempest-VolumesSnapshotsTestJSON-1217350311 tempest-VolumesSnapshotsTestJSON-1217350311-project] Calling method '.version_select at 0x7ffbc46a0e50>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:45:27.566271 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-adc4aaa5-4e54-4052-b5f0-13872fb1a21b tempest-VolumesTestJSON-1577662730 tempest-VolumesTestJSON-1577662730-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/737e2d08-3a13-441b-b436-24827598a3b5" status: 200 len: 351 microversion: 2.1 time: 0.108384 Jul 06 13:45:27.567233 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 17/29] 10.222.0.20 () {58 vars in 1244 bytes} [Wed Jul 6 13:45:27 2022] GET /compute/v2.1/os-volumes/737e2d08-3a13-441b-b436-24827598a3b5 => generated 351 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 06 13:45:27.669519 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-15b84960-484c-4d8e-b5cd-cdaff900dc2b tempest-VolumesSnapshotsTestJSON-1217350311 tempest-VolumesSnapshotsTestJSON-1217350311-project] 10.222.0.20 "DELETE /compute/v2.1/os-snapshots/4045d919-b3bb-4bf0-b52a-d4406404fa4d" status: 202 len: 0 microversion: 2.1 time: 0.166363 Jul 06 13:45:27.670774 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 13/30] 10.222.0.20 () {58 vars in 1253 bytes} [Wed Jul 6 13:45:27 2022] DELETE /compute/v2.1/os-snapshots/4045d919-b3bb-4bf0-b52a-d4406404fa4d => generated 0 bytes in 168 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 06 13:45:27.679579 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-ab5cc4d0-8cc3-4d41-bf49-c04996e2862e tempest-VolumesSnapshotsTestJSON-1217350311 tempest-VolumesSnapshotsTestJSON-1217350311-project] Calling method '.version_select at 0x7ffbc57df310>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:45:27.847439 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-ab5cc4d0-8cc3-4d41-bf49-c04996e2862e tempest-VolumesSnapshotsTestJSON-1217350311 tempest-VolumesSnapshotsTestJSON-1217350311-project] 10.222.0.20 "GET /compute/v2.1/os-snapshots/4045d919-b3bb-4bf0-b52a-d4406404fa4d" status: 200 len: 287 microversion: 2.1 time: 0.171894 Jul 06 13:45:27.848232 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 18/31] 10.222.0.20 () {58 vars in 1250 bytes} [Wed Jul 6 13:45:27 2022] GET /compute/v2.1/os-snapshots/4045d919-b3bb-4bf0-b52a-d4406404fa4d => generated 287 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 06 13:45:28.434630 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-8a382384-ae43-4e35-bcc0-c72083172bbc tempest-VolumesGetTestJSON-252313682 tempest-VolumesGetTestJSON-252313682-project] Calling method '.version_select at 0x7ffbc46a0a60>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:45:28.438762 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-b88c49d8-f64c-4a80-a1e7-a8823a849501 tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] Calling method '>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:45:28.439381 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-b88c49d8-f64c-4a80-a1e7-a8823a849501 tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] [instance: 965c7a0f-fa3f-4f5c-92bf-94d8b646a9ae] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:45:28.487238 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.wsgi [None req-8a382384-ae43-4e35-bcc0-c72083172bbc tempest-VolumesGetTestJSON-252313682 tempest-VolumesGetTestJSON-252313682-project] HTTP exception thrown: Volume 8f621b99-c061-47d7-860d-4cb0986b03f8 could not be found. Jul 06 13:45:28.500782 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-8a382384-ae43-4e35-bcc0-c72083172bbc tempest-VolumesGetTestJSON-252313682 tempest-VolumesGetTestJSON-252313682-project] Request method failure captured: Jul 06 13:45:28.500782 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: request: GET /compute/v2.1/os-volumes/8f621b99-c061-47d7-860d-4cb0986b03f8 HTTP/1.1 Jul 06 13:45:28.500782 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: Accept: application/json Jul 06 13:45:28.500782 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: Accept-Encoding: identity Jul 06 13:45:28.500782 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: Connection: close Jul 06 13:45:28.500782 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: Content-Length: 0 Jul 06 13:45:28.500782 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: Content-Type: application/json Jul 06 13:45:28.500782 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: Host: 10.222.0.20 Jul 06 13:45:28.500782 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: Openstack-System-Scope: None Jul 06 13:45:28.500782 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: User-Agent: python-urllib3/1.26.9 Jul 06 13:45:28.500782 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: X-Auth-Token: gAAAAABixZHq4cxdWpZFHlVMtV17WelVPzF5Y0St4ZOZxz3HFdYejs0SD3u9TxprJvplZa27uCmm-FWC58_Lat5gOuwdavtoXAQukaJHXWk1cTBAttqYspBGnt3ufsnzPIt0CVlzNoZ9jfdXDYxGqlPII246mhV8dDurFbT8BdiceVaSzpJ_8kI Jul 06 13:45:28.500782 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: X-Domain-Id: None Jul 06 13:45:28.500782 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: X-Domain-Name: None Jul 06 13:45:28.500782 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: X-Identity-Status: Confirmed Jul 06 13:45:28.500782 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: X-Is-Admin-Project: True Jul 06 13:45:28.500782 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: X-Project-Domain-Id: default Jul 06 13:45:28.500782 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: X-Project-Domain-Name: Default Jul 06 13:45:28.500782 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: X-Project-Id: c4e36049a0fd4b12a1ab55b5b4d5adfe Jul 06 13:45:28.500782 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: X-Project-Name: tempest-VolumesGetTestJSON-252313682 Jul 06 13:45:28.500782 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: X-Role: reader,member Jul 06 13:45:28.500782 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: X-Roles: reader,member Jul 06 13:45:28.502193 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_c4e36049a0fd4b12a1ab55b5b4d5adfe"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/c4e36049a0fd4b12a1ab55b5b4d5adfe"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/c4e36049a0fd4b12a1ab55b5b4d5adfe"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/c4e36049a0fd4b12a1ab55b5b4d5adfe"}]}] Jul 06 13:45:28.502193 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: X-Tenant: tempest-VolumesGetTestJSON-252313682 Jul 06 13:45:28.502193 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: X-Tenant-Id: c4e36049a0fd4b12a1ab55b5b4d5adfe Jul 06 13:45:28.502193 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: X-Tenant-Name: tempest-VolumesGetTestJSON-252313682 Jul 06 13:45:28.502193 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: X-User: tempest-VolumesGetTestJSON-252313682-project Jul 06 13:45:28.502193 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: X-User-Domain-Id: default Jul 06 13:45:28.502193 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: X-User-Domain-Name: Default Jul 06 13:45:28.502193 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: X-User-Id: 3b07c60a91d241c6b1a42bc32328c274 Jul 06 13:45:28.502193 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: X-User-Name: tempest-VolumesGetTestJSON-252313682-project Jul 06 13:45:28.502193 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: method: Jul 06 13:45:28.502193 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: exception: Volume 8f621b99-c061-47d7-860d-4cb0986b03f8 could not be found. Jul 06 13:45:28.502193 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: action_args: {'id': '8f621b99-c061-47d7-860d-4cb0986b03f8'} Jul 06 13:45:28.502193 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 06 13:45:28.502930 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 06 13:45:28.502930 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 06 13:45:28.502930 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 06 13:45:28.502930 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 06 13:45:28.502930 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 06 13:45:28.502930 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 06 13:45:28.502930 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 06 13:45:28.502930 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 06 13:45:28.502930 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 06 13:45:28.502930 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 06 13:45:28.502930 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 06 13:45:28.502930 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 06 13:45:28.502930 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 06 13:45:28.502930 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 06 13:45:28.502930 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 06 13:45:28.502930 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 8f621b99-c061-47d7-860d-4cb0986b03f8 could not be found. (HTTP 404) (Request-ID: req-f03dbe11-874d-4450-93a3-d9d47aa0fbe8) Jul 06 13:45:28.502930 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi Jul 06 13:45:28.502930 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 06 13:45:28.502930 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi Jul 06 13:45:28.504014 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 06 13:45:28.504014 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 06 13:45:28.504014 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 06 13:45:28.504014 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 06 13:45:28.504014 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 06 13:45:28.504014 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 06 13:45:28.504014 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 06 13:45:28.504014 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 06 13:45:28.504014 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 06 13:45:28.504014 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 06 13:45:28.504014 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 06 13:45:28.504014 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 06 13:45:28.504014 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 06 13:45:28.504014 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 06 13:45:28.504014 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 06 13:45:28.504014 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 06 13:45:28.504014 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 06 13:45:28.504014 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 06 13:45:28.504014 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 06 13:45:28.505242 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 06 13:45:28.505242 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 06 13:45:28.505242 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 06 13:45:28.505242 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 06 13:45:28.505242 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 8f621b99-c061-47d7-860d-4cb0986b03f8 could not be found. Jul 06 13:45:28.505242 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi Jul 06 13:45:28.505242 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 06 13:45:28.505242 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi Jul 06 13:45:28.505242 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 06 13:45:28.505242 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 06 13:45:28.505242 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 06 13:45:28.505242 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 06 13:45:28.505242 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 06 13:45:28.505242 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 06 13:45:28.505242 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 06 13:45:28.505242 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 06 13:45:28.505242 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 06 13:45:28.505242 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 06 13:45:28.505242 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 06 13:45:28.506508 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 8f621b99-c061-47d7-860d-4cb0986b03f8 could not be found. Jul 06 13:45:28.506508 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi Jul 06 13:45:28.506508 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 06 13:45:28.506508 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi Jul 06 13:45:28.506508 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 06 13:45:28.506508 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 06 13:45:28.506508 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 06 13:45:28.506508 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 06 13:45:28.506508 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 06 13:45:28.506508 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 8f621b99-c061-47d7-860d-4cb0986b03f8 could not be found. Jul 06 13:45:28.506508 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi Jul 06 13:45:28.506508 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-8a382384-ae43-4e35-bcc0-c72083172bbc tempest-VolumesGetTestJSON-252313682 tempest-VolumesGetTestJSON-252313682-project] Returning 404 to user: Volume 8f621b99-c061-47d7-860d-4cb0986b03f8 could not be found. {{(pid=124367) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 06 13:45:28.506508 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-8a382384-ae43-4e35-bcc0-c72083172bbc tempest-VolumesGetTestJSON-252313682 tempest-VolumesGetTestJSON-252313682-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/8f621b99-c061-47d7-860d-4cb0986b03f8" status: 404 len: 109 microversion: 2.1 time: 0.078654 Jul 06 13:45:28.509785 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 14/32] 10.222.0.20 () {58 vars in 1244 bytes} [Wed Jul 6 13:45:28 2022] GET /compute/v2.1/os-volumes/8f621b99-c061-47d7-860d-4cb0986b03f8 => generated 109 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 06 13:45:28.771397 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-b88c49d8-f64c-4a80-a1e7-a8823a849501 tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad0781ce20e54c3a9b7c61e0cccf6918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd48e24dbeaa241d7a97350fb2c8187b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:45:28.781804 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-b88c49d8-f64c-4a80-a1e7-a8823a849501 tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] 10.222.0.20 "GET /compute/v2.1/servers/965c7a0f-fa3f-4f5c-92bf-94d8b646a9ae" status: 200 len: 1214 microversion: 2.1 time: 0.352285 Jul 06 13:45:28.798794 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 19/33] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:45:28 2022] GET /compute/v2.1/servers/965c7a0f-fa3f-4f5c-92bf-94d8b646a9ae => generated 1214 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 06 13:45:28.866666 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-8292eaaf-5a3a-468c-bd8e-c346bc6acfa9 tempest-VolumesSnapshotsTestJSON-1217350311 tempest-VolumesSnapshotsTestJSON-1217350311-project] Calling method '.version_select at 0x7ffbc46a0430>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:45:28.950103 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.wsgi [None req-8292eaaf-5a3a-468c-bd8e-c346bc6acfa9 tempest-VolumesSnapshotsTestJSON-1217350311 tempest-VolumesSnapshotsTestJSON-1217350311-project] HTTP exception thrown: Snapshot 4045d919-b3bb-4bf0-b52a-d4406404fa4d could not be found. Jul 06 13:45:28.952731 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-8292eaaf-5a3a-468c-bd8e-c346bc6acfa9 tempest-VolumesSnapshotsTestJSON-1217350311 tempest-VolumesSnapshotsTestJSON-1217350311-project] Request method failure captured: Jul 06 13:45:28.952731 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: request: GET /compute/v2.1/os-snapshots/4045d919-b3bb-4bf0-b52a-d4406404fa4d HTTP/1.1 Jul 06 13:45:28.952731 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: Accept: application/json Jul 06 13:45:28.952731 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: Accept-Encoding: identity Jul 06 13:45:28.952731 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: Connection: close Jul 06 13:45:28.952731 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: Content-Length: 0 Jul 06 13:45:28.952731 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: Content-Type: application/json Jul 06 13:45:28.952731 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: Host: 10.222.0.20 Jul 06 13:45:28.952731 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: Openstack-System-Scope: None Jul 06 13:45:28.952731 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: User-Agent: python-urllib3/1.26.9 Jul 06 13:45:28.952731 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: X-Auth-Token: gAAAAABixZHrMHNt0AiiTsOy0q2XvA-FiUwaejsD4BYGpzsq2drs5v3lS0hBc-zoyqCkFWVVj-shQxMIvBKxs74sPAVJLGAh2Nnk4QLlejMJBMkZnaIsdVmkNfMxpRykFKBErNIy6RblQu64ulILd8xtKuriML8DI1JQPieUIfAkEsJqHvzeXo0 Jul 06 13:45:28.952731 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: X-Domain-Id: None Jul 06 13:45:28.952731 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: X-Domain-Name: None Jul 06 13:45:28.952731 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: X-Identity-Status: Confirmed Jul 06 13:45:28.952731 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: X-Is-Admin-Project: True Jul 06 13:45:28.952731 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: X-Project-Domain-Id: default Jul 06 13:45:28.952731 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: X-Project-Domain-Name: Default Jul 06 13:45:28.952731 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: X-Project-Id: 5080a0e6cfb24d799c3b31cec1d073bc Jul 06 13:45:28.952731 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1217350311 Jul 06 13:45:28.952731 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: X-Role: reader,member Jul 06 13:45:28.952731 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: X-Roles: reader,member Jul 06 13:45:28.953832 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_5080a0e6cfb24d799c3b31cec1d073bc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/5080a0e6cfb24d799c3b31cec1d073bc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/5080a0e6cfb24d799c3b31cec1d073bc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/5080a0e6cfb24d799c3b31cec1d073bc"}]}] Jul 06 13:45:28.953832 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1217350311 Jul 06 13:45:28.953832 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: X-Tenant-Id: 5080a0e6cfb24d799c3b31cec1d073bc Jul 06 13:45:28.953832 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1217350311 Jul 06 13:45:28.953832 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: X-User: tempest-VolumesSnapshotsTestJSON-1217350311-project Jul 06 13:45:28.953832 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: X-User-Domain-Id: default Jul 06 13:45:28.953832 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: X-User-Domain-Name: Default Jul 06 13:45:28.953832 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: X-User-Id: ae1587d0dc6246f9997824193eef6d78 Jul 06 13:45:28.953832 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1217350311-project Jul 06 13:45:28.953832 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: method: Jul 06 13:45:28.953832 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: exception: Snapshot 4045d919-b3bb-4bf0-b52a-d4406404fa4d could not be found. Jul 06 13:45:28.953832 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: action_args: {'id': '4045d919-b3bb-4bf0-b52a-d4406404fa4d'} Jul 06 13:45:28.953832 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 06 13:45:28.954484 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 06 13:45:28.954484 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jul 06 13:45:28.954484 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jul 06 13:45:28.954484 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jul 06 13:45:28.954484 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jul 06 13:45:28.954484 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jul 06 13:45:28.954484 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jul 06 13:45:28.954484 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 06 13:45:28.954484 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 06 13:45:28.954484 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 06 13:45:28.954484 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 06 13:45:28.954484 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 06 13:45:28.954484 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 06 13:45:28.954484 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 06 13:45:28.954484 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 06 13:45:28.954484 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 4045d919-b3bb-4bf0-b52a-d4406404fa4d could not be found. (HTTP 404) (Request-ID: req-7e54aae6-b9b3-4bfd-8768-5be324b7636a) Jul 06 13:45:28.954484 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi Jul 06 13:45:28.954484 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 06 13:45:28.955322 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi Jul 06 13:45:28.955322 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 06 13:45:28.955322 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Jul 06 13:45:28.955322 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Jul 06 13:45:28.955322 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 06 13:45:28.955322 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 06 13:45:28.955322 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Jul 06 13:45:28.955322 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Jul 06 13:45:28.955322 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 06 13:45:28.955322 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 06 13:45:28.955322 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jul 06 13:45:28.955322 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jul 06 13:45:28.955322 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jul 06 13:45:28.955322 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jul 06 13:45:28.955322 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jul 06 13:45:28.955322 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jul 06 13:45:28.955322 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 06 13:45:28.955322 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 06 13:45:28.955322 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 06 13:45:28.959294 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 06 13:45:28.959294 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 06 13:45:28.959294 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 06 13:45:28.959294 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 06 13:45:28.959294 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 06 13:45:28.959294 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 4045d919-b3bb-4bf0-b52a-d4406404fa4d could not be found. Jul 06 13:45:28.959294 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi Jul 06 13:45:28.959294 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 06 13:45:28.959294 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi Jul 06 13:45:28.959294 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 06 13:45:28.959294 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 06 13:45:28.959294 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 06 13:45:28.959294 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 06 13:45:28.959294 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 06 13:45:28.959294 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 06 13:45:28.959294 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 06 13:45:28.959294 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 06 13:45:28.959294 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 06 13:45:28.959294 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Jul 06 13:45:28.959294 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 06 13:45:28.960380 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 4045d919-b3bb-4bf0-b52a-d4406404fa4d could not be found. Jul 06 13:45:28.960380 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi Jul 06 13:45:28.960380 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 06 13:45:28.960380 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi Jul 06 13:45:28.960380 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 06 13:45:28.960380 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 06 13:45:28.960380 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 06 13:45:28.960380 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 06 13:45:28.960380 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 06 13:45:28.960380 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 4045d919-b3bb-4bf0-b52a-d4406404fa4d could not be found. Jul 06 13:45:28.960380 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi Jul 06 13:45:28.964383 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-8292eaaf-5a3a-468c-bd8e-c346bc6acfa9 tempest-VolumesSnapshotsTestJSON-1217350311 tempest-VolumesSnapshotsTestJSON-1217350311-project] Returning 404 to user: Snapshot 4045d919-b3bb-4bf0-b52a-d4406404fa4d could not be found. {{(pid=124367) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 06 13:45:28.965545 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-8292eaaf-5a3a-468c-bd8e-c346bc6acfa9 tempest-VolumesSnapshotsTestJSON-1217350311 tempest-VolumesSnapshotsTestJSON-1217350311-project] 10.222.0.20 "GET /compute/v2.1/os-snapshots/4045d919-b3bb-4bf0-b52a-d4406404fa4d" status: 404 len: 111 microversion: 2.1 time: 0.110235 Jul 06 13:45:28.966668 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 15/34] 10.222.0.20 () {58 vars in 1250 bytes} [Wed Jul 6 13:45:28 2022] GET /compute/v2.1/os-snapshots/4045d919-b3bb-4bf0-b52a-d4406404fa4d => generated 111 bytes in 112 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 06 13:45:28.975151 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-0d278474-8ab1-4120-80da-e6cf95620102 tempest-VolumesSnapshotsTestJSON-1217350311 tempest-VolumesSnapshotsTestJSON-1217350311-project] Calling method '.version_select at 0x7ffbc57df940>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:45:29.224514 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-0d278474-8ab1-4120-80da-e6cf95620102 tempest-VolumesSnapshotsTestJSON-1217350311 tempest-VolumesSnapshotsTestJSON-1217350311-project] 10.222.0.20 "DELETE /compute/v2.1/os-volumes/07ab59c4-ff68-4c97-adff-f5818fef19ac" status: 202 len: 0 microversion: 2.1 time: 0.253132 Jul 06 13:45:29.225339 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 20/35] 10.222.0.20 () {58 vars in 1247 bytes} [Wed Jul 6 13:45:28 2022] DELETE /compute/v2.1/os-volumes/07ab59c4-ff68-4c97-adff-f5818fef19ac => generated 0 bytes in 255 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 06 13:45:29.239302 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-f87c84ab-78bf-4a50-9073-d0f29c03b378 tempest-VolumesSnapshotsTestJSON-1217350311 tempest-VolumesSnapshotsTestJSON-1217350311-project] Calling method '.version_select at 0x7ffbc57dfee0>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:45:29.397373 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-9538689b-339b-489d-a493-0bb3d54af5e8 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Action: 'create', calling method: .version_select at 0x7ffbc4674ca0>, body: {"keypair": {"name": "tempest-keypair-577538698", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJjqtSsrHeBjVCJ7mBcEw9x6OySc912VTw9jdN3vRfC03NfRuPRFA8V/tw/Jz0GHlLLg7k6ZxTTA6PO2ySaMFmsTMvOiqM0NXU50wRuJqGk0hxDNDtRTVUz4gteD+paqsQ=="}} {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 06 13:45:29.435445 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-f87c84ab-78bf-4a50-9073-d0f29c03b378 tempest-VolumesSnapshotsTestJSON-1217350311 tempest-VolumesSnapshotsTestJSON-1217350311-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/07ab59c4-ff68-4c97-adff-f5818fef19ac" status: 200 len: 345 microversion: 2.1 time: 0.202491 Jul 06 13:45:29.443105 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 21/36] 10.222.0.20 () {58 vars in 1244 bytes} [Wed Jul 6 13:45:29 2022] GET /compute/v2.1/os-volumes/07ab59c4-ff68-4c97-adff-f5818fef19ac => generated 345 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 06 13:45:29.562505 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.quota [None req-9538689b-339b-489d-a493-0bb3d54af5e8 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Getting quotas for project bd85f2a57a0847debf5aaf81aab7a638. Resources: {'key_pairs'} {{(pid=124367) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 06 13:45:29.580580 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.quota [None req-9538689b-339b-489d-a493-0bb3d54af5e8 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Getting quotas for user 7b572a8f465048558fc969b85b2aec5b and project bd85f2a57a0847debf5aaf81aab7a638. Resources: {'key_pairs'} {{(pid=124367) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 06 13:45:29.738318 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-9538689b-339b-489d-a493-0bb3d54af5e8 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.678904 Jul 06 13:45:29.738933 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 16/37] 10.222.0.20 () {60 vars in 1158 bytes} [Wed Jul 6 13:45:29 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 06 13:45:29.805456 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-a99e5e05-251b-4995-9e69-303cca0afe9d tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] Calling method '>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:45:29.807116 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-a99e5e05-251b-4995-9e69-303cca0afe9d tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] [instance: 965c7a0f-fa3f-4f5c-92bf-94d8b646a9ae] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:45:29.825249 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-a99e5e05-251b-4995-9e69-303cca0afe9d tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:45:29.826001 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-a99e5e05-251b-4995-9e69-303cca0afe9d tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:45:29.827896 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-a99e5e05-251b-4995-9e69-303cca0afe9d tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:45:29.831043 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-a99e5e05-251b-4995-9e69-303cca0afe9d tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:45:30.255728 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-a99e5e05-251b-4995-9e69-303cca0afe9d tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad0781ce20e54c3a9b7c61e0cccf6918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd48e24dbeaa241d7a97350fb2c8187b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:45:30.285296 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-a99e5e05-251b-4995-9e69-303cca0afe9d tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] 10.222.0.20 "GET /compute/v2.1/servers/965c7a0f-fa3f-4f5c-92bf-94d8b646a9ae" status: 200 len: 1218 microversion: 2.1 time: 0.484154 Jul 06 13:45:30.296923 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 22/38] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:45:29 2022] GET /compute/v2.1/servers/965c7a0f-fa3f-4f5c-92bf-94d8b646a9ae => generated 1218 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:45:30.448332 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-ff7b3f76-a10c-4724-b226-1ee5cfa767f3 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Action: 'create', calling method: .version_select at 0x7ffbc4692820>, body: {"keypair": {"name": "tempest-keypair-1180722985", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHzoQ+LOfIlEW4iUu7jr4bQmiqgGbpqF7VbxoNa/qDdYh+uC0WEn7B8DIIJMudSqPGQV807Va/pc/pGs2kn3RWKiC18Yh4o2WM049wAUc4vba6tJ5aFwi3iXEZQADAvDTQ=="}} {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 06 13:45:30.466207 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-574ba9fb-3980-458f-b263-caacb7d60d7e tempest-VolumesSnapshotsTestJSON-1217350311 tempest-VolumesSnapshotsTestJSON-1217350311-project] Calling method '.version_select at 0x7ffbc57df8b0>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:45:30.474345 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.quota [None req-ff7b3f76-a10c-4724-b226-1ee5cfa767f3 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Getting quotas for project 05df572327d54bd99595974b75898052. Resources: {'key_pairs'} {{(pid=124367) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 06 13:45:30.480598 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.quota [None req-ff7b3f76-a10c-4724-b226-1ee5cfa767f3 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Getting quotas for user 3d7cacb73c8342579d9f990b0193487c and project 05df572327d54bd99595974b75898052. Resources: {'key_pairs'} {{(pid=124367) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 06 13:45:30.519676 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-ff7b3f76-a10c-4724-b226-1ee5cfa767f3 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.345404 Jul 06 13:45:30.529915 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 17/39] 10.222.0.20 () {60 vars in 1158 bytes} [Wed Jul 6 13:45:30 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 06 13:45:30.588274 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-574ba9fb-3980-458f-b263-caacb7d60d7e tempest-VolumesSnapshotsTestJSON-1217350311 tempest-VolumesSnapshotsTestJSON-1217350311-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/07ab59c4-ff68-4c97-adff-f5818fef19ac" status: 200 len: 345 microversion: 2.1 time: 0.136760 Jul 06 13:45:30.588672 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 23/40] 10.222.0.20 () {58 vars in 1244 bytes} [Wed Jul 6 13:45:30 2022] GET /compute/v2.1/os-volumes/07ab59c4-ff68-4c97-adff-f5818fef19ac => generated 345 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 06 13:45:31.304876 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-d6061858-7e76-4727-a52a-8593ad291e2d tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] Calling method '>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:45:31.308543 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-d6061858-7e76-4727-a52a-8593ad291e2d tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] [instance: 965c7a0f-fa3f-4f5c-92bf-94d8b646a9ae] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:45:31.320775 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-d6061858-7e76-4727-a52a-8593ad291e2d tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:45:31.322293 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-d6061858-7e76-4727-a52a-8593ad291e2d tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:45:31.323212 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-d6061858-7e76-4727-a52a-8593ad291e2d tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:45:31.324048 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-d6061858-7e76-4727-a52a-8593ad291e2d tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:45:31.325459 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-233da81a-7cab-427b-b2dd-7957833fd68d tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1970288447", "imageRef": "b08481d9-1e39-41e8-97bd-b05a9c35b377", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 06 13:45:31.403759 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-d6061858-7e76-4727-a52a-8593ad291e2d tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad0781ce20e54c3a9b7c61e0cccf6918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd48e24dbeaa241d7a97350fb2c8187b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:45:31.413673 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-d6061858-7e76-4727-a52a-8593ad291e2d tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] 10.222.0.20 "GET /compute/v2.1/servers/965c7a0f-fa3f-4f5c-92bf-94d8b646a9ae" status: 200 len: 1218 microversion: 2.1 time: 0.114140 Jul 06 13:45:31.419974 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.network.neutron [None req-233da81a-7cab-427b-b2dd-7957833fd68d tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] validate_networks() for [('f1ea0748-7e5f-4bd2-b8bf-076ecf50758f', None, None, None, None, None)] {{(pid=124367) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 06 13:45:31.424775 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 24/41] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:45:31 2022] GET /compute/v2.1/servers/965c7a0f-fa3f-4f5c-92bf-94d8b646a9ae => generated 1218 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 06 13:45:31.600464 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-4ca7ada5-3fb3-44f9-bb42-ff2c301ca9b2 tempest-VolumesSnapshotsTestJSON-1217350311 tempest-VolumesSnapshotsTestJSON-1217350311-project] Calling method '.version_select at 0x7ffbc56e7310>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:45:31.719363 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-4ca7ada5-3fb3-44f9-bb42-ff2c301ca9b2 tempest-VolumesSnapshotsTestJSON-1217350311 tempest-VolumesSnapshotsTestJSON-1217350311-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/07ab59c4-ff68-4c97-adff-f5818fef19ac" status: 200 len: 345 microversion: 2.1 time: 0.122978 Jul 06 13:45:31.726963 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 25/42] 10.222.0.20 () {58 vars in 1244 bytes} [Wed Jul 6 13:45:31 2022] GET /compute/v2.1/os-volumes/07ab59c4-ff68-4c97-adff-f5818fef19ac => generated 345 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 06 13:45:32.223526 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.virt.hardware [None req-233da81a-7cab-427b-b2dd-7957833fd68d tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Flavor limits 0:0:0 {{(pid=124367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 06 13:45:32.224878 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.virt.hardware [None req-233da81a-7cab-427b-b2dd-7957833fd68d tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Image limits 0:0:0 {{(pid=124367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 06 13:45:32.225669 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.virt.hardware [None req-233da81a-7cab-427b-b2dd-7957833fd68d tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Flavor pref 0:0:0 {{(pid=124367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 06 13:45:32.232208 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.virt.hardware [None req-233da81a-7cab-427b-b2dd-7957833fd68d tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Image pref 0:0:0 {{(pid=124367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 06 13:45:32.232957 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.virt.hardware [None req-233da81a-7cab-427b-b2dd-7957833fd68d tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 06 13:45:32.246567 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-233da81a-7cab-427b-b2dd-7957833fd68d tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:45:32.247246 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-233da81a-7cab-427b-b2dd-7957833fd68d tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:45:32.248167 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-233da81a-7cab-427b-b2dd-7957833fd68d tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:45:32.248724 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-233da81a-7cab-427b-b2dd-7957833fd68d tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:45:32.299253 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.quota [None req-233da81a-7cab-427b-b2dd-7957833fd68d tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Getting quotas for project 3b2a80a004e04da7ae12db9f3f87146f. Resources: {'instances', 'cores', 'ram'} {{(pid=124367) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 06 13:45:32.310953 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.quota [None req-233da81a-7cab-427b-b2dd-7957833fd68d tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Getting quotas for user 0c83c05bec4f456d8aa7d51732ddc8af and project 3b2a80a004e04da7ae12db9f3f87146f. Resources: {'instances', 'cores', 'ram'} {{(pid=124367) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 06 13:45:32.341035 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-233da81a-7cab-427b-b2dd-7957833fd68d tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Going to run 1 instances... {{(pid=124367) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 06 13:45:32.344597 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-233da81a-7cab-427b-b2dd-7957833fd68d tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] [instance: 12bddea9-d545-43f2-9bf7-5e723900c8c6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b08481d9-1e39-41e8-97bd-b05a9c35b377',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124367) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 06 13:45:32.432641 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-d2d20bcf-4a54-4e92-bca3-77d48b87d3b1 tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] Calling method '>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:45:32.433414 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-d2d20bcf-4a54-4e92-bca3-77d48b87d3b1 tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] [instance: 965c7a0f-fa3f-4f5c-92bf-94d8b646a9ae] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:45:32.448530 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-d2d20bcf-4a54-4e92-bca3-77d48b87d3b1 tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:45:32.450543 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-d2d20bcf-4a54-4e92-bca3-77d48b87d3b1 tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:45:32.455311 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-d2d20bcf-4a54-4e92-bca3-77d48b87d3b1 tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:45:32.458688 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-d2d20bcf-4a54-4e92-bca3-77d48b87d3b1 tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:45:32.461884 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-233da81a-7cab-427b-b2dd-7957833fd68d tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.241407 Jul 06 13:45:32.469985 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 18/43] 10.222.0.20 () {60 vars in 1146 bytes} [Wed Jul 6 13:45:31 2022] POST /compute/v2.1/servers => generated 383 bytes in 1250 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 06 13:45:32.487199 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-eaa4d030-ca90-47c3-9190-8212a8369d63 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:45:32.493847 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-eaa4d030-ca90-47c3-9190-8212a8369d63 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] [instance: 12bddea9-d545-43f2-9bf7-5e723900c8c6] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:45:32.619886 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-d2d20bcf-4a54-4e92-bca3-77d48b87d3b1 tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad0781ce20e54c3a9b7c61e0cccf6918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd48e24dbeaa241d7a97350fb2c8187b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:45:32.631952 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-d2d20bcf-4a54-4e92-bca3-77d48b87d3b1 tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] 10.222.0.20 "GET /compute/v2.1/servers/965c7a0f-fa3f-4f5c-92bf-94d8b646a9ae" status: 200 len: 1218 microversion: 2.1 time: 0.204473 Jul 06 13:45:32.632542 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 26/44] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:45:32 2022] GET /compute/v2.1/servers/965c7a0f-fa3f-4f5c-92bf-94d8b646a9ae => generated 1218 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:45:32.733970 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-2d4303da-3716-486b-a53f-1a108ddef11e tempest-VolumesSnapshotsTestJSON-1217350311 tempest-VolumesSnapshotsTestJSON-1217350311-project] Calling method '.version_select at 0x7ffbc56e7280>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:45:32.793948 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-eaa4d030-ca90-47c3-9190-8212a8369d63 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c83c05bec4f456d8aa7d51732ddc8af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b2a80a004e04da7ae12db9f3f87146f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:45:32.815941 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-2d4303da-3716-486b-a53f-1a108ddef11e tempest-VolumesSnapshotsTestJSON-1217350311 tempest-VolumesSnapshotsTestJSON-1217350311-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/07ab59c4-ff68-4c97-adff-f5818fef19ac" status: 200 len: 345 microversion: 2.1 time: 0.078564 Jul 06 13:45:32.816634 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 27/45] 10.222.0.20 () {58 vars in 1244 bytes} [Wed Jul 6 13:45:32 2022] GET /compute/v2.1/os-volumes/07ab59c4-ff68-4c97-adff-f5818fef19ac => generated 345 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 06 13:45:32.835511 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-eaa4d030-ca90-47c3-9190-8212a8369d63 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] 10.222.0.20 "GET /compute/v2.1/servers/12bddea9-d545-43f2-9bf7-5e723900c8c6" status: 200 len: 1222 microversion: 2.1 time: 0.359090 Jul 06 13:45:32.836942 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 19/46] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:45:32 2022] GET /compute/v2.1/servers/12bddea9-d545-43f2-9bf7-5e723900c8c6 => generated 1222 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:45:33.088346 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-aa022931-315b-4522-9b74-89efb345ff4d tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-2002964703", "imageRef": "b08481d9-1e39-41e8-97bd-b05a9c35b377", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 06 13:45:33.161480 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-f06ad738-3b97-4e8e-982e-b42e53a0cfa8 tempest-VolumesNegativeTest-884817008 tempest-VolumesNegativeTest-884817008-project] Action: 'create', calling method: .version_select at 0x7ffbc56e7310>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-158518743", "metadata": {"Type": "work"}}} {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 06 13:45:33.188228 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.network.neutron [None req-aa022931-315b-4522-9b74-89efb345ff4d tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] validate_networks() for [('f1ea0748-7e5f-4bd2-b8bf-076ecf50758f', None, None, None, None, None)] {{(pid=124367) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 06 13:45:33.189130 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-f06ad738-3b97-4e8e-982e-b42e53a0cfa8 tempest-VolumesNegativeTest-884817008 tempest-VolumesNegativeTest-884817008-project] Request method failure captured: Jul 06 13:45:33.189130 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 06 13:45:33.189130 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: Accept: application/json Jul 06 13:45:33.189130 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: Accept-Encoding: identity Jul 06 13:45:33.189130 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: Connection: close Jul 06 13:45:33.189130 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: Content-Length: 121 Jul 06 13:45:33.189130 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: Content-Type: application/json Jul 06 13:45:33.189130 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: Host: 10.222.0.20 Jul 06 13:45:33.189130 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: Openstack-System-Scope: None Jul 06 13:45:33.189130 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: User-Agent: python-urllib3/1.26.9 Jul 06 13:45:33.189130 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Auth-Token: gAAAAABixZH8_IGNKIY-6QR3QlR6xNKq2ekDmnb2Zys7e4aiuLnKje8ZHvmGDe6oeTOLZCzNoVeHI6IAWiiJ0uEb92nJBViv4P1L7vdXNYsGI1lZ02TtqKIVpIIWWf6jSmu3HxmdLn5p3xDeOkymyCOat5ktaQBIhVtNue2bqU1kxd_bIHvLtb8 Jul 06 13:45:33.189130 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Domain-Id: None Jul 06 13:45:33.189130 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Domain-Name: None Jul 06 13:45:33.189130 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Identity-Status: Confirmed Jul 06 13:45:33.189130 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Is-Admin-Project: True Jul 06 13:45:33.189130 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Project-Domain-Id: default Jul 06 13:45:33.189130 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Project-Domain-Name: Default Jul 06 13:45:33.189130 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Project-Id: eceed8c4586040e78e2514434c8451ba Jul 06 13:45:33.189130 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Project-Name: tempest-VolumesNegativeTest-884817008 Jul 06 13:45:33.189130 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Role: reader,member Jul 06 13:45:33.189130 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Roles: reader,member Jul 06 13:45:33.190230 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_eceed8c4586040e78e2514434c8451ba"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/eceed8c4586040e78e2514434c8451ba"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/eceed8c4586040e78e2514434c8451ba"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/eceed8c4586040e78e2514434c8451ba"}]}] Jul 06 13:45:33.190230 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Tenant: tempest-VolumesNegativeTest-884817008 Jul 06 13:45:33.190230 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Tenant-Id: eceed8c4586040e78e2514434c8451ba Jul 06 13:45:33.190230 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Tenant-Name: tempest-VolumesNegativeTest-884817008 Jul 06 13:45:33.190230 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-User: tempest-VolumesNegativeTest-884817008-project Jul 06 13:45:33.190230 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-User-Domain-Id: default Jul 06 13:45:33.190230 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-User-Domain-Name: Default Jul 06 13:45:33.190230 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-User-Id: 41e942a600e74f97b6b09c9202c4a636 Jul 06 13:45:33.190230 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-User-Name: tempest-VolumesNegativeTest-884817008-project Jul 06 13:45:33.190230 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: Jul 06 13:45:33.190230 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-158518743", "metadata": {"Type": "work"}}} Jul 06 13:45:33.190230 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: method: Jul 06 13:45:33.190230 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 06 13:45:33.190858 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-158518743', 'metadata': {'Type': 'work'}}}} Jul 06 13:45:33.190858 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 06 13:45:33.190858 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 06 13:45:33.190858 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 06 13:45:33.190858 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 06 13:45:33.190858 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 06 13:45:33.190858 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi raise error Jul 06 13:45:33.190858 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Jul 06 13:45:33.190858 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi Jul 06 13:45:33.190858 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jul 06 13:45:33.190858 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 06 13:45:33.190858 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi Jul 06 13:45:33.190858 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 06 13:45:33.190858 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi '#$%' Jul 06 13:45:33.190858 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi Jul 06 13:45:33.190858 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 06 13:45:33.190858 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi Jul 06 13:45:33.190858 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 06 13:45:33.190858 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 06 13:45:33.190858 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 06 13:45:33.190858 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 06 13:45:33.190858 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 06 13:45:33.191879 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 06 13:45:33.191879 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 06 13:45:33.191879 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 06 13:45:33.191879 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 06 13:45:33.191879 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 06 13:45:33.191879 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 06 13:45:33.191879 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 06 13:45:33.191879 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 06 13:45:33.191879 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 06 13:45:33.191879 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 06 13:45:33.191879 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 06 13:45:33.191879 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi Jul 06 13:45:33.191879 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 06 13:45:33.191879 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi Jul 06 13:45:33.191879 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 06 13:45:33.191879 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 06 13:45:33.191879 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 06 13:45:33.191879 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 06 13:45:33.191879 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 06 13:45:33.192750 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 06 13:45:33.192750 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi Jul 06 13:45:33.192750 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-f06ad738-3b97-4e8e-982e-b42e53a0cfa8 tempest-VolumesNegativeTest-884817008 tempest-VolumesNegativeTest-884817008-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=124368) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 06 13:45:33.192750 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-f06ad738-3b97-4e8e-982e-b42e53a0cfa8 tempest-VolumesNegativeTest-884817008 tempest-VolumesNegativeTest-884817008-project] 10.222.0.20 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.305154 Jul 06 13:45:33.192750 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 28/47] 10.222.0.20 () {60 vars in 1155 bytes} [Wed Jul 6 13:45:32 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 307 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 06 13:45:33.203993 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-85b4ca5b-c149-4f02-be31-21a3e4d3c3af tempest-VolumesNegativeTest-884817008 tempest-VolumesNegativeTest-884817008-project] Action: 'create', calling method: .version_select at 0x7ffbc61dc940>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1603025458", "metadata": {"Type": "work"}}} {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 06 13:45:33.206518 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-85b4ca5b-c149-4f02-be31-21a3e4d3c3af tempest-VolumesNegativeTest-884817008 tempest-VolumesNegativeTest-884817008-project] Request method failure captured: Jul 06 13:45:33.206518 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 06 13:45:33.206518 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: Accept: application/json Jul 06 13:45:33.206518 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: Accept-Encoding: identity Jul 06 13:45:33.206518 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: Connection: close Jul 06 13:45:33.206518 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: Content-Length: 120 Jul 06 13:45:33.206518 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: Content-Type: application/json Jul 06 13:45:33.206518 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: Host: 10.222.0.20 Jul 06 13:45:33.206518 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: Openstack-System-Scope: None Jul 06 13:45:33.206518 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: User-Agent: python-urllib3/1.26.9 Jul 06 13:45:33.206518 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Auth-Token: gAAAAABixZH8_IGNKIY-6QR3QlR6xNKq2ekDmnb2Zys7e4aiuLnKje8ZHvmGDe6oeTOLZCzNoVeHI6IAWiiJ0uEb92nJBViv4P1L7vdXNYsGI1lZ02TtqKIVpIIWWf6jSmu3HxmdLn5p3xDeOkymyCOat5ktaQBIhVtNue2bqU1kxd_bIHvLtb8 Jul 06 13:45:33.206518 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Domain-Id: None Jul 06 13:45:33.206518 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Domain-Name: None Jul 06 13:45:33.206518 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Identity-Status: Confirmed Jul 06 13:45:33.206518 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Is-Admin-Project: True Jul 06 13:45:33.206518 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Project-Domain-Id: default Jul 06 13:45:33.206518 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Project-Domain-Name: Default Jul 06 13:45:33.206518 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Project-Id: eceed8c4586040e78e2514434c8451ba Jul 06 13:45:33.206518 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Project-Name: tempest-VolumesNegativeTest-884817008 Jul 06 13:45:33.206518 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Role: reader,member Jul 06 13:45:33.206518 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Roles: reader,member Jul 06 13:45:33.207541 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_eceed8c4586040e78e2514434c8451ba"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/eceed8c4586040e78e2514434c8451ba"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/eceed8c4586040e78e2514434c8451ba"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/eceed8c4586040e78e2514434c8451ba"}]}] Jul 06 13:45:33.207541 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Tenant: tempest-VolumesNegativeTest-884817008 Jul 06 13:45:33.207541 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Tenant-Id: eceed8c4586040e78e2514434c8451ba Jul 06 13:45:33.207541 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Tenant-Name: tempest-VolumesNegativeTest-884817008 Jul 06 13:45:33.207541 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-User: tempest-VolumesNegativeTest-884817008-project Jul 06 13:45:33.207541 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-User-Domain-Id: default Jul 06 13:45:33.207541 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-User-Domain-Name: Default Jul 06 13:45:33.207541 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-User-Id: 41e942a600e74f97b6b09c9202c4a636 Jul 06 13:45:33.207541 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-User-Name: tempest-VolumesNegativeTest-884817008-project Jul 06 13:45:33.207541 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: Jul 06 13:45:33.207541 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1603025458", "metadata": {"Type": "work"}}} Jul 06 13:45:33.207541 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: method: Jul 06 13:45:33.207541 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 06 13:45:33.208154 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1603025458', 'metadata': {'Type': 'work'}}}} Jul 06 13:45:33.208154 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 06 13:45:33.208154 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 06 13:45:33.208154 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 06 13:45:33.208154 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 06 13:45:33.208154 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 06 13:45:33.208154 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi raise error Jul 06 13:45:33.208154 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Jul 06 13:45:33.208154 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi Jul 06 13:45:33.208154 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Jul 06 13:45:33.208154 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 06 13:45:33.208154 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi Jul 06 13:45:33.208154 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 06 13:45:33.208154 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi '0' Jul 06 13:45:33.208154 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi Jul 06 13:45:33.208154 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 06 13:45:33.208154 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi Jul 06 13:45:33.208154 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 06 13:45:33.208154 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 06 13:45:33.208154 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 06 13:45:33.208154 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 06 13:45:33.208154 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 06 13:45:33.209747 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 06 13:45:33.209747 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 06 13:45:33.209747 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 06 13:45:33.209747 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 06 13:45:33.209747 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 06 13:45:33.209747 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 06 13:45:33.209747 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 06 13:45:33.209747 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 06 13:45:33.209747 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 06 13:45:33.209747 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 06 13:45:33.209747 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 06 13:45:33.209747 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi Jul 06 13:45:33.209747 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 06 13:45:33.209747 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi Jul 06 13:45:33.209747 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 06 13:45:33.209747 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 06 13:45:33.209747 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 06 13:45:33.209747 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 06 13:45:33.209747 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 06 13:45:33.210667 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 06 13:45:33.210667 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi Jul 06 13:45:33.210667 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-85b4ca5b-c149-4f02-be31-21a3e4d3c3af tempest-VolumesNegativeTest-884817008 tempest-VolumesNegativeTest-884817008-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=124368) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 06 13:45:33.210667 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-85b4ca5b-c149-4f02-be31-21a3e4d3c3af tempest-VolumesNegativeTest-884817008 tempest-VolumesNegativeTest-884817008-project] 10.222.0.20 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.008608 Jul 06 13:45:33.213486 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 29/48] 10.222.0.20 () {60 vars in 1155 bytes} [Wed Jul 6 13:45:33 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 15 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 06 13:45:33.223192 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-461707d0-1b89-49f4-90d3-54dfa675de8a tempest-VolumesNegativeTest-884817008 tempest-VolumesNegativeTest-884817008-project] Action: 'create', calling method: .version_select at 0x7ffbc56e79d0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-938150666", "metadata": {"Type": "work"}}} {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 06 13:45:33.225585 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-461707d0-1b89-49f4-90d3-54dfa675de8a tempest-VolumesNegativeTest-884817008 tempest-VolumesNegativeTest-884817008-project] Request method failure captured: Jul 06 13:45:33.225585 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 06 13:45:33.225585 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: Accept: application/json Jul 06 13:45:33.225585 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: Accept-Encoding: identity Jul 06 13:45:33.225585 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: Connection: close Jul 06 13:45:33.225585 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: Content-Length: 118 Jul 06 13:45:33.225585 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: Content-Type: application/json Jul 06 13:45:33.225585 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: Host: 10.222.0.20 Jul 06 13:45:33.225585 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: Openstack-System-Scope: None Jul 06 13:45:33.225585 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: User-Agent: python-urllib3/1.26.9 Jul 06 13:45:33.225585 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Auth-Token: gAAAAABixZH8_IGNKIY-6QR3QlR6xNKq2ekDmnb2Zys7e4aiuLnKje8ZHvmGDe6oeTOLZCzNoVeHI6IAWiiJ0uEb92nJBViv4P1L7vdXNYsGI1lZ02TtqKIVpIIWWf6jSmu3HxmdLn5p3xDeOkymyCOat5ktaQBIhVtNue2bqU1kxd_bIHvLtb8 Jul 06 13:45:33.225585 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Domain-Id: None Jul 06 13:45:33.225585 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Domain-Name: None Jul 06 13:45:33.225585 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Identity-Status: Confirmed Jul 06 13:45:33.225585 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Is-Admin-Project: True Jul 06 13:45:33.225585 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Project-Domain-Id: default Jul 06 13:45:33.225585 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Project-Domain-Name: Default Jul 06 13:45:33.225585 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Project-Id: eceed8c4586040e78e2514434c8451ba Jul 06 13:45:33.225585 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Project-Name: tempest-VolumesNegativeTest-884817008 Jul 06 13:45:33.225585 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Role: reader,member Jul 06 13:45:33.225585 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Roles: reader,member Jul 06 13:45:33.226640 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_eceed8c4586040e78e2514434c8451ba"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/eceed8c4586040e78e2514434c8451ba"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/eceed8c4586040e78e2514434c8451ba"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/eceed8c4586040e78e2514434c8451ba"}]}] Jul 06 13:45:33.226640 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Tenant: tempest-VolumesNegativeTest-884817008 Jul 06 13:45:33.226640 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Tenant-Id: eceed8c4586040e78e2514434c8451ba Jul 06 13:45:33.226640 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Tenant-Name: tempest-VolumesNegativeTest-884817008 Jul 06 13:45:33.226640 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-User: tempest-VolumesNegativeTest-884817008-project Jul 06 13:45:33.226640 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-User-Domain-Id: default Jul 06 13:45:33.226640 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-User-Domain-Name: Default Jul 06 13:45:33.226640 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-User-Id: 41e942a600e74f97b6b09c9202c4a636 Jul 06 13:45:33.226640 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-User-Name: tempest-VolumesNegativeTest-884817008-project Jul 06 13:45:33.226640 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: Jul 06 13:45:33.226640 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-938150666", "metadata": {"Type": "work"}}} Jul 06 13:45:33.226640 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: method: Jul 06 13:45:33.226640 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 06 13:45:33.227513 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-938150666', 'metadata': {'Type': 'work'}}}} Jul 06 13:45:33.227513 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 06 13:45:33.227513 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 06 13:45:33.227513 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 06 13:45:33.227513 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 06 13:45:33.227513 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 06 13:45:33.227513 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi raise error Jul 06 13:45:33.227513 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Jul 06 13:45:33.227513 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi Jul 06 13:45:33.227513 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jul 06 13:45:33.227513 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 06 13:45:33.227513 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi Jul 06 13:45:33.227513 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 06 13:45:33.227513 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi '' Jul 06 13:45:33.227513 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi Jul 06 13:45:33.227513 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 06 13:45:33.227513 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi Jul 06 13:45:33.227513 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 06 13:45:33.227513 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 06 13:45:33.227513 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 06 13:45:33.227513 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 06 13:45:33.227513 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 06 13:45:33.228532 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 06 13:45:33.228532 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 06 13:45:33.228532 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 06 13:45:33.228532 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 06 13:45:33.228532 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 06 13:45:33.228532 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 06 13:45:33.228532 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 06 13:45:33.228532 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 06 13:45:33.228532 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 06 13:45:33.228532 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 06 13:45:33.228532 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 06 13:45:33.228532 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi Jul 06 13:45:33.228532 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 06 13:45:33.228532 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi Jul 06 13:45:33.228532 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 06 13:45:33.228532 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 06 13:45:33.228532 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 06 13:45:33.228532 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 06 13:45:33.228532 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 06 13:45:33.229464 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 06 13:45:33.229464 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi Jul 06 13:45:33.229464 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-461707d0-1b89-49f4-90d3-54dfa675de8a tempest-VolumesNegativeTest-884817008 tempest-VolumesNegativeTest-884817008-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=124368) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 06 13:45:33.229464 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-461707d0-1b89-49f4-90d3-54dfa675de8a tempest-VolumesNegativeTest-884817008 tempest-VolumesNegativeTest-884817008-project] 10.222.0.20 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.008110 Jul 06 13:45:33.235233 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 30/49] 10.222.0.20 () {60 vars in 1155 bytes} [Wed Jul 6 13:45:33 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 17 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jul 06 13:45:33.252036 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-6713882e-f924-41c3-8b3f-02b240207802 tempest-VolumesNegativeTest-884817008 tempest-VolumesNegativeTest-884817008-project] Calling method '.version_select at 0x7ffbc56f24c0>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:45:33.318095 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.wsgi [None req-6713882e-f924-41c3-8b3f-02b240207802 tempest-VolumesNegativeTest-884817008 tempest-VolumesNegativeTest-884817008-project] HTTP exception thrown: Volume tempest-invalid-584758452 could not be found. Jul 06 13:45:33.324005 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-6713882e-f924-41c3-8b3f-02b240207802 tempest-VolumesNegativeTest-884817008 tempest-VolumesNegativeTest-884817008-project] Request method failure captured: Jul 06 13:45:33.324005 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-584758452 HTTP/1.1 Jul 06 13:45:33.324005 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: Accept: application/json Jul 06 13:45:33.324005 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: Accept-Encoding: identity Jul 06 13:45:33.324005 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: Connection: close Jul 06 13:45:33.324005 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: Content-Length: 0 Jul 06 13:45:33.324005 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: Content-Type: application/json Jul 06 13:45:33.324005 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: Host: 10.222.0.20 Jul 06 13:45:33.324005 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: Openstack-System-Scope: None Jul 06 13:45:33.324005 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: User-Agent: python-urllib3/1.26.9 Jul 06 13:45:33.324005 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Auth-Token: gAAAAABixZH8_IGNKIY-6QR3QlR6xNKq2ekDmnb2Zys7e4aiuLnKje8ZHvmGDe6oeTOLZCzNoVeHI6IAWiiJ0uEb92nJBViv4P1L7vdXNYsGI1lZ02TtqKIVpIIWWf6jSmu3HxmdLn5p3xDeOkymyCOat5ktaQBIhVtNue2bqU1kxd_bIHvLtb8 Jul 06 13:45:33.324005 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Domain-Id: None Jul 06 13:45:33.324005 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Domain-Name: None Jul 06 13:45:33.324005 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Identity-Status: Confirmed Jul 06 13:45:33.324005 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Is-Admin-Project: True Jul 06 13:45:33.324005 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Project-Domain-Id: default Jul 06 13:45:33.324005 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Project-Domain-Name: Default Jul 06 13:45:33.324005 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Project-Id: eceed8c4586040e78e2514434c8451ba Jul 06 13:45:33.324005 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Project-Name: tempest-VolumesNegativeTest-884817008 Jul 06 13:45:33.324005 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Role: reader,member Jul 06 13:45:33.324005 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Roles: reader,member Jul 06 13:45:33.325616 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_eceed8c4586040e78e2514434c8451ba"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/eceed8c4586040e78e2514434c8451ba"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/eceed8c4586040e78e2514434c8451ba"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/eceed8c4586040e78e2514434c8451ba"}]}] Jul 06 13:45:33.325616 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Tenant: tempest-VolumesNegativeTest-884817008 Jul 06 13:45:33.325616 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Tenant-Id: eceed8c4586040e78e2514434c8451ba Jul 06 13:45:33.325616 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Tenant-Name: tempest-VolumesNegativeTest-884817008 Jul 06 13:45:33.325616 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-User: tempest-VolumesNegativeTest-884817008-project Jul 06 13:45:33.325616 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-User-Domain-Id: default Jul 06 13:45:33.325616 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-User-Domain-Name: Default Jul 06 13:45:33.325616 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-User-Id: 41e942a600e74f97b6b09c9202c4a636 Jul 06 13:45:33.325616 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-User-Name: tempest-VolumesNegativeTest-884817008-project Jul 06 13:45:33.325616 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: method: Jul 06 13:45:33.325616 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: exception: Volume tempest-invalid-584758452 could not be found. Jul 06 13:45:33.325616 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: action_args: {'id': 'tempest-invalid-584758452'} Jul 06 13:45:33.325616 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 06 13:45:33.326492 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 06 13:45:33.326492 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 06 13:45:33.326492 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 06 13:45:33.326492 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 06 13:45:33.326492 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 06 13:45:33.326492 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 06 13:45:33.326492 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 06 13:45:33.326492 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 06 13:45:33.326492 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 06 13:45:33.326492 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 06 13:45:33.326492 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 06 13:45:33.326492 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 06 13:45:33.326492 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 06 13:45:33.326492 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 06 13:45:33.326492 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 06 13:45:33.326492 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-584758452 could not be found. (HTTP 404) (Request-ID: req-1cfb6a0a-bd81-4eda-9485-937a2538611e) Jul 06 13:45:33.326492 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi Jul 06 13:45:33.326492 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 06 13:45:33.326492 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi Jul 06 13:45:33.327706 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 06 13:45:33.327706 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 06 13:45:33.327706 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 06 13:45:33.327706 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 06 13:45:33.327706 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 06 13:45:33.327706 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 06 13:45:33.327706 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 06 13:45:33.327706 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 06 13:45:33.327706 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 06 13:45:33.327706 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 06 13:45:33.327706 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 06 13:45:33.327706 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 06 13:45:33.327706 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 06 13:45:33.327706 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 06 13:45:33.327706 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 06 13:45:33.327706 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 06 13:45:33.327706 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 06 13:45:33.327706 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 06 13:45:33.327706 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 06 13:45:33.336606 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 06 13:45:33.336606 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 06 13:45:33.336606 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 06 13:45:33.336606 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 06 13:45:33.336606 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-584758452 could not be found. Jul 06 13:45:33.336606 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi Jul 06 13:45:33.336606 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 06 13:45:33.336606 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi Jul 06 13:45:33.336606 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 06 13:45:33.336606 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 06 13:45:33.336606 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 06 13:45:33.336606 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 06 13:45:33.336606 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 06 13:45:33.336606 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 06 13:45:33.336606 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 06 13:45:33.336606 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 06 13:45:33.336606 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 06 13:45:33.336606 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 06 13:45:33.336606 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 06 13:45:33.336606 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-584758452 could not be found. Jul 06 13:45:33.340681 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi Jul 06 13:45:33.340681 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 06 13:45:33.340681 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi Jul 06 13:45:33.340681 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 06 13:45:33.340681 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 06 13:45:33.340681 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 06 13:45:33.340681 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 06 13:45:33.340681 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 06 13:45:33.340681 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-584758452 could not be found. Jul 06 13:45:33.340681 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi Jul 06 13:45:33.340681 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-6713882e-f924-41c3-8b3f-02b240207802 tempest-VolumesNegativeTest-884817008 tempest-VolumesNegativeTest-884817008-project] Returning 404 to user: Volume tempest-invalid-584758452 could not be found. {{(pid=124368) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 06 13:45:33.340681 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-6713882e-f924-41c3-8b3f-02b240207802 tempest-VolumesNegativeTest-884817008 tempest-VolumesNegativeTest-884817008-project] 10.222.0.20 "DELETE /compute/v2.1/os-volumes/tempest-invalid-584758452" status: 404 len: 98 microversion: 2.1 time: 0.089175 Jul 06 13:45:33.340681 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 31/50] 10.222.0.20 () {58 vars in 1214 bytes} [Wed Jul 6 13:45:33 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-584758452 => generated 98 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 06 13:45:33.349507 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-62454d9c-67d3-4dc2-a345-2ef16d6b358c tempest-VolumesNegativeTest-884817008 tempest-VolumesNegativeTest-884817008-project] 10.222.0.20 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.009972 Jul 06 13:45:33.351690 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 32/51] 10.222.0.20 () {58 vars in 1139 bytes} [Wed Jul 6 13:45:33 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 16 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jul 06 13:45:33.370283 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-63e87375-9a8c-43e7-8b50-586859fd338a tempest-VolumesNegativeTest-884817008 tempest-VolumesNegativeTest-884817008-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.010616 Jul 06 13:45:33.374908 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 33/52] 10.222.0.20 () {58 vars in 1136 bytes} [Wed Jul 6 13:45:33 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 17 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jul 06 13:45:33.404395 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-d5a74b68-c4a0-4ff7-9862-613e1c5b52e7 tempest-VolumesNegativeTest-884817008 tempest-VolumesNegativeTest-884817008-project] Calling method '.version_select at 0x7ffbc56f2280>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:45:33.480552 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.wsgi [None req-d5a74b68-c4a0-4ff7-9862-613e1c5b52e7 tempest-VolumesNegativeTest-884817008 tempest-VolumesNegativeTest-884817008-project] HTTP exception thrown: Volume 6befc95f-4a4c-4a2f-95f4-7b37be551224 could not be found. Jul 06 13:45:33.483685 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-d5a74b68-c4a0-4ff7-9862-613e1c5b52e7 tempest-VolumesNegativeTest-884817008 tempest-VolumesNegativeTest-884817008-project] Request method failure captured: Jul 06 13:45:33.483685 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: request: DELETE /compute/v2.1/os-volumes/6befc95f-4a4c-4a2f-95f4-7b37be551224 HTTP/1.1 Jul 06 13:45:33.483685 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: Accept: application/json Jul 06 13:45:33.483685 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: Accept-Encoding: identity Jul 06 13:45:33.483685 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: Connection: close Jul 06 13:45:33.483685 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: Content-Length: 0 Jul 06 13:45:33.483685 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: Content-Type: application/json Jul 06 13:45:33.483685 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: Host: 10.222.0.20 Jul 06 13:45:33.483685 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: Openstack-System-Scope: None Jul 06 13:45:33.483685 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: User-Agent: python-urllib3/1.26.9 Jul 06 13:45:33.483685 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Auth-Token: gAAAAABixZH8_IGNKIY-6QR3QlR6xNKq2ekDmnb2Zys7e4aiuLnKje8ZHvmGDe6oeTOLZCzNoVeHI6IAWiiJ0uEb92nJBViv4P1L7vdXNYsGI1lZ02TtqKIVpIIWWf6jSmu3HxmdLn5p3xDeOkymyCOat5ktaQBIhVtNue2bqU1kxd_bIHvLtb8 Jul 06 13:45:33.483685 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Domain-Id: None Jul 06 13:45:33.483685 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Domain-Name: None Jul 06 13:45:33.483685 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Identity-Status: Confirmed Jul 06 13:45:33.483685 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Is-Admin-Project: True Jul 06 13:45:33.483685 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Project-Domain-Id: default Jul 06 13:45:33.483685 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Project-Domain-Name: Default Jul 06 13:45:33.483685 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Project-Id: eceed8c4586040e78e2514434c8451ba Jul 06 13:45:33.483685 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Project-Name: tempest-VolumesNegativeTest-884817008 Jul 06 13:45:33.483685 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Role: reader,member Jul 06 13:45:33.483685 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Roles: reader,member Jul 06 13:45:33.484984 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_eceed8c4586040e78e2514434c8451ba"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/eceed8c4586040e78e2514434c8451ba"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/eceed8c4586040e78e2514434c8451ba"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/eceed8c4586040e78e2514434c8451ba"}]}] Jul 06 13:45:33.484984 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Tenant: tempest-VolumesNegativeTest-884817008 Jul 06 13:45:33.484984 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Tenant-Id: eceed8c4586040e78e2514434c8451ba Jul 06 13:45:33.484984 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Tenant-Name: tempest-VolumesNegativeTest-884817008 Jul 06 13:45:33.484984 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-User: tempest-VolumesNegativeTest-884817008-project Jul 06 13:45:33.484984 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-User-Domain-Id: default Jul 06 13:45:33.484984 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-User-Domain-Name: Default Jul 06 13:45:33.484984 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-User-Id: 41e942a600e74f97b6b09c9202c4a636 Jul 06 13:45:33.484984 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-User-Name: tempest-VolumesNegativeTest-884817008-project Jul 06 13:45:33.484984 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: method: Jul 06 13:45:33.484984 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: exception: Volume 6befc95f-4a4c-4a2f-95f4-7b37be551224 could not be found. Jul 06 13:45:33.484984 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: action_args: {'id': '6befc95f-4a4c-4a2f-95f4-7b37be551224'} Jul 06 13:45:33.484984 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 06 13:45:33.491728 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 06 13:45:33.491728 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 06 13:45:33.491728 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 06 13:45:33.491728 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 06 13:45:33.491728 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 06 13:45:33.491728 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 06 13:45:33.491728 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 06 13:45:33.491728 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 06 13:45:33.491728 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 06 13:45:33.491728 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 06 13:45:33.491728 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 06 13:45:33.491728 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 06 13:45:33.491728 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 06 13:45:33.491728 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 06 13:45:33.491728 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 06 13:45:33.491728 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 6befc95f-4a4c-4a2f-95f4-7b37be551224 could not be found. (HTTP 404) (Request-ID: req-50cba7ee-9b43-4e45-8ab7-259507f9bc55) Jul 06 13:45:33.491728 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi Jul 06 13:45:33.491728 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 06 13:45:33.491728 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi Jul 06 13:45:33.493636 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 06 13:45:33.493636 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 06 13:45:33.493636 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 06 13:45:33.493636 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 06 13:45:33.493636 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 06 13:45:33.493636 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 06 13:45:33.493636 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 06 13:45:33.493636 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 06 13:45:33.493636 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 06 13:45:33.493636 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 06 13:45:33.493636 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 06 13:45:33.493636 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 06 13:45:33.493636 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 06 13:45:33.493636 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 06 13:45:33.493636 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 06 13:45:33.493636 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 06 13:45:33.493636 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 06 13:45:33.493636 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 06 13:45:33.493636 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 06 13:45:33.494731 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 06 13:45:33.494731 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 06 13:45:33.494731 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 06 13:45:33.494731 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 06 13:45:33.494731 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 6befc95f-4a4c-4a2f-95f4-7b37be551224 could not be found. Jul 06 13:45:33.494731 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi Jul 06 13:45:33.494731 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 06 13:45:33.494731 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi Jul 06 13:45:33.494731 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 06 13:45:33.494731 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 06 13:45:33.494731 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 06 13:45:33.494731 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 06 13:45:33.494731 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 06 13:45:33.494731 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 06 13:45:33.494731 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 06 13:45:33.494731 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 06 13:45:33.494731 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 06 13:45:33.494731 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 06 13:45:33.494731 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 06 13:45:33.495754 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 6befc95f-4a4c-4a2f-95f4-7b37be551224 could not be found. Jul 06 13:45:33.495754 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi Jul 06 13:45:33.495754 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 06 13:45:33.495754 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi Jul 06 13:45:33.495754 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 06 13:45:33.495754 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 06 13:45:33.495754 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 06 13:45:33.495754 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 06 13:45:33.495754 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 06 13:45:33.495754 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 6befc95f-4a4c-4a2f-95f4-7b37be551224 could not be found. Jul 06 13:45:33.495754 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi Jul 06 13:45:33.495754 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-d5a74b68-c4a0-4ff7-9862-613e1c5b52e7 tempest-VolumesNegativeTest-884817008 tempest-VolumesNegativeTest-884817008-project] Returning 404 to user: Volume 6befc95f-4a4c-4a2f-95f4-7b37be551224 could not be found. {{(pid=124368) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 06 13:45:33.495754 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-d5a74b68-c4a0-4ff7-9862-613e1c5b52e7 tempest-VolumesNegativeTest-884817008 tempest-VolumesNegativeTest-884817008-project] 10.222.0.20 "DELETE /compute/v2.1/os-volumes/6befc95f-4a4c-4a2f-95f4-7b37be551224" status: 404 len: 109 microversion: 2.1 time: 0.094110 Jul 06 13:45:33.495754 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 34/53] 10.222.0.20 () {58 vars in 1247 bytes} [Wed Jul 6 13:45:33 2022] DELETE /compute/v2.1/os-volumes/6befc95f-4a4c-4a2f-95f4-7b37be551224 => generated 109 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 06 13:45:33.497663 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-12419157-4b2e-4ed7-bdb5-7fe516937849 tempest-VolumesNegativeTest-884817008 tempest-VolumesNegativeTest-884817008-project] Calling method '.version_select at 0x7ffbc56f2430>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:45:33.585516 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.wsgi [None req-12419157-4b2e-4ed7-bdb5-7fe516937849 tempest-VolumesNegativeTest-884817008 tempest-VolumesNegativeTest-884817008-project] HTTP exception thrown: Volume ca4c2b15-882e-4eea-b74d-573a25b39c3c could not be found. Jul 06 13:45:33.588370 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-12419157-4b2e-4ed7-bdb5-7fe516937849 tempest-VolumesNegativeTest-884817008 tempest-VolumesNegativeTest-884817008-project] Request method failure captured: Jul 06 13:45:33.588370 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: request: GET /compute/v2.1/os-volumes/ca4c2b15-882e-4eea-b74d-573a25b39c3c HTTP/1.1 Jul 06 13:45:33.588370 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: Accept: application/json Jul 06 13:45:33.588370 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: Accept-Encoding: identity Jul 06 13:45:33.588370 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: Connection: close Jul 06 13:45:33.588370 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: Content-Length: 0 Jul 06 13:45:33.588370 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: Content-Type: application/json Jul 06 13:45:33.588370 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: Host: 10.222.0.20 Jul 06 13:45:33.588370 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: Openstack-System-Scope: None Jul 06 13:45:33.588370 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: User-Agent: python-urllib3/1.26.9 Jul 06 13:45:33.588370 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Auth-Token: gAAAAABixZH8_IGNKIY-6QR3QlR6xNKq2ekDmnb2Zys7e4aiuLnKje8ZHvmGDe6oeTOLZCzNoVeHI6IAWiiJ0uEb92nJBViv4P1L7vdXNYsGI1lZ02TtqKIVpIIWWf6jSmu3HxmdLn5p3xDeOkymyCOat5ktaQBIhVtNue2bqU1kxd_bIHvLtb8 Jul 06 13:45:33.588370 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Domain-Id: None Jul 06 13:45:33.588370 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Domain-Name: None Jul 06 13:45:33.588370 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Identity-Status: Confirmed Jul 06 13:45:33.588370 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Is-Admin-Project: True Jul 06 13:45:33.588370 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Project-Domain-Id: default Jul 06 13:45:33.588370 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Project-Domain-Name: Default Jul 06 13:45:33.588370 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Project-Id: eceed8c4586040e78e2514434c8451ba Jul 06 13:45:33.588370 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Project-Name: tempest-VolumesNegativeTest-884817008 Jul 06 13:45:33.588370 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Role: reader,member Jul 06 13:45:33.588370 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Roles: reader,member Jul 06 13:45:33.589599 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_eceed8c4586040e78e2514434c8451ba"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/eceed8c4586040e78e2514434c8451ba"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/eceed8c4586040e78e2514434c8451ba"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/eceed8c4586040e78e2514434c8451ba"}]}] Jul 06 13:45:33.589599 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Tenant: tempest-VolumesNegativeTest-884817008 Jul 06 13:45:33.589599 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Tenant-Id: eceed8c4586040e78e2514434c8451ba Jul 06 13:45:33.589599 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Tenant-Name: tempest-VolumesNegativeTest-884817008 Jul 06 13:45:33.589599 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-User: tempest-VolumesNegativeTest-884817008-project Jul 06 13:45:33.589599 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-User-Domain-Id: default Jul 06 13:45:33.589599 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-User-Domain-Name: Default Jul 06 13:45:33.589599 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-User-Id: 41e942a600e74f97b6b09c9202c4a636 Jul 06 13:45:33.589599 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-User-Name: tempest-VolumesNegativeTest-884817008-project Jul 06 13:45:33.589599 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: method: Jul 06 13:45:33.589599 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: exception: Volume ca4c2b15-882e-4eea-b74d-573a25b39c3c could not be found. Jul 06 13:45:33.589599 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: action_args: {'id': 'ca4c2b15-882e-4eea-b74d-573a25b39c3c'} Jul 06 13:45:33.589599 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 06 13:45:33.590322 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 06 13:45:33.590322 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 06 13:45:33.590322 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 06 13:45:33.590322 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 06 13:45:33.590322 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 06 13:45:33.590322 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 06 13:45:33.590322 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 06 13:45:33.590322 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 06 13:45:33.590322 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 06 13:45:33.590322 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 06 13:45:33.590322 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 06 13:45:33.590322 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 06 13:45:33.590322 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 06 13:45:33.590322 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 06 13:45:33.590322 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 06 13:45:33.590322 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume ca4c2b15-882e-4eea-b74d-573a25b39c3c could not be found. (HTTP 404) (Request-ID: req-46672f46-1057-4296-b45a-b719762e5ac2) Jul 06 13:45:33.590322 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi Jul 06 13:45:33.590322 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 06 13:45:33.590322 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi Jul 06 13:45:33.600609 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 06 13:45:33.600609 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 06 13:45:33.600609 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 06 13:45:33.600609 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 06 13:45:33.600609 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 06 13:45:33.600609 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 06 13:45:33.600609 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 06 13:45:33.600609 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 06 13:45:33.600609 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 06 13:45:33.600609 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 06 13:45:33.600609 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 06 13:45:33.600609 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 06 13:45:33.600609 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 06 13:45:33.600609 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 06 13:45:33.600609 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 06 13:45:33.600609 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 06 13:45:33.600609 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 06 13:45:33.600609 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 06 13:45:33.600609 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 06 13:45:33.601707 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 06 13:45:33.601707 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 06 13:45:33.601707 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 06 13:45:33.601707 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 06 13:45:33.601707 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume ca4c2b15-882e-4eea-b74d-573a25b39c3c could not be found. Jul 06 13:45:33.601707 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi Jul 06 13:45:33.601707 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 06 13:45:33.601707 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi Jul 06 13:45:33.601707 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 06 13:45:33.601707 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 06 13:45:33.601707 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 06 13:45:33.601707 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 06 13:45:33.601707 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 06 13:45:33.601707 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 06 13:45:33.601707 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 06 13:45:33.601707 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 06 13:45:33.601707 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 06 13:45:33.601707 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 06 13:45:33.601707 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 06 13:45:33.604241 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume ca4c2b15-882e-4eea-b74d-573a25b39c3c could not be found. Jul 06 13:45:33.604241 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi Jul 06 13:45:33.604241 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 06 13:45:33.604241 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi Jul 06 13:45:33.604241 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 06 13:45:33.604241 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 06 13:45:33.604241 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 06 13:45:33.604241 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 06 13:45:33.604241 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 06 13:45:33.604241 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume ca4c2b15-882e-4eea-b74d-573a25b39c3c could not be found. Jul 06 13:45:33.604241 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi Jul 06 13:45:33.604241 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-12419157-4b2e-4ed7-bdb5-7fe516937849 tempest-VolumesNegativeTest-884817008 tempest-VolumesNegativeTest-884817008-project] Returning 404 to user: Volume ca4c2b15-882e-4eea-b74d-573a25b39c3c could not be found. {{(pid=124368) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 06 13:45:33.604241 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-12419157-4b2e-4ed7-bdb5-7fe516937849 tempest-VolumesNegativeTest-884817008 tempest-VolumesNegativeTest-884817008-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/ca4c2b15-882e-4eea-b74d-573a25b39c3c" status: 404 len: 109 microversion: 2.1 time: 0.096876 Jul 06 13:45:33.604241 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 35/54] 10.222.0.20 () {58 vars in 1244 bytes} [Wed Jul 6 13:45:33 2022] GET /compute/v2.1/os-volumes/ca4c2b15-882e-4eea-b74d-573a25b39c3c => generated 109 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 06 13:45:33.650799 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-701ccc5a-5cc1-4a08-a415-16f3e36e6c3e tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] Calling method '>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:45:33.651560 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-701ccc5a-5cc1-4a08-a415-16f3e36e6c3e tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] [instance: 965c7a0f-fa3f-4f5c-92bf-94d8b646a9ae] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:45:33.674379 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-701ccc5a-5cc1-4a08-a415-16f3e36e6c3e tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:45:33.677690 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-701ccc5a-5cc1-4a08-a415-16f3e36e6c3e tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:45:33.681909 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-701ccc5a-5cc1-4a08-a415-16f3e36e6c3e tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:45:33.686308 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-701ccc5a-5cc1-4a08-a415-16f3e36e6c3e tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:45:34.023257 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-701ccc5a-5cc1-4a08-a415-16f3e36e6c3e tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad0781ce20e54c3a9b7c61e0cccf6918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd48e24dbeaa241d7a97350fb2c8187b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:45:34.035633 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-701ccc5a-5cc1-4a08-a415-16f3e36e6c3e tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] 10.222.0.20 "GET /compute/v2.1/servers/965c7a0f-fa3f-4f5c-92bf-94d8b646a9ae" status: 200 len: 1266 microversion: 2.1 time: 0.389904 Jul 06 13:45:34.048906 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 36/55] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:45:33 2022] GET /compute/v2.1/servers/965c7a0f-fa3f-4f5c-92bf-94d8b646a9ae => generated 1266 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:45:34.056418 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-98b20d03-00f9-478f-b76a-97ede7d8ff00 tempest-VolumesSnapshotsTestJSON-1217350311 tempest-VolumesSnapshotsTestJSON-1217350311-project] Calling method '.version_select at 0x7ffbc56e31f0>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:45:34.123819 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.wsgi [None req-98b20d03-00f9-478f-b76a-97ede7d8ff00 tempest-VolumesSnapshotsTestJSON-1217350311 tempest-VolumesSnapshotsTestJSON-1217350311-project] HTTP exception thrown: Volume 07ab59c4-ff68-4c97-adff-f5818fef19ac could not be found. Jul 06 13:45:34.127157 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-98b20d03-00f9-478f-b76a-97ede7d8ff00 tempest-VolumesSnapshotsTestJSON-1217350311 tempest-VolumesSnapshotsTestJSON-1217350311-project] Request method failure captured: Jul 06 13:45:34.127157 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: request: GET /compute/v2.1/os-volumes/07ab59c4-ff68-4c97-adff-f5818fef19ac HTTP/1.1 Jul 06 13:45:34.127157 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: Accept: application/json Jul 06 13:45:34.127157 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: Accept-Encoding: identity Jul 06 13:45:34.127157 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: Connection: close Jul 06 13:45:34.127157 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: Content-Length: 0 Jul 06 13:45:34.127157 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: Content-Type: application/json Jul 06 13:45:34.127157 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: Host: 10.222.0.20 Jul 06 13:45:34.127157 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: Openstack-System-Scope: None Jul 06 13:45:34.127157 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: User-Agent: python-urllib3/1.26.9 Jul 06 13:45:34.127157 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Auth-Token: gAAAAABixZHrMHNt0AiiTsOy0q2XvA-FiUwaejsD4BYGpzsq2drs5v3lS0hBc-zoyqCkFWVVj-shQxMIvBKxs74sPAVJLGAh2Nnk4QLlejMJBMkZnaIsdVmkNfMxpRykFKBErNIy6RblQu64ulILd8xtKuriML8DI1JQPieUIfAkEsJqHvzeXo0 Jul 06 13:45:34.127157 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Domain-Id: None Jul 06 13:45:34.127157 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Domain-Name: None Jul 06 13:45:34.127157 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Identity-Status: Confirmed Jul 06 13:45:34.127157 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Is-Admin-Project: True Jul 06 13:45:34.127157 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Project-Domain-Id: default Jul 06 13:45:34.127157 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Project-Domain-Name: Default Jul 06 13:45:34.127157 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Project-Id: 5080a0e6cfb24d799c3b31cec1d073bc Jul 06 13:45:34.127157 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1217350311 Jul 06 13:45:34.127157 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Role: reader,member Jul 06 13:45:34.127157 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Roles: reader,member Jul 06 13:45:34.128454 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_5080a0e6cfb24d799c3b31cec1d073bc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/5080a0e6cfb24d799c3b31cec1d073bc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/5080a0e6cfb24d799c3b31cec1d073bc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/5080a0e6cfb24d799c3b31cec1d073bc"}]}] Jul 06 13:45:34.128454 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1217350311 Jul 06 13:45:34.128454 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Tenant-Id: 5080a0e6cfb24d799c3b31cec1d073bc Jul 06 13:45:34.128454 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1217350311 Jul 06 13:45:34.128454 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-User: tempest-VolumesSnapshotsTestJSON-1217350311-project Jul 06 13:45:34.128454 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-User-Domain-Id: default Jul 06 13:45:34.128454 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-User-Domain-Name: Default Jul 06 13:45:34.128454 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-User-Id: ae1587d0dc6246f9997824193eef6d78 Jul 06 13:45:34.128454 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1217350311-project Jul 06 13:45:34.128454 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: method: Jul 06 13:45:34.128454 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: exception: Volume 07ab59c4-ff68-4c97-adff-f5818fef19ac could not be found. Jul 06 13:45:34.128454 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: action_args: {'id': '07ab59c4-ff68-4c97-adff-f5818fef19ac'} Jul 06 13:45:34.128454 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 06 13:45:34.129340 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 06 13:45:34.129340 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 06 13:45:34.129340 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 06 13:45:34.129340 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 06 13:45:34.129340 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 06 13:45:34.129340 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 06 13:45:34.129340 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 06 13:45:34.129340 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 06 13:45:34.129340 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 06 13:45:34.129340 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 06 13:45:34.129340 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 06 13:45:34.129340 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 06 13:45:34.129340 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 06 13:45:34.129340 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 06 13:45:34.129340 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 06 13:45:34.129340 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 07ab59c4-ff68-4c97-adff-f5818fef19ac could not be found. (HTTP 404) (Request-ID: req-c12a6e13-12a8-496f-bd60-205e5c7bfd9d) Jul 06 13:45:34.129340 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi Jul 06 13:45:34.129340 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 06 13:45:34.129340 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi Jul 06 13:45:34.130390 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 06 13:45:34.130390 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 06 13:45:34.130390 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 06 13:45:34.130390 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 06 13:45:34.130390 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 06 13:45:34.130390 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 06 13:45:34.130390 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 06 13:45:34.130390 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 06 13:45:34.130390 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 06 13:45:34.130390 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 06 13:45:34.130390 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 06 13:45:34.130390 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 06 13:45:34.130390 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 06 13:45:34.130390 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 06 13:45:34.130390 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 06 13:45:34.130390 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 06 13:45:34.130390 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 06 13:45:34.130390 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 06 13:45:34.130390 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 06 13:45:34.131462 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 06 13:45:34.131462 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 06 13:45:34.131462 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 06 13:45:34.131462 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 06 13:45:34.131462 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 07ab59c4-ff68-4c97-adff-f5818fef19ac could not be found. Jul 06 13:45:34.131462 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi Jul 06 13:45:34.131462 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 06 13:45:34.131462 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi Jul 06 13:45:34.131462 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 06 13:45:34.131462 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 06 13:45:34.131462 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 06 13:45:34.131462 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 06 13:45:34.131462 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 06 13:45:34.131462 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 06 13:45:34.131462 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 06 13:45:34.131462 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 06 13:45:34.131462 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 06 13:45:34.131462 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 06 13:45:34.131462 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 06 13:45:34.132512 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 07ab59c4-ff68-4c97-adff-f5818fef19ac could not be found. Jul 06 13:45:34.132512 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi Jul 06 13:45:34.132512 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 06 13:45:34.132512 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi Jul 06 13:45:34.132512 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 06 13:45:34.132512 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 06 13:45:34.132512 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 06 13:45:34.132512 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 06 13:45:34.132512 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 06 13:45:34.132512 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 07ab59c4-ff68-4c97-adff-f5818fef19ac could not be found. Jul 06 13:45:34.132512 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi Jul 06 13:45:34.134951 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-98b20d03-00f9-478f-b76a-97ede7d8ff00 tempest-VolumesSnapshotsTestJSON-1217350311 tempest-VolumesSnapshotsTestJSON-1217350311-project] Returning 404 to user: Volume 07ab59c4-ff68-4c97-adff-f5818fef19ac could not be found. {{(pid=124368) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 06 13:45:34.136713 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-98b20d03-00f9-478f-b76a-97ede7d8ff00 tempest-VolumesSnapshotsTestJSON-1217350311 tempest-VolumesSnapshotsTestJSON-1217350311-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/07ab59c4-ff68-4c97-adff-f5818fef19ac" status: 404 len: 109 microversion: 2.1 time: 0.085367 Jul 06 13:45:34.138312 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 37/56] 10.222.0.20 () {58 vars in 1244 bytes} [Wed Jul 6 13:45:34 2022] GET /compute/v2.1/os-volumes/07ab59c4-ff68-4c97-adff-f5818fef19ac => generated 109 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 06 13:45:34.153752 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-8daaded5-d345-4f55-9f4b-f71ee8e9c824 tempest-VolumesSnapshotsTestJSON-1217350311 tempest-VolumesSnapshotsTestJSON-1217350311-project] Calling method '.version_select at 0x7ffbc56e3b80>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:45:34.366527 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.wsgi [None req-8daaded5-d345-4f55-9f4b-f71ee8e9c824 tempest-VolumesSnapshotsTestJSON-1217350311 tempest-VolumesSnapshotsTestJSON-1217350311-project] HTTP exception thrown: Volume 07ab59c4-ff68-4c97-adff-f5818fef19ac could not be found. Jul 06 13:45:34.369207 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-8daaded5-d345-4f55-9f4b-f71ee8e9c824 tempest-VolumesSnapshotsTestJSON-1217350311 tempest-VolumesSnapshotsTestJSON-1217350311-project] Request method failure captured: Jul 06 13:45:34.369207 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: request: DELETE /compute/v2.1/os-volumes/07ab59c4-ff68-4c97-adff-f5818fef19ac HTTP/1.1 Jul 06 13:45:34.369207 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: Accept: application/json Jul 06 13:45:34.369207 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: Accept-Encoding: identity Jul 06 13:45:34.369207 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: Connection: close Jul 06 13:45:34.369207 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: Content-Length: 0 Jul 06 13:45:34.369207 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: Content-Type: application/json Jul 06 13:45:34.369207 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: Host: 10.222.0.20 Jul 06 13:45:34.369207 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: Openstack-System-Scope: None Jul 06 13:45:34.369207 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: User-Agent: python-urllib3/1.26.9 Jul 06 13:45:34.369207 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Auth-Token: gAAAAABixZHrMHNt0AiiTsOy0q2XvA-FiUwaejsD4BYGpzsq2drs5v3lS0hBc-zoyqCkFWVVj-shQxMIvBKxs74sPAVJLGAh2Nnk4QLlejMJBMkZnaIsdVmkNfMxpRykFKBErNIy6RblQu64ulILd8xtKuriML8DI1JQPieUIfAkEsJqHvzeXo0 Jul 06 13:45:34.369207 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Domain-Id: None Jul 06 13:45:34.369207 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Domain-Name: None Jul 06 13:45:34.369207 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Identity-Status: Confirmed Jul 06 13:45:34.369207 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Is-Admin-Project: True Jul 06 13:45:34.369207 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Project-Domain-Id: default Jul 06 13:45:34.369207 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Project-Domain-Name: Default Jul 06 13:45:34.369207 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Project-Id: 5080a0e6cfb24d799c3b31cec1d073bc Jul 06 13:45:34.369207 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1217350311 Jul 06 13:45:34.369207 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Role: reader,member Jul 06 13:45:34.369207 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Roles: reader,member Jul 06 13:45:34.370377 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_5080a0e6cfb24d799c3b31cec1d073bc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/5080a0e6cfb24d799c3b31cec1d073bc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/5080a0e6cfb24d799c3b31cec1d073bc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/5080a0e6cfb24d799c3b31cec1d073bc"}]}] Jul 06 13:45:34.370377 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1217350311 Jul 06 13:45:34.370377 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Tenant-Id: 5080a0e6cfb24d799c3b31cec1d073bc Jul 06 13:45:34.370377 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1217350311 Jul 06 13:45:34.370377 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-User: tempest-VolumesSnapshotsTestJSON-1217350311-project Jul 06 13:45:34.370377 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-User-Domain-Id: default Jul 06 13:45:34.370377 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-User-Domain-Name: Default Jul 06 13:45:34.370377 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-User-Id: ae1587d0dc6246f9997824193eef6d78 Jul 06 13:45:34.370377 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1217350311-project Jul 06 13:45:34.370377 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: method: Jul 06 13:45:34.370377 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: exception: Volume 07ab59c4-ff68-4c97-adff-f5818fef19ac could not be found. Jul 06 13:45:34.370377 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: action_args: {'id': '07ab59c4-ff68-4c97-adff-f5818fef19ac'} Jul 06 13:45:34.370377 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 06 13:45:34.371142 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 06 13:45:34.371142 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 06 13:45:34.371142 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 06 13:45:34.371142 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 06 13:45:34.371142 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 06 13:45:34.371142 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 06 13:45:34.371142 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 06 13:45:34.371142 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 06 13:45:34.371142 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 06 13:45:34.371142 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 06 13:45:34.371142 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 06 13:45:34.371142 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 06 13:45:34.371142 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 06 13:45:34.371142 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 06 13:45:34.371142 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 06 13:45:34.371142 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 07ab59c4-ff68-4c97-adff-f5818fef19ac could not be found. (HTTP 404) (Request-ID: req-aeeec312-e320-4613-8b84-351ce4715253) Jul 06 13:45:34.371142 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi Jul 06 13:45:34.371142 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 06 13:45:34.371142 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi Jul 06 13:45:34.372145 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 06 13:45:34.372145 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 06 13:45:34.372145 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 06 13:45:34.372145 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 06 13:45:34.372145 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 06 13:45:34.372145 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 06 13:45:34.372145 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 06 13:45:34.372145 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 06 13:45:34.372145 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 06 13:45:34.372145 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 06 13:45:34.372145 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 06 13:45:34.372145 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 06 13:45:34.372145 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 06 13:45:34.372145 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 06 13:45:34.372145 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 06 13:45:34.372145 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 06 13:45:34.372145 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 06 13:45:34.372145 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 06 13:45:34.372145 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 06 13:45:34.375355 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 06 13:45:34.375355 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 06 13:45:34.375355 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 06 13:45:34.375355 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 06 13:45:34.375355 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 07ab59c4-ff68-4c97-adff-f5818fef19ac could not be found. Jul 06 13:45:34.375355 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi Jul 06 13:45:34.375355 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 06 13:45:34.375355 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi Jul 06 13:45:34.375355 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 06 13:45:34.375355 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 06 13:45:34.375355 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 06 13:45:34.375355 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 06 13:45:34.375355 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 06 13:45:34.375355 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 06 13:45:34.375355 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 06 13:45:34.375355 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 06 13:45:34.375355 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 06 13:45:34.375355 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 06 13:45:34.375355 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 06 13:45:34.376370 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 07ab59c4-ff68-4c97-adff-f5818fef19ac could not be found. Jul 06 13:45:34.376370 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi Jul 06 13:45:34.376370 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 06 13:45:34.376370 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi Jul 06 13:45:34.376370 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 06 13:45:34.376370 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 06 13:45:34.376370 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 06 13:45:34.376370 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 06 13:45:34.376370 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 06 13:45:34.376370 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 07ab59c4-ff68-4c97-adff-f5818fef19ac could not be found. Jul 06 13:45:34.376370 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi Jul 06 13:45:34.376370 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-8daaded5-d345-4f55-9f4b-f71ee8e9c824 tempest-VolumesSnapshotsTestJSON-1217350311 tempest-VolumesSnapshotsTestJSON-1217350311-project] Returning 404 to user: Volume 07ab59c4-ff68-4c97-adff-f5818fef19ac could not be found. {{(pid=124368) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 06 13:45:34.376370 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-8daaded5-d345-4f55-9f4b-f71ee8e9c824 tempest-VolumesSnapshotsTestJSON-1217350311 tempest-VolumesSnapshotsTestJSON-1217350311-project] 10.222.0.20 "DELETE /compute/v2.1/os-volumes/07ab59c4-ff68-4c97-adff-f5818fef19ac" status: 404 len: 109 microversion: 2.1 time: 0.222568 Jul 06 13:45:34.376370 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 38/57] 10.222.0.20 () {58 vars in 1247 bytes} [Wed Jul 6 13:45:34 2022] DELETE /compute/v2.1/os-volumes/07ab59c4-ff68-4c97-adff-f5818fef19ac => generated 109 bytes in 224 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 06 13:45:34.391407 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-f6baf761-70c3-430e-bd88-70bb9d613136 tempest-VolumesTestJSON-1577662730 tempest-VolumesTestJSON-1577662730-project] Calling method '.version_select at 0x7ffbc56ae9d0>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:45:34.585564 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-f6baf761-70c3-430e-bd88-70bb9d613136 tempest-VolumesTestJSON-1577662730 tempest-VolumesTestJSON-1577662730-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/7ca9190e-8427-481d-9440-55016b23fb28" status: 200 len: 350 microversion: 2.1 time: 0.212895 Jul 06 13:45:34.586778 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 39/58] 10.222.0.20 () {58 vars in 1244 bytes} [Wed Jul 6 13:45:34 2022] GET /compute/v2.1/os-volumes/7ca9190e-8427-481d-9440-55016b23fb28 => generated 350 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 06 13:45:34.609678 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-5b72e62e-d204-4638-af6c-661b877fedf6 tempest-VolumesSnapshotsTestJSON-1217350311 tempest-VolumesSnapshotsTestJSON-1217350311-project] Calling method '.version_select at 0x7ffbc56e3ee0>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:45:34.704412 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.wsgi [None req-5b72e62e-d204-4638-af6c-661b877fedf6 tempest-VolumesSnapshotsTestJSON-1217350311 tempest-VolumesSnapshotsTestJSON-1217350311-project] HTTP exception thrown: Volume 07ab59c4-ff68-4c97-adff-f5818fef19ac could not be found. Jul 06 13:45:34.707046 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-5b72e62e-d204-4638-af6c-661b877fedf6 tempest-VolumesSnapshotsTestJSON-1217350311 tempest-VolumesSnapshotsTestJSON-1217350311-project] Request method failure captured: Jul 06 13:45:34.707046 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: request: GET /compute/v2.1/os-volumes/07ab59c4-ff68-4c97-adff-f5818fef19ac HTTP/1.1 Jul 06 13:45:34.707046 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: Accept: application/json Jul 06 13:45:34.707046 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: Accept-Encoding: identity Jul 06 13:45:34.707046 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: Connection: close Jul 06 13:45:34.707046 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: Content-Length: 0 Jul 06 13:45:34.707046 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: Content-Type: application/json Jul 06 13:45:34.707046 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: Host: 10.222.0.20 Jul 06 13:45:34.707046 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: Openstack-System-Scope: None Jul 06 13:45:34.707046 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: User-Agent: python-urllib3/1.26.9 Jul 06 13:45:34.707046 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Auth-Token: gAAAAABixZHrMHNt0AiiTsOy0q2XvA-FiUwaejsD4BYGpzsq2drs5v3lS0hBc-zoyqCkFWVVj-shQxMIvBKxs74sPAVJLGAh2Nnk4QLlejMJBMkZnaIsdVmkNfMxpRykFKBErNIy6RblQu64ulILd8xtKuriML8DI1JQPieUIfAkEsJqHvzeXo0 Jul 06 13:45:34.707046 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Domain-Id: None Jul 06 13:45:34.707046 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Domain-Name: None Jul 06 13:45:34.707046 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Identity-Status: Confirmed Jul 06 13:45:34.707046 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Is-Admin-Project: True Jul 06 13:45:34.707046 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Project-Domain-Id: default Jul 06 13:45:34.707046 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Project-Domain-Name: Default Jul 06 13:45:34.707046 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Project-Id: 5080a0e6cfb24d799c3b31cec1d073bc Jul 06 13:45:34.707046 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1217350311 Jul 06 13:45:34.707046 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Role: reader,member Jul 06 13:45:34.707046 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Roles: reader,member Jul 06 13:45:34.708103 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_5080a0e6cfb24d799c3b31cec1d073bc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/5080a0e6cfb24d799c3b31cec1d073bc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/5080a0e6cfb24d799c3b31cec1d073bc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/5080a0e6cfb24d799c3b31cec1d073bc"}]}] Jul 06 13:45:34.708103 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1217350311 Jul 06 13:45:34.708103 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Tenant-Id: 5080a0e6cfb24d799c3b31cec1d073bc Jul 06 13:45:34.708103 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1217350311 Jul 06 13:45:34.708103 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-User: tempest-VolumesSnapshotsTestJSON-1217350311-project Jul 06 13:45:34.708103 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-User-Domain-Id: default Jul 06 13:45:34.708103 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-User-Domain-Name: Default Jul 06 13:45:34.708103 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-User-Id: ae1587d0dc6246f9997824193eef6d78 Jul 06 13:45:34.708103 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1217350311-project Jul 06 13:45:34.708103 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: method: Jul 06 13:45:34.708103 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: exception: Volume 07ab59c4-ff68-4c97-adff-f5818fef19ac could not be found. Jul 06 13:45:34.708103 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: action_args: {'id': '07ab59c4-ff68-4c97-adff-f5818fef19ac'} Jul 06 13:45:34.708103 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 06 13:45:34.708764 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 06 13:45:34.708764 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 06 13:45:34.708764 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 06 13:45:34.708764 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 06 13:45:34.708764 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 06 13:45:34.708764 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 06 13:45:34.708764 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 06 13:45:34.708764 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 06 13:45:34.708764 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 06 13:45:34.708764 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 06 13:45:34.708764 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 06 13:45:34.708764 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 06 13:45:34.708764 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 06 13:45:34.708764 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 06 13:45:34.708764 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 06 13:45:34.708764 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 07ab59c4-ff68-4c97-adff-f5818fef19ac could not be found. (HTTP 404) (Request-ID: req-62399051-9437-4776-951a-af86a08f816a) Jul 06 13:45:34.708764 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi Jul 06 13:45:34.708764 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 06 13:45:34.708764 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi Jul 06 13:45:34.709721 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 06 13:45:34.709721 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 06 13:45:34.709721 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 06 13:45:34.709721 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 06 13:45:34.709721 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 06 13:45:34.709721 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 06 13:45:34.709721 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 06 13:45:34.709721 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 06 13:45:34.709721 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 06 13:45:34.709721 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 06 13:45:34.709721 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 06 13:45:34.709721 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 06 13:45:34.709721 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 06 13:45:34.709721 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 06 13:45:34.709721 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 06 13:45:34.709721 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 06 13:45:34.709721 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 06 13:45:34.709721 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 06 13:45:34.709721 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 06 13:45:34.713864 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 06 13:45:34.713864 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 06 13:45:34.713864 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 06 13:45:34.713864 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 06 13:45:34.713864 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 07ab59c4-ff68-4c97-adff-f5818fef19ac could not be found. Jul 06 13:45:34.713864 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi Jul 06 13:45:34.713864 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 06 13:45:34.713864 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi Jul 06 13:45:34.713864 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 06 13:45:34.713864 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 06 13:45:34.713864 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 06 13:45:34.713864 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 06 13:45:34.713864 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 06 13:45:34.713864 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 06 13:45:34.713864 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 06 13:45:34.713864 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 06 13:45:34.713864 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 06 13:45:34.713864 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 06 13:45:34.713864 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 06 13:45:34.715655 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 07ab59c4-ff68-4c97-adff-f5818fef19ac could not be found. Jul 06 13:45:34.715655 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi Jul 06 13:45:34.715655 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 06 13:45:34.715655 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi Jul 06 13:45:34.715655 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 06 13:45:34.715655 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 06 13:45:34.715655 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 06 13:45:34.715655 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 06 13:45:34.715655 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 06 13:45:34.715655 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 07ab59c4-ff68-4c97-adff-f5818fef19ac could not be found. Jul 06 13:45:34.715655 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi Jul 06 13:45:34.715655 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-5b72e62e-d204-4638-af6c-661b877fedf6 tempest-VolumesSnapshotsTestJSON-1217350311 tempest-VolumesSnapshotsTestJSON-1217350311-project] Returning 404 to user: Volume 07ab59c4-ff68-4c97-adff-f5818fef19ac could not be found. {{(pid=124368) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 06 13:45:34.715655 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-5b72e62e-d204-4638-af6c-661b877fedf6 tempest-VolumesSnapshotsTestJSON-1217350311 tempest-VolumesSnapshotsTestJSON-1217350311-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/07ab59c4-ff68-4c97-adff-f5818fef19ac" status: 404 len: 109 microversion: 2.1 time: 0.120481 Jul 06 13:45:34.715655 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 40/59] 10.222.0.20 () {58 vars in 1244 bytes} [Wed Jul 6 13:45:34 2022] GET /compute/v2.1/os-volumes/07ab59c4-ff68-4c97-adff-f5818fef19ac => generated 109 bytes in 126 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 06 13:45:34.734704 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-539665fc-2797-44d6-b583-b5e01b5695bf tempest-VolumesTestJSON-1577662730 tempest-VolumesTestJSON-1577662730-project] Calling method '.version_select at 0x7ffbc56ae940>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:45:34.747533 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.virt.hardware [None req-aa022931-315b-4522-9b74-89efb345ff4d tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Flavor limits 0:0:0 {{(pid=124367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 06 13:45:34.748012 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.virt.hardware [None req-aa022931-315b-4522-9b74-89efb345ff4d tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Image limits 0:0:0 {{(pid=124367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 06 13:45:34.748411 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.virt.hardware [None req-aa022931-315b-4522-9b74-89efb345ff4d tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Flavor pref 0:0:0 {{(pid=124367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 06 13:45:34.748835 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.virt.hardware [None req-aa022931-315b-4522-9b74-89efb345ff4d tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Image pref 0:0:0 {{(pid=124367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 06 13:45:34.749745 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.virt.hardware [None req-aa022931-315b-4522-9b74-89efb345ff4d tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 06 13:45:34.775336 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-aa022931-315b-4522-9b74-89efb345ff4d tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:45:34.775874 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-aa022931-315b-4522-9b74-89efb345ff4d tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:45:34.776755 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-aa022931-315b-4522-9b74-89efb345ff4d tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:45:34.777224 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-aa022931-315b-4522-9b74-89efb345ff4d tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:45:34.827242 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.quota [None req-aa022931-315b-4522-9b74-89efb345ff4d tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Getting quotas for project 3b2a80a004e04da7ae12db9f3f87146f. Resources: {'instances', 'cores', 'ram'} {{(pid=124367) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 06 13:45:34.848590 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.quota [None req-aa022931-315b-4522-9b74-89efb345ff4d tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Getting quotas for user 0c83c05bec4f456d8aa7d51732ddc8af and project 3b2a80a004e04da7ae12db9f3f87146f. Resources: {'instances', 'cores', 'ram'} {{(pid=124367) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 06 13:45:34.929561 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-aa022931-315b-4522-9b74-89efb345ff4d tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Going to run 1 instances... {{(pid=124367) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 06 13:45:34.939546 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-aa022931-315b-4522-9b74-89efb345ff4d tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] [instance: c801676d-524f-42fc-a2b8-fe4186986d95] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b08481d9-1e39-41e8-97bd-b05a9c35b377',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124367) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 06 13:45:35.052218 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-539665fc-2797-44d6-b583-b5e01b5695bf tempest-VolumesTestJSON-1577662730 tempest-VolumesTestJSON-1577662730-project] 10.222.0.20 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.337277 Jul 06 13:45:35.052784 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 41/60] 10.222.0.20 () {58 vars in 1133 bytes} [Wed Jul 6 13:45:34 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:45:35.058391 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-fb280931-d6d7-40f3-8cd1-cca71a1de51d tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] Calling method '>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:45:35.059195 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-fb280931-d6d7-40f3-8cd1-cca71a1de51d tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] [instance: 965c7a0f-fa3f-4f5c-92bf-94d8b646a9ae] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:45:35.093695 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-fb280931-d6d7-40f3-8cd1-cca71a1de51d tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:45:35.112433 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-fb280931-d6d7-40f3-8cd1-cca71a1de51d tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:45:35.113338 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-fb280931-d6d7-40f3-8cd1-cca71a1de51d tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:45:35.119180 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-fb280931-d6d7-40f3-8cd1-cca71a1de51d tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:45:35.197679 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-aa022931-315b-4522-9b74-89efb345ff4d tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.109315 Jul 06 13:45:35.199064 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 20/61] 10.222.0.20 () {60 vars in 1146 bytes} [Wed Jul 6 13:45:33 2022] POST /compute/v2.1/servers => generated 383 bytes in 2122 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 06 13:45:35.211176 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-a141875d-b87d-4606-8360-72b09758d0c3 tempest-VolumesTestJSON-1577662730 tempest-VolumesTestJSON-1577662730-project] Calling method '.version_select at 0x7ffbc464bf70>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:45:35.568389 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-fb280931-d6d7-40f3-8cd1-cca71a1de51d tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad0781ce20e54c3a9b7c61e0cccf6918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd48e24dbeaa241d7a97350fb2c8187b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:45:35.586400 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-fb280931-d6d7-40f3-8cd1-cca71a1de51d tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] 10.222.0.20 "GET /compute/v2.1/servers/965c7a0f-fa3f-4f5c-92bf-94d8b646a9ae" status: 200 len: 1272 microversion: 2.1 time: 0.532150 Jul 06 13:45:35.588406 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 42/62] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:45:35 2022] GET /compute/v2.1/servers/965c7a0f-fa3f-4f5c-92bf-94d8b646a9ae => generated 1272 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:45:35.605580 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-6f657085-fbf1-4a00-bb15-78d1beca5f8c tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Calling method '>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:45:35.625095 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-a141875d-b87d-4606-8360-72b09758d0c3 tempest-VolumesTestJSON-1577662730 tempest-VolumesTestJSON-1577662730-project] 10.222.0.20 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.424777 Jul 06 13:45:35.625971 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 21/63] 10.222.0.20 () {58 vars in 1148 bytes} [Wed Jul 6 13:45:35 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 06 13:45:35.640690 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-fa8b90b8-23c6-4f91-959b-f98c36c2afeb tempest-VolumesTestJSON-1577662730 tempest-VolumesTestJSON-1577662730-project] Calling method '.version_select at 0x7ffbc465c160>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:45:35.641227 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-6f657085-fbf1-4a00-bb15-78d1beca5f8c tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] [instance: c801676d-524f-42fc-a2b8-fe4186986d95] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:45:35.764620 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-6f657085-fbf1-4a00-bb15-78d1beca5f8c tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c83c05bec4f456d8aa7d51732ddc8af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b2a80a004e04da7ae12db9f3f87146f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:45:35.774184 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-6f657085-fbf1-4a00-bb15-78d1beca5f8c tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] 10.222.0.20 "GET /compute/v2.1/servers/c801676d-524f-42fc-a2b8-fe4186986d95" status: 200 len: 1222 microversion: 2.1 time: 0.180024 Jul 06 13:45:35.782154 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 43/64] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:45:35 2022] GET /compute/v2.1/servers/c801676d-524f-42fc-a2b8-fe4186986d95 => generated 1222 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:45:35.941715 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-fa8b90b8-23c6-4f91-959b-f98c36c2afeb tempest-VolumesTestJSON-1577662730 tempest-VolumesTestJSON-1577662730-project] 10.222.0.20 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.306891 Jul 06 13:45:35.942861 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 22/65] 10.222.0.20 () {58 vars in 1133 bytes} [Wed Jul 6 13:45:35 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 06 13:45:35.957336 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-78299e2b-e2c5-4d1b-a0b8-1740ebe83e68 tempest-VolumesTestJSON-1577662730 tempest-VolumesTestJSON-1577662730-project] Calling method '.version_select at 0x7ffbc5643f70>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:45:36.171734 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-78299e2b-e2c5-4d1b-a0b8-1740ebe83e68 tempest-VolumesTestJSON-1577662730 tempest-VolumesTestJSON-1577662730-project] 10.222.0.20 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.219355 Jul 06 13:45:36.184509 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 44/66] 10.222.0.20 () {58 vars in 1166 bytes} [Wed Jul 6 13:45:35 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 06 13:45:36.186235 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-57ce476b-ca60-4ff2-a08f-e93f45af0bca tempest-VolumesTestJSON-1577662730 tempest-VolumesTestJSON-1577662730-project] Calling method '.version_select at 0x7ffbc465c280>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:45:36.251366 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-529516e5-2cb0-47b3-9afd-9c9991f9c141 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1241697115", "imageRef": "b08481d9-1e39-41e8-97bd-b05a9c35b377", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "971af843-a8c2-4694-8a42-a011949622a1"}], "security_groups": [{"name": "tempest-securitygroup--55942230"}], "key_name": "tempest-keypair-1180722985", "user_data": "}} {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 06 13:45:36.391024 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-57ce476b-ca60-4ff2-a08f-e93f45af0bca tempest-VolumesTestJSON-1577662730 tempest-VolumesTestJSON-1577662730-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.209025 Jul 06 13:45:36.391612 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 23/67] 10.222.0.20 () {58 vars in 1169 bytes} [Wed Jul 6 13:45:36 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 06 13:45:36.416802 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-3ee6f3da-ebae-42b0-8c20-0981dd58a421 tempest-VolumesTestJSON-1577662730 tempest-VolumesTestJSON-1577662730-project] Calling method '.version_select at 0x7ffbc464bc10>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:45:36.752702 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-3ee6f3da-ebae-42b0-8c20-0981dd58a421 tempest-VolumesTestJSON-1577662730 tempest-VolumesTestJSON-1577662730-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.350458 Jul 06 13:45:36.762362 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 24/68] 10.222.0.20 () {58 vars in 1154 bytes} [Wed Jul 6 13:45:36 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:45:36.771499 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-9832b69c-0525-4612-b227-c1e8d1690782 tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:45:36.772640 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-9832b69c-0525-4612-b227-c1e8d1690782 tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] [instance: 965c7a0f-fa3f-4f5c-92bf-94d8b646a9ae] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:45:36.817403 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-9832b69c-0525-4612-b227-c1e8d1690782 tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:45:36.819546 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-9832b69c-0525-4612-b227-c1e8d1690782 tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:45:36.821981 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-9832b69c-0525-4612-b227-c1e8d1690782 tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:45:36.823652 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-9832b69c-0525-4612-b227-c1e8d1690782 tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:45:37.739106 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-9832b69c-0525-4612-b227-c1e8d1690782 tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad0781ce20e54c3a9b7c61e0cccf6918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd48e24dbeaa241d7a97350fb2c8187b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:45:37.822596 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-9832b69c-0525-4612-b227-c1e8d1690782 tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] 10.222.0.20 "GET /compute/v2.1/servers/965c7a0f-fa3f-4f5c-92bf-94d8b646a9ae" status: 200 len: 1272 microversion: 2.1 time: 1.058156 Jul 06 13:45:37.847001 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 25/69] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:45:36 2022] GET /compute/v2.1/servers/965c7a0f-fa3f-4f5c-92bf-94d8b646a9ae => generated 1272 bytes in 1082 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:45:37.874382 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-51a58be7-08ea-4633-8027-177ffb6a62ef tempest-VolumesTestJSON-1577662730 tempest-VolumesTestJSON-1577662730-project] Calling method '.version_select at 0x7ffbc45d3ca0>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:45:38.138290 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.network.neutron [None req-529516e5-2cb0-47b3-9afd-9c9991f9c141 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] validate_networks() for [('971af843-a8c2-4694-8a42-a011949622a1', None, None, None, None, None)] {{(pid=124368) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 06 13:45:38.165773 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-51a58be7-08ea-4633-8027-177ffb6a62ef tempest-VolumesTestJSON-1577662730 tempest-VolumesTestJSON-1577662730-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.304662 Jul 06 13:45:38.166639 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 26/70] 10.222.0.20 () {58 vars in 1187 bytes} [Wed Jul 6 13:45:37 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 06 13:45:38.172066 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-db4b590b-1809-4a3b-9863-422d65f1505c tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:45:38.173252 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-db4b590b-1809-4a3b-9863-422d65f1505c tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] [instance: c801676d-524f-42fc-a2b8-fe4186986d95] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:45:38.203181 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-db4b590b-1809-4a3b-9863-422d65f1505c tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:45:38.209699 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-db4b590b-1809-4a3b-9863-422d65f1505c tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:45:38.210913 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-db4b590b-1809-4a3b-9863-422d65f1505c tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:45:38.213719 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-db4b590b-1809-4a3b-9863-422d65f1505c tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:45:38.807564 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-db4b590b-1809-4a3b-9863-422d65f1505c tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c83c05bec4f456d8aa7d51732ddc8af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b2a80a004e04da7ae12db9f3f87146f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:45:38.822542 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-db4b590b-1809-4a3b-9863-422d65f1505c tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] 10.222.0.20 "GET /compute/v2.1/servers/c801676d-524f-42fc-a2b8-fe4186986d95" status: 200 len: 1282 microversion: 2.1 time: 0.654063 Jul 06 13:45:38.824389 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 27/71] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:45:38 2022] GET /compute/v2.1/servers/c801676d-524f-42fc-a2b8-fe4186986d95 => generated 1282 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:45:38.830047 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-11615ca2-c502-4ec9-b021-fd31ad6f68ca tempest-VolumesTestJSON-1577662730 tempest-VolumesTestJSON-1577662730-project] Calling method '.version_select at 0x7ffbc45d33a0>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:45:39.214377 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-11615ca2-c502-4ec9-b021-fd31ad6f68ca tempest-VolumesTestJSON-1577662730 tempest-VolumesTestJSON-1577662730-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.388645 Jul 06 13:45:39.215257 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 28/72] 10.222.0.20 () {58 vars in 1154 bytes} [Wed Jul 6 13:45:38 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:45:39.230900 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-f0a0403f-9b4a-4e0f-a0a9-eb7e20d35478 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-340875590", "imageRef": "b08481d9-1e39-41e8-97bd-b05a9c35b377", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "599de418-b206-4788-89c1-e9276ab94414"}], "security_groups": [{"name": "tempest-securitygroup--1493278310"}], "key_name": "tempest-keypair-577538698", "user_data": "}} {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 06 13:45:40.097825 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.network.neutron [None req-f0a0403f-9b4a-4e0f-a0a9-eb7e20d35478 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] validate_networks() for [('599de418-b206-4788-89c1-e9276ab94414', None, None, None, None, None)] {{(pid=124367) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 06 13:45:42.023120 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.virt.hardware [None req-529516e5-2cb0-47b3-9afd-9c9991f9c141 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Flavor limits 0:0:0 {{(pid=124368) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 06 13:45:42.024346 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.virt.hardware [None req-529516e5-2cb0-47b3-9afd-9c9991f9c141 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Image limits 0:0:0 {{(pid=124368) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 06 13:45:42.024689 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.virt.hardware [None req-529516e5-2cb0-47b3-9afd-9c9991f9c141 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Flavor pref 0:0:0 {{(pid=124368) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 06 13:45:42.025665 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.virt.hardware [None req-529516e5-2cb0-47b3-9afd-9c9991f9c141 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Image pref 0:0:0 {{(pid=124368) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 06 13:45:42.026394 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.virt.hardware [None req-529516e5-2cb0-47b3-9afd-9c9991f9c141 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124368) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 06 13:45:42.082277 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-529516e5-2cb0-47b3-9afd-9c9991f9c141 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:45:42.090530 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-529516e5-2cb0-47b3-9afd-9c9991f9c141 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:45:42.091672 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-529516e5-2cb0-47b3-9afd-9c9991f9c141 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:45:42.092773 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-529516e5-2cb0-47b3-9afd-9c9991f9c141 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:45:42.173034 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.quota [None req-529516e5-2cb0-47b3-9afd-9c9991f9c141 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Getting quotas for project 05df572327d54bd99595974b75898052. Resources: {'instances', 'cores', 'ram'} {{(pid=124368) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 06 13:45:42.201994 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.quota [None req-529516e5-2cb0-47b3-9afd-9c9991f9c141 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Getting quotas for user 3d7cacb73c8342579d9f990b0193487c and project 05df572327d54bd99595974b75898052. Resources: {'instances', 'cores', 'ram'} {{(pid=124368) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 06 13:45:42.243268 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-529516e5-2cb0-47b3-9afd-9c9991f9c141 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Going to run 1 instances... {{(pid=124368) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 06 13:45:42.252312 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-529516e5-2cb0-47b3-9afd-9c9991f9c141 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] [instance: 546a77fd-66e1-4d89-afa3-58d632b09186] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b08481d9-1e39-41e8-97bd-b05a9c35b377',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124368) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 06 13:45:42.462013 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-529516e5-2cb0-47b3-9afd-9c9991f9c141 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 6.218358 Jul 06 13:45:42.462939 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 45/73] 10.222.0.20 () {60 vars in 1146 bytes} [Wed Jul 6 13:45:36 2022] POST /compute/v2.1/servers => generated 400 bytes in 6221 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 06 13:45:42.475200 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-dfaee8b0-9329-44d1-8e37-e6e2c9a00b54 tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] Calling method '>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:45:42.482297 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-dfaee8b0-9329-44d1-8e37-e6e2c9a00b54 tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] [instance: 965c7a0f-fa3f-4f5c-92bf-94d8b646a9ae] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:45:42.503615 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-dfaee8b0-9329-44d1-8e37-e6e2c9a00b54 tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:45:42.504071 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-dfaee8b0-9329-44d1-8e37-e6e2c9a00b54 tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:45:42.511154 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-dfaee8b0-9329-44d1-8e37-e6e2c9a00b54 tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:45:42.514200 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-dfaee8b0-9329-44d1-8e37-e6e2c9a00b54 tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:45:42.849716 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.virt.hardware [None req-f0a0403f-9b4a-4e0f-a0a9-eb7e20d35478 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Flavor limits 0:0:0 {{(pid=124367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 06 13:45:42.850652 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.virt.hardware [None req-f0a0403f-9b4a-4e0f-a0a9-eb7e20d35478 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Image limits 0:0:0 {{(pid=124367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 06 13:45:42.851281 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.virt.hardware [None req-f0a0403f-9b4a-4e0f-a0a9-eb7e20d35478 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Flavor pref 0:0:0 {{(pid=124367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 06 13:45:42.853426 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.virt.hardware [None req-f0a0403f-9b4a-4e0f-a0a9-eb7e20d35478 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Image pref 0:0:0 {{(pid=124367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 06 13:45:42.853997 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.virt.hardware [None req-f0a0403f-9b4a-4e0f-a0a9-eb7e20d35478 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 06 13:45:42.896733 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-f0a0403f-9b4a-4e0f-a0a9-eb7e20d35478 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:45:42.898482 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-f0a0403f-9b4a-4e0f-a0a9-eb7e20d35478 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:45:42.901780 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-f0a0403f-9b4a-4e0f-a0a9-eb7e20d35478 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:45:42.902555 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-f0a0403f-9b4a-4e0f-a0a9-eb7e20d35478 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:45:42.935956 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.quota [None req-f0a0403f-9b4a-4e0f-a0a9-eb7e20d35478 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Getting quotas for project bd85f2a57a0847debf5aaf81aab7a638. Resources: {'instances', 'cores', 'ram'} {{(pid=124367) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 06 13:45:42.941167 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.quota [None req-f0a0403f-9b4a-4e0f-a0a9-eb7e20d35478 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Getting quotas for user 7b572a8f465048558fc969b85b2aec5b and project bd85f2a57a0847debf5aaf81aab7a638. Resources: {'instances', 'cores', 'ram'} {{(pid=124367) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 06 13:45:42.964665 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-f0a0403f-9b4a-4e0f-a0a9-eb7e20d35478 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Going to run 1 instances... {{(pid=124367) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 06 13:45:42.969500 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-f0a0403f-9b4a-4e0f-a0a9-eb7e20d35478 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] [instance: 5cf73c2b-28f6-49f1-a119-224c05679d2c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b08481d9-1e39-41e8-97bd-b05a9c35b377',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124367) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 06 13:45:43.108168 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-f0a0403f-9b4a-4e0f-a0a9-eb7e20d35478 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 3.891823 Jul 06 13:45:43.109534 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 29/74] 10.222.0.20 () {60 vars in 1146 bytes} [Wed Jul 6 13:45:39 2022] POST /compute/v2.1/servers => generated 402 bytes in 3894 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 06 13:45:43.119466 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-18b05813-7514-4159-a181-4325f8efbfe7 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:45:43.122908 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-18b05813-7514-4159-a181-4325f8efbfe7 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] [instance: c801676d-524f-42fc-a2b8-fe4186986d95] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:45:43.134657 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG dbcounter [-] [124367] Writing DB stats nova_api:SELECT=86,nova_api:INSERT=14 {{(pid=124367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:45:43.156687 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-18b05813-7514-4159-a181-4325f8efbfe7 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:45:43.159955 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-18b05813-7514-4159-a181-4325f8efbfe7 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:45:43.161893 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-18b05813-7514-4159-a181-4325f8efbfe7 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:45:43.162764 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-18b05813-7514-4159-a181-4325f8efbfe7 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:45:43.782247 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-dfaee8b0-9329-44d1-8e37-e6e2c9a00b54 tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad0781ce20e54c3a9b7c61e0cccf6918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd48e24dbeaa241d7a97350fb2c8187b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:45:43.798518 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-dfaee8b0-9329-44d1-8e37-e6e2c9a00b54 tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] 10.222.0.20 "GET /compute/v2.1/servers/965c7a0f-fa3f-4f5c-92bf-94d8b646a9ae" status: 200 len: 1314 microversion: 2.1 time: 1.329411 Jul 06 13:45:43.799413 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 46/75] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:45:42 2022] GET /compute/v2.1/servers/965c7a0f-fa3f-4f5c-92bf-94d8b646a9ae => generated 1314 bytes in 1336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:45:43.815303 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-da1e50f2-93b4-42a2-9a0e-16a2438fddfe tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Calling method '>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:45:43.816235 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-da1e50f2-93b4-42a2-9a0e-16a2438fddfe tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] [instance: 546a77fd-66e1-4d89-afa3-58d632b09186] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:45:43.837406 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-da1e50f2-93b4-42a2-9a0e-16a2438fddfe tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:45:43.838544 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-da1e50f2-93b4-42a2-9a0e-16a2438fddfe tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:45:43.839496 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-da1e50f2-93b4-42a2-9a0e-16a2438fddfe tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:45:43.840090 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-da1e50f2-93b4-42a2-9a0e-16a2438fddfe tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:45:44.546289 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-18b05813-7514-4159-a181-4325f8efbfe7 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c83c05bec4f456d8aa7d51732ddc8af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b2a80a004e04da7ae12db9f3f87146f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:45:44.552619 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-da1e50f2-93b4-42a2-9a0e-16a2438fddfe tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d7cacb73c8342579d9f990b0193487c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05df572327d54bd99595974b75898052', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:45:44.584706 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-da1e50f2-93b4-42a2-9a0e-16a2438fddfe tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] 10.222.0.20 "GET /compute/v2.1/servers/546a77fd-66e1-4d89-afa3-58d632b09186" status: 200 len: 1242 microversion: 2.1 time: 0.783398 Jul 06 13:45:44.585365 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 47/76] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:45:43 2022] GET /compute/v2.1/servers/546a77fd-66e1-4d89-afa3-58d632b09186 => generated 1242 bytes in 785 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:45:44.599749 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-18b05813-7514-4159-a181-4325f8efbfe7 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] 10.222.0.20 "GET /compute/v2.1/servers/c801676d-524f-42fc-a2b8-fe4186986d95" status: 200 len: 1322 microversion: 2.1 time: 1.486173 Jul 06 13:45:44.603037 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 30/77] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:45:43 2022] GET /compute/v2.1/servers/c801676d-524f-42fc-a2b8-fe4186986d95 => generated 1322 bytes in 1493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:45:44.619123 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-0175fb47-ad2a-4d31-b011-7e39fccd29a4 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Calling method '>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:45:44.619730 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-0175fb47-ad2a-4d31-b011-7e39fccd29a4 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] [instance: 5cf73c2b-28f6-49f1-a119-224c05679d2c] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:45:44.662991 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-0175fb47-ad2a-4d31-b011-7e39fccd29a4 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:45:44.663430 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-0175fb47-ad2a-4d31-b011-7e39fccd29a4 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:45:44.664745 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-0175fb47-ad2a-4d31-b011-7e39fccd29a4 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:45:44.665213 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-0175fb47-ad2a-4d31-b011-7e39fccd29a4 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:45:44.818712 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-6c226fc2-5f69-4eb8-ac12-2039d12f41db tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:45:44.819339 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-6c226fc2-5f69-4eb8-ac12-2039d12f41db tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] [instance: 965c7a0f-fa3f-4f5c-92bf-94d8b646a9ae] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:45:44.845660 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-6c226fc2-5f69-4eb8-ac12-2039d12f41db tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:45:44.846137 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-6c226fc2-5f69-4eb8-ac12-2039d12f41db tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:45:44.852853 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-6c226fc2-5f69-4eb8-ac12-2039d12f41db tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:45:44.855961 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-6c226fc2-5f69-4eb8-ac12-2039d12f41db tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:45:44.893645 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-0175fb47-ad2a-4d31-b011-7e39fccd29a4 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b572a8f465048558fc969b85b2aec5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd85f2a57a0847debf5aaf81aab7a638', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:45:44.913302 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-0175fb47-ad2a-4d31-b011-7e39fccd29a4 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] 10.222.0.20 "GET /compute/v2.1/servers/5cf73c2b-28f6-49f1-a119-224c05679d2c" status: 200 len: 1244 microversion: 2.1 time: 0.312022 Jul 06 13:45:44.920435 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 48/78] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:45:44 2022] GET /compute/v2.1/servers/5cf73c2b-28f6-49f1-a119-224c05679d2c => generated 1244 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:45:45.606545 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-2f698d32-8d67-422c-8cfd-b1c9bf62cf9d tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Calling method '>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:45:45.607162 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-2f698d32-8d67-422c-8cfd-b1c9bf62cf9d tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] [instance: 546a77fd-66e1-4d89-afa3-58d632b09186] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:45:45.642586 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-2f698d32-8d67-422c-8cfd-b1c9bf62cf9d tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:45:45.643076 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-2f698d32-8d67-422c-8cfd-b1c9bf62cf9d tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:45:45.650004 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-2f698d32-8d67-422c-8cfd-b1c9bf62cf9d tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:45:45.651940 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-2f698d32-8d67-422c-8cfd-b1c9bf62cf9d tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:45:46.087606 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-2f698d32-8d67-422c-8cfd-b1c9bf62cf9d tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d7cacb73c8342579d9f990b0193487c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05df572327d54bd99595974b75898052', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:45:46.097826 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-2f698d32-8d67-422c-8cfd-b1c9bf62cf9d tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] 10.222.0.20 "GET /compute/v2.1/servers/546a77fd-66e1-4d89-afa3-58d632b09186" status: 200 len: 1298 microversion: 2.1 time: 0.497360 Jul 06 13:45:46.099164 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 49/79] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:45:45 2022] GET /compute/v2.1/servers/546a77fd-66e1-4d89-afa3-58d632b09186 => generated 1298 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:45:46.124341 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-6b3de485-c862-49da-b026-22c443c6cf97 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Calling method '>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:45:46.127011 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-6b3de485-c862-49da-b026-22c443c6cf97 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] [instance: c801676d-524f-42fc-a2b8-fe4186986d95] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:45:46.139859 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-6b3de485-c862-49da-b026-22c443c6cf97 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:45:46.140817 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-6b3de485-c862-49da-b026-22c443c6cf97 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:45:46.141988 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-6b3de485-c862-49da-b026-22c443c6cf97 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:45:46.142896 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-6b3de485-c862-49da-b026-22c443c6cf97 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:45:46.335710 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-6c226fc2-5f69-4eb8-ac12-2039d12f41db tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad0781ce20e54c3a9b7c61e0cccf6918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd48e24dbeaa241d7a97350fb2c8187b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:45:46.393380 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-6c226fc2-5f69-4eb8-ac12-2039d12f41db tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] 10.222.0.20 "GET /compute/v2.1/servers/965c7a0f-fa3f-4f5c-92bf-94d8b646a9ae" status: 200 len: 1314 microversion: 2.1 time: 1.576965 Jul 06 13:45:46.415951 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 31/80] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:45:44 2022] GET /compute/v2.1/servers/965c7a0f-fa3f-4f5c-92bf-94d8b646a9ae => generated 1314 bytes in 1602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 06 13:45:46.447837 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-8ac374f7-b605-44ea-b8d0-61b0f9c15251 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:45:46.450458 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-8ac374f7-b605-44ea-b8d0-61b0f9c15251 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] [instance: 5cf73c2b-28f6-49f1-a119-224c05679d2c] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:45:46.527506 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-8ac374f7-b605-44ea-b8d0-61b0f9c15251 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:45:46.528083 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-8ac374f7-b605-44ea-b8d0-61b0f9c15251 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:45:46.538358 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-8ac374f7-b605-44ea-b8d0-61b0f9c15251 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:45:46.538892 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-8ac374f7-b605-44ea-b8d0-61b0f9c15251 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:45:46.848231 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-6b3de485-c862-49da-b026-22c443c6cf97 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c83c05bec4f456d8aa7d51732ddc8af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b2a80a004e04da7ae12db9f3f87146f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:45:46.858129 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-6b3de485-c862-49da-b026-22c443c6cf97 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] 10.222.0.20 "GET /compute/v2.1/servers/c801676d-524f-42fc-a2b8-fe4186986d95" status: 200 len: 1322 microversion: 2.1 time: 0.757700 Jul 06 13:45:46.868956 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 50/81] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:45:46 2022] GET /compute/v2.1/servers/c801676d-524f-42fc-a2b8-fe4186986d95 => generated 1322 bytes in 766 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:45:46.928220 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-8ac374f7-b605-44ea-b8d0-61b0f9c15251 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b572a8f465048558fc969b85b2aec5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd85f2a57a0847debf5aaf81aab7a638', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:45:46.939078 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-8ac374f7-b605-44ea-b8d0-61b0f9c15251 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] 10.222.0.20 "GET /compute/v2.1/servers/5cf73c2b-28f6-49f1-a119-224c05679d2c" status: 200 len: 1292 microversion: 2.1 time: 0.518602 Jul 06 13:45:46.949815 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 32/82] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:45:46 2022] GET /compute/v2.1/servers/5cf73c2b-28f6-49f1-a119-224c05679d2c => generated 1292 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:45:47.116320 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-258b1ecf-b8de-490a-be4d-cf278e4fea0d tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Calling method '>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:45:47.117631 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-258b1ecf-b8de-490a-be4d-cf278e4fea0d tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] [instance: 546a77fd-66e1-4d89-afa3-58d632b09186] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:45:47.128190 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-258b1ecf-b8de-490a-be4d-cf278e4fea0d tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:45:47.129798 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-258b1ecf-b8de-490a-be4d-cf278e4fea0d tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:45:47.131850 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-258b1ecf-b8de-490a-be4d-cf278e4fea0d tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:45:47.142939 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-258b1ecf-b8de-490a-be4d-cf278e4fea0d tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:45:47.415071 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-6fd98262-1461-4a4a-a663-e5de993a93dc tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:45:47.415858 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-6fd98262-1461-4a4a-a663-e5de993a93dc tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] [instance: 965c7a0f-fa3f-4f5c-92bf-94d8b646a9ae] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:45:47.434682 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-6fd98262-1461-4a4a-a663-e5de993a93dc tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:45:47.435166 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-6fd98262-1461-4a4a-a663-e5de993a93dc tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:45:47.441587 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-6fd98262-1461-4a4a-a663-e5de993a93dc tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:45:47.443790 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-6fd98262-1461-4a4a-a663-e5de993a93dc tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:45:47.668345 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-258b1ecf-b8de-490a-be4d-cf278e4fea0d tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d7cacb73c8342579d9f990b0193487c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05df572327d54bd99595974b75898052', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:45:47.694330 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-258b1ecf-b8de-490a-be4d-cf278e4fea0d tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] 10.222.0.20 "GET /compute/v2.1/servers/546a77fd-66e1-4d89-afa3-58d632b09186" status: 200 len: 1296 microversion: 2.1 time: 0.578249 Jul 06 13:45:47.700488 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 51/83] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:45:47 2022] GET /compute/v2.1/servers/546a77fd-66e1-4d89-afa3-58d632b09186 => generated 1296 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:45:47.881312 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-820659f9-e335-45e6-ba37-f71f0de52295 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Calling method '>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:45:47.882022 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-820659f9-e335-45e6-ba37-f71f0de52295 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] [instance: c801676d-524f-42fc-a2b8-fe4186986d95] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:45:47.900370 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-820659f9-e335-45e6-ba37-f71f0de52295 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:45:47.900876 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-820659f9-e335-45e6-ba37-f71f0de52295 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:45:47.907415 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-820659f9-e335-45e6-ba37-f71f0de52295 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:45:47.909185 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-820659f9-e335-45e6-ba37-f71f0de52295 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:45:49.170178 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-820659f9-e335-45e6-ba37-f71f0de52295 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c83c05bec4f456d8aa7d51732ddc8af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b2a80a004e04da7ae12db9f3f87146f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:45:49.183785 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-820659f9-e335-45e6-ba37-f71f0de52295 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] 10.222.0.20 "GET /compute/v2.1/servers/c801676d-524f-42fc-a2b8-fe4186986d95" status: 200 len: 1322 microversion: 2.1 time: 1.305550 Jul 06 13:45:49.186484 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 52/84] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:45:47 2022] GET /compute/v2.1/servers/c801676d-524f-42fc-a2b8-fe4186986d95 => generated 1322 bytes in 1311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 06 13:45:49.198200 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-6c4a7944-53e7-4d0d-9eb5-3e6295dcba76 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Calling method '>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:45:49.199187 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-6c4a7944-53e7-4d0d-9eb5-3e6295dcba76 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] [instance: 5cf73c2b-28f6-49f1-a119-224c05679d2c] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:45:49.213969 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-6c4a7944-53e7-4d0d-9eb5-3e6295dcba76 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:45:49.214875 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-6c4a7944-53e7-4d0d-9eb5-3e6295dcba76 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:45:49.218354 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-6c4a7944-53e7-4d0d-9eb5-3e6295dcba76 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:45:49.219044 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-6c4a7944-53e7-4d0d-9eb5-3e6295dcba76 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:45:49.468736 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-6c4a7944-53e7-4d0d-9eb5-3e6295dcba76 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b572a8f465048558fc969b85b2aec5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd85f2a57a0847debf5aaf81aab7a638', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:45:49.483549 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-6c4a7944-53e7-4d0d-9eb5-3e6295dcba76 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] 10.222.0.20 "GET /compute/v2.1/servers/5cf73c2b-28f6-49f1-a119-224c05679d2c" status: 200 len: 1298 microversion: 2.1 time: 0.293212 Jul 06 13:45:49.484982 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 53/85] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:45:49 2022] GET /compute/v2.1/servers/5cf73c2b-28f6-49f1-a119-224c05679d2c => generated 1298 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:45:49.600913 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-6fd98262-1461-4a4a-a663-e5de993a93dc tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad0781ce20e54c3a9b7c61e0cccf6918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd48e24dbeaa241d7a97350fb2c8187b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:45:49.624176 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-6fd98262-1461-4a4a-a663-e5de993a93dc tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] 10.222.0.20 "GET /compute/v2.1/servers/965c7a0f-fa3f-4f5c-92bf-94d8b646a9ae" status: 200 len: 1314 microversion: 2.1 time: 2.206570 Jul 06 13:45:49.629310 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 33/86] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:45:47 2022] GET /compute/v2.1/servers/965c7a0f-fa3f-4f5c-92bf-94d8b646a9ae => generated 1314 bytes in 2220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 06 13:45:49.645534 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-6beefeba-11bb-49de-b9f3-0947ef8e36ad tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:45:49.646881 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-6beefeba-11bb-49de-b9f3-0947ef8e36ad tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] [instance: 546a77fd-66e1-4d89-afa3-58d632b09186] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:45:49.667222 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-6beefeba-11bb-49de-b9f3-0947ef8e36ad tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:45:49.668210 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-6beefeba-11bb-49de-b9f3-0947ef8e36ad tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:45:49.669440 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-6beefeba-11bb-49de-b9f3-0947ef8e36ad tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:45:49.670343 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-6beefeba-11bb-49de-b9f3-0947ef8e36ad tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:45:50.034410 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [req-bafdfd2a-bd07-4ea6-a4e0-ce035216b4fc req-49727b89-6a71-4d37-ae1e-aee0a3d1a78e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "965c7a0f-fa3f-4f5c-92bf-94d8b646a9ae", "tag": "8a192dda-4324-4e22-921f-fbd7d7236d23"}]} {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 06 13:45:50.058079 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [req-bafdfd2a-bd07-4ea6-a4e0-ce035216b4fc req-49727b89-6a71-4d37-ae1e-aee0a3d1a78e service nova] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:45:50.058521 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [req-bafdfd2a-bd07-4ea6-a4e0-ce035216b4fc req-49727b89-6a71-4d37-ae1e-aee0a3d1a78e service nova] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:45:50.108906 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.compute.server_external_events [req-bafdfd2a-bd07-4ea6-a4e0-ce035216b4fc req-49727b89-6a71-4d37-ae1e-aee0a3d1a78e service nova] Creating event network-changed:8a192dda-4324-4e22-921f-fbd7d7236d23 for instance 965c7a0f-fa3f-4f5c-92bf-94d8b646a9ae on hv-cinder-81914 Jul 06 13:45:50.111330 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [req-bafdfd2a-bd07-4ea6-a4e0-ce035216b4fc req-49727b89-6a71-4d37-ae1e-aee0a3d1a78e service nova] Acquired lock "compute-rpcapi-router" {{(pid=124368) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 06 13:45:50.112657 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-b38217bc-d8f2-4fae-bde5-098727a17cb3 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:45:50.118893 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-b38217bc-d8f2-4fae-bde5-098727a17cb3 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:45:50.120121 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-b38217bc-d8f2-4fae-bde5-098727a17cb3 None None] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:45:50.120712 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-b38217bc-d8f2-4fae-bde5-098727a17cb3 None None] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:45:50.144700 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.compute.rpcapi [None req-b38217bc-d8f2-4fae-bde5-098727a17cb3 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jul 06 13:45:50.149368 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-b38217bc-d8f2-4fae-bde5-098727a17cb3 None None] Releasing lock "compute-rpcapi-router" {{(pid=124368) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 06 13:45:50.187400 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-6beefeba-11bb-49de-b9f3-0947ef8e36ad tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d7cacb73c8342579d9f990b0193487c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05df572327d54bd99595974b75898052', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:45:50.192972 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-b38217bc-d8f2-4fae-bde5-098727a17cb3 None None] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.706455 Jul 06 13:45:50.197865 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 54/87] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 6 13:45:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 06 13:45:50.215334 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-6beefeba-11bb-49de-b9f3-0947ef8e36ad tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] 10.222.0.20 "GET /compute/v2.1/servers/546a77fd-66e1-4d89-afa3-58d632b09186" status: 200 len: 1296 microversion: 2.1 time: 0.582927 Jul 06 13:45:50.218347 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 34/88] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:45:49 2022] GET /compute/v2.1/servers/546a77fd-66e1-4d89-afa3-58d632b09186 => generated 1296 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:45:50.237846 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-86e6540a-fd98-492f-8a2a-c713b5b1600a tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:45:50.238727 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-86e6540a-fd98-492f-8a2a-c713b5b1600a tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] [instance: c801676d-524f-42fc-a2b8-fe4186986d95] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:45:50.247937 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-86e6540a-fd98-492f-8a2a-c713b5b1600a tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:45:50.248838 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-86e6540a-fd98-492f-8a2a-c713b5b1600a tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:45:50.251974 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-86e6540a-fd98-492f-8a2a-c713b5b1600a tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:45:50.255685 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-86e6540a-fd98-492f-8a2a-c713b5b1600a tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:45:50.740201 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [req-c71f2a6f-25c2-4196-9615-10a5237f138a req-3699e0b3-d0c4-4e76-828f-a500400f595d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c801676d-524f-42fc-a2b8-fe4186986d95", "tag": "13a49a96-2359-4685-a057-014466405458"}]} {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 06 13:45:50.775312 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [req-c71f2a6f-25c2-4196-9615-10a5237f138a req-3699e0b3-d0c4-4e76-828f-a500400f595d service nova] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:45:50.777233 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [req-c71f2a6f-25c2-4196-9615-10a5237f138a req-3699e0b3-d0c4-4e76-828f-a500400f595d service nova] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:45:50.844397 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.compute.server_external_events [req-c71f2a6f-25c2-4196-9615-10a5237f138a req-3699e0b3-d0c4-4e76-828f-a500400f595d service nova] Creating event network-changed:13a49a96-2359-4685-a057-014466405458 for instance c801676d-524f-42fc-a2b8-fe4186986d95 on hv-cinder-81914 Jul 06 13:45:50.879888 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [req-c71f2a6f-25c2-4196-9615-10a5237f138a req-3699e0b3-d0c4-4e76-828f-a500400f595d service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.677355 Jul 06 13:45:50.880580 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 55/89] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 6 13:45:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 06 13:45:50.903537 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-a4fe3be7-88b8-40dd-92a3-fd5018fc3a63 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Calling method '>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:45:50.904257 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-a4fe3be7-88b8-40dd-92a3-fd5018fc3a63 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] [instance: 5cf73c2b-28f6-49f1-a119-224c05679d2c] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:45:50.933785 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-a4fe3be7-88b8-40dd-92a3-fd5018fc3a63 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:45:50.937612 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-a4fe3be7-88b8-40dd-92a3-fd5018fc3a63 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:45:50.938478 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-a4fe3be7-88b8-40dd-92a3-fd5018fc3a63 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:45:50.938969 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-a4fe3be7-88b8-40dd-92a3-fd5018fc3a63 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:45:51.130001 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-a4fe3be7-88b8-40dd-92a3-fd5018fc3a63 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b572a8f465048558fc969b85b2aec5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd85f2a57a0847debf5aaf81aab7a638', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:45:51.138767 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-a4fe3be7-88b8-40dd-92a3-fd5018fc3a63 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] 10.222.0.20 "GET /compute/v2.1/servers/5cf73c2b-28f6-49f1-a119-224c05679d2c" status: 200 len: 1298 microversion: 2.1 time: 0.256865 Jul 06 13:45:51.141122 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 56/90] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:45:50 2022] GET /compute/v2.1/servers/5cf73c2b-28f6-49f1-a119-224c05679d2c => generated 1298 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:45:51.155394 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-4f20fcbf-9dda-42f5-95fd-f3d261ef6d54 tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] Calling method '>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:45:51.157672 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-4f20fcbf-9dda-42f5-95fd-f3d261ef6d54 tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] [instance: 965c7a0f-fa3f-4f5c-92bf-94d8b646a9ae] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:45:51.178223 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-4f20fcbf-9dda-42f5-95fd-f3d261ef6d54 tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:45:51.179300 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-4f20fcbf-9dda-42f5-95fd-f3d261ef6d54 tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:45:51.180097 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-4f20fcbf-9dda-42f5-95fd-f3d261ef6d54 tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:45:51.188962 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-4f20fcbf-9dda-42f5-95fd-f3d261ef6d54 tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:45:51.354386 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-86e6540a-fd98-492f-8a2a-c713b5b1600a tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c83c05bec4f456d8aa7d51732ddc8af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b2a80a004e04da7ae12db9f3f87146f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:45:51.362806 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-86e6540a-fd98-492f-8a2a-c713b5b1600a tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] 10.222.0.20 "GET /compute/v2.1/servers/c801676d-524f-42fc-a2b8-fe4186986d95" status: 200 len: 1322 microversion: 2.1 time: 1.143075 Jul 06 13:45:51.363380 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 35/91] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:45:50 2022] GET /compute/v2.1/servers/c801676d-524f-42fc-a2b8-fe4186986d95 => generated 1322 bytes in 1144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:45:51.379665 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-6795a439-c9f4-44a1-adbe-8735b5a2c238 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:45:51.387101 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-6795a439-c9f4-44a1-adbe-8735b5a2c238 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] [instance: 546a77fd-66e1-4d89-afa3-58d632b09186] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:45:51.404822 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-6795a439-c9f4-44a1-adbe-8735b5a2c238 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:45:51.405479 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-6795a439-c9f4-44a1-adbe-8735b5a2c238 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:45:51.406659 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-6795a439-c9f4-44a1-adbe-8735b5a2c238 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:45:51.407236 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-6795a439-c9f4-44a1-adbe-8735b5a2c238 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:45:51.990824 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-4f20fcbf-9dda-42f5-95fd-f3d261ef6d54 tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad0781ce20e54c3a9b7c61e0cccf6918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd48e24dbeaa241d7a97350fb2c8187b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:45:52.007852 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-4f20fcbf-9dda-42f5-95fd-f3d261ef6d54 tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] 10.222.0.20 "GET /compute/v2.1/servers/965c7a0f-fa3f-4f5c-92bf-94d8b646a9ae" status: 200 len: 1314 microversion: 2.1 time: 0.864183 Jul 06 13:45:52.008688 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 57/92] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:45:51 2022] GET /compute/v2.1/servers/965c7a0f-fa3f-4f5c-92bf-94d8b646a9ae => generated 1314 bytes in 866 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:45:52.159241 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-7cfe36c0-54f0-4f69-9224-788e16306088 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Calling method '>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:45:52.159864 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-7cfe36c0-54f0-4f69-9224-788e16306088 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] [instance: 5cf73c2b-28f6-49f1-a119-224c05679d2c] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:45:52.173994 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-7cfe36c0-54f0-4f69-9224-788e16306088 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:45:52.175274 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-7cfe36c0-54f0-4f69-9224-788e16306088 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:45:52.176581 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-7cfe36c0-54f0-4f69-9224-788e16306088 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:45:52.182560 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-7cfe36c0-54f0-4f69-9224-788e16306088 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:45:52.187524 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG dbcounter [-] [124368] Writing DB stats nova_cell1:SELECT=100 {{(pid=124368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:45:52.218365 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG dbcounter [-] [124368] Writing DB stats nova_cell0:SELECT=12 {{(pid=124368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:45:52.483430 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-6795a439-c9f4-44a1-adbe-8735b5a2c238 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d7cacb73c8342579d9f990b0193487c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05df572327d54bd99595974b75898052', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:45:52.492368 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-6795a439-c9f4-44a1-adbe-8735b5a2c238 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] 10.222.0.20 "GET /compute/v2.1/servers/546a77fd-66e1-4d89-afa3-58d632b09186" status: 200 len: 1362 microversion: 2.1 time: 1.116459 Jul 06 13:45:52.493044 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 36/93] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:45:51 2022] GET /compute/v2.1/servers/546a77fd-66e1-4d89-afa3-58d632b09186 => generated 1362 bytes in 1118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:45:52.503094 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-25601078-ea45-4cb2-98fa-23e5141e66b1 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:45:52.504441 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-25601078-ea45-4cb2-98fa-23e5141e66b1 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] [instance: c801676d-524f-42fc-a2b8-fe4186986d95] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:45:52.511953 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-25601078-ea45-4cb2-98fa-23e5141e66b1 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:45:52.512755 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-25601078-ea45-4cb2-98fa-23e5141e66b1 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:45:52.513900 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-25601078-ea45-4cb2-98fa-23e5141e66b1 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:45:52.514325 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-25601078-ea45-4cb2-98fa-23e5141e66b1 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:45:52.762654 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-7cfe36c0-54f0-4f69-9224-788e16306088 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b572a8f465048558fc969b85b2aec5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd85f2a57a0847debf5aaf81aab7a638', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:45:52.773606 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-7cfe36c0-54f0-4f69-9224-788e16306088 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] 10.222.0.20 "GET /compute/v2.1/servers/5cf73c2b-28f6-49f1-a119-224c05679d2c" status: 200 len: 1366 microversion: 2.1 time: 0.618208 Jul 06 13:45:52.774471 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 58/94] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:45:52 2022] GET /compute/v2.1/servers/5cf73c2b-28f6-49f1-a119-224c05679d2c => generated 1366 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 06 13:45:52.912173 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG dbcounter [-] [124367] Writing DB stats nova_cell0:SELECT=8 {{(pid=124367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:45:52.955128 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG dbcounter [-] [124367] Writing DB stats nova_cell0:SELECT=34 {{(pid=124367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:45:53.021941 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [req-3ef05ddf-5dc2-4077-832a-428bd3adb5b5 req-1ac3dab1-fe9a-4f4b-a6d2-bda7e920577f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "12bddea9-d545-43f2-9bf7-5e723900c8c6", "tag": "0a503503-bc5a-427b-9188-0939c526e5da"}]} {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 06 13:45:53.032719 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [req-3ef05ddf-5dc2-4077-832a-428bd3adb5b5 req-1ac3dab1-fe9a-4f4b-a6d2-bda7e920577f service nova] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:45:53.033285 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [req-3ef05ddf-5dc2-4077-832a-428bd3adb5b5 req-1ac3dab1-fe9a-4f4b-a6d2-bda7e920577f service nova] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:45:53.050159 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.compute.server_external_events [req-3ef05ddf-5dc2-4077-832a-428bd3adb5b5 req-1ac3dab1-fe9a-4f4b-a6d2-bda7e920577f service nova] Creating event network-changed:0a503503-bc5a-427b-9188-0939c526e5da for instance 12bddea9-d545-43f2-9bf7-5e723900c8c6 on hv-cinder-81914 Jul 06 13:45:53.058780 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-25601078-ea45-4cb2-98fa-23e5141e66b1 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c83c05bec4f456d8aa7d51732ddc8af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b2a80a004e04da7ae12db9f3f87146f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:45:53.059377 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [req-3ef05ddf-5dc2-4077-832a-428bd3adb5b5 req-1ac3dab1-fe9a-4f4b-a6d2-bda7e920577f service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044164 Jul 06 13:45:53.060523 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 59/95] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 6 13:45:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 06 13:45:53.066437 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-b496c214-c287-45b3-a56c-49fde52a9096 tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] Calling method '>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:45:53.067441 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-b496c214-c287-45b3-a56c-49fde52a9096 tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] [instance: 965c7a0f-fa3f-4f5c-92bf-94d8b646a9ae] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:45:53.071964 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-25601078-ea45-4cb2-98fa-23e5141e66b1 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] 10.222.0.20 "GET /compute/v2.1/servers/c801676d-524f-42fc-a2b8-fe4186986d95" status: 200 len: 1322 microversion: 2.1 time: 0.577554 Jul 06 13:45:53.073381 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 37/96] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:45:52 2022] GET /compute/v2.1/servers/c801676d-524f-42fc-a2b8-fe4186986d95 => generated 1322 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:45:53.083260 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-b496c214-c287-45b3-a56c-49fde52a9096 tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:45:53.083260 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-b496c214-c287-45b3-a56c-49fde52a9096 tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:45:53.083260 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-b496c214-c287-45b3-a56c-49fde52a9096 tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:45:53.083260 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-b496c214-c287-45b3-a56c-49fde52a9096 tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:45:53.510035 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-208bedbc-5c5d-49f9-9e14-57da12062037 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:45:53.510718 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-208bedbc-5c5d-49f9-9e14-57da12062037 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] [instance: 546a77fd-66e1-4d89-afa3-58d632b09186] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:45:53.519617 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-208bedbc-5c5d-49f9-9e14-57da12062037 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:45:53.521063 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-208bedbc-5c5d-49f9-9e14-57da12062037 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:45:53.524648 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-208bedbc-5c5d-49f9-9e14-57da12062037 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:45:53.525769 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-208bedbc-5c5d-49f9-9e14-57da12062037 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:45:53.607137 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-b496c214-c287-45b3-a56c-49fde52a9096 tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad0781ce20e54c3a9b7c61e0cccf6918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd48e24dbeaa241d7a97350fb2c8187b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:45:53.651537 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-b496c214-c287-45b3-a56c-49fde52a9096 tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] 10.222.0.20 "GET /compute/v2.1/servers/965c7a0f-fa3f-4f5c-92bf-94d8b646a9ae" status: 200 len: 1314 microversion: 2.1 time: 0.578893 Jul 06 13:45:53.652194 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 60/97] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:45:53 2022] GET /compute/v2.1/servers/965c7a0f-fa3f-4f5c-92bf-94d8b646a9ae => generated 1314 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:45:53.792301 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-e0429e3e-0ac8-40f9-87a2-c64fc53a6a5f tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Calling method '>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:45:53.793628 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-e0429e3e-0ac8-40f9-87a2-c64fc53a6a5f tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] [instance: 5cf73c2b-28f6-49f1-a119-224c05679d2c] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:45:53.811986 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-e0429e3e-0ac8-40f9-87a2-c64fc53a6a5f tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:45:53.812968 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-e0429e3e-0ac8-40f9-87a2-c64fc53a6a5f tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:45:53.815347 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-e0429e3e-0ac8-40f9-87a2-c64fc53a6a5f tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:45:53.816154 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-e0429e3e-0ac8-40f9-87a2-c64fc53a6a5f tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:45:54.105499 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-208bedbc-5c5d-49f9-9e14-57da12062037 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d7cacb73c8342579d9f990b0193487c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05df572327d54bd99595974b75898052', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:45:54.123336 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-208bedbc-5c5d-49f9-9e14-57da12062037 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] 10.222.0.20 "GET /compute/v2.1/servers/546a77fd-66e1-4d89-afa3-58d632b09186" status: 200 len: 1362 microversion: 2.1 time: 0.614028 Jul 06 13:45:54.127033 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 38/98] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:45:53 2022] GET /compute/v2.1/servers/546a77fd-66e1-4d89-afa3-58d632b09186 => generated 1362 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 06 13:45:54.136565 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [req-a399ac04-7355-48be-b429-7b7d0867d73b req-249702be-9b7b-44eb-9548-389a222b66c4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5cf73c2b-28f6-49f1-a119-224c05679d2c", "tag": "eb26a6ef-8459-409e-986c-7f71a4f52683"}]} {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 06 13:45:54.176480 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [req-a399ac04-7355-48be-b429-7b7d0867d73b req-249702be-9b7b-44eb-9548-389a222b66c4 service nova] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:45:54.178762 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [req-a399ac04-7355-48be-b429-7b7d0867d73b req-249702be-9b7b-44eb-9548-389a222b66c4 service nova] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:45:54.260547 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.compute.server_external_events [req-a399ac04-7355-48be-b429-7b7d0867d73b req-249702be-9b7b-44eb-9548-389a222b66c4 service nova] Creating event network-changed:eb26a6ef-8459-409e-986c-7f71a4f52683 for instance 5cf73c2b-28f6-49f1-a119-224c05679d2c on hv-cinder-81914 Jul 06 13:45:54.269798 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [req-a399ac04-7355-48be-b429-7b7d0867d73b req-249702be-9b7b-44eb-9548-389a222b66c4 service nova] Acquired lock "compute-rpcapi-router" {{(pid=124367) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 06 13:45:54.271364 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-6557592d-d3bc-4562-9f32-41f24b132ba6 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:45:54.272014 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-6557592d-d3bc-4562-9f32-41f24b132ba6 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:45:54.275074 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-6557592d-d3bc-4562-9f32-41f24b132ba6 None None] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:45:54.275767 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-6557592d-d3bc-4562-9f32-41f24b132ba6 None None] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:45:54.319612 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-e0429e3e-0ac8-40f9-87a2-c64fc53a6a5f tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b572a8f465048558fc969b85b2aec5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd85f2a57a0847debf5aaf81aab7a638', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:45:54.321277 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.compute.rpcapi [None req-6557592d-d3bc-4562-9f32-41f24b132ba6 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jul 06 13:45:54.325949 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-6557592d-d3bc-4562-9f32-41f24b132ba6 None None] Releasing lock "compute-rpcapi-router" {{(pid=124367) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 06 13:45:54.338248 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-e0429e3e-0ac8-40f9-87a2-c64fc53a6a5f tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] 10.222.0.20 "GET /compute/v2.1/servers/5cf73c2b-28f6-49f1-a119-224c05679d2c" status: 200 len: 1366 microversion: 2.1 time: 0.551170 Jul 06 13:45:54.345476 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 61/99] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:45:53 2022] GET /compute/v2.1/servers/5cf73c2b-28f6-49f1-a119-224c05679d2c => generated 1366 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:45:54.370176 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-31130e2e-69bb-4117-a569-bc8d34079f29 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Calling method '>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:45:54.371904 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-31130e2e-69bb-4117-a569-bc8d34079f29 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] [instance: c801676d-524f-42fc-a2b8-fe4186986d95] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:45:54.392314 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-31130e2e-69bb-4117-a569-bc8d34079f29 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:45:54.393279 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-31130e2e-69bb-4117-a569-bc8d34079f29 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:45:54.394776 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-31130e2e-69bb-4117-a569-bc8d34079f29 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:45:54.399253 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-31130e2e-69bb-4117-a569-bc8d34079f29 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:45:54.400724 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-6557592d-d3bc-4562-9f32-41f24b132ba6 None None] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.271742 Jul 06 13:45:54.402091 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 39/100] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 6 13:45:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 06 13:45:54.683226 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-af95a4a2-a2ca-4980-bb40-a0aebc209ddc tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:45:54.689352 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-af95a4a2-a2ca-4980-bb40-a0aebc209ddc tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] [instance: 965c7a0f-fa3f-4f5c-92bf-94d8b646a9ae] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:45:54.720262 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-af95a4a2-a2ca-4980-bb40-a0aebc209ddc tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:45:54.722097 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-af95a4a2-a2ca-4980-bb40-a0aebc209ddc tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:45:54.723842 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-af95a4a2-a2ca-4980-bb40-a0aebc209ddc tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:45:54.724505 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-af95a4a2-a2ca-4980-bb40-a0aebc209ddc tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:45:54.879863 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-31130e2e-69bb-4117-a569-bc8d34079f29 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c83c05bec4f456d8aa7d51732ddc8af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b2a80a004e04da7ae12db9f3f87146f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:45:54.889708 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-31130e2e-69bb-4117-a569-bc8d34079f29 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] 10.222.0.20 "GET /compute/v2.1/servers/c801676d-524f-42fc-a2b8-fe4186986d95" status: 200 len: 1322 microversion: 2.1 time: 0.541713 Jul 06 13:45:54.899096 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 62/101] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:45:54 2022] GET /compute/v2.1/servers/c801676d-524f-42fc-a2b8-fe4186986d95 => generated 1322 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:45:55.050852 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-af95a4a2-a2ca-4980-bb40-a0aebc209ddc tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad0781ce20e54c3a9b7c61e0cccf6918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd48e24dbeaa241d7a97350fb2c8187b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:45:55.062328 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-af95a4a2-a2ca-4980-bb40-a0aebc209ddc tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] 10.222.0.20 "GET /compute/v2.1/servers/965c7a0f-fa3f-4f5c-92bf-94d8b646a9ae" status: 200 len: 1314 microversion: 2.1 time: 0.395864 Jul 06 13:45:55.074745 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 40/102] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:45:54 2022] GET /compute/v2.1/servers/965c7a0f-fa3f-4f5c-92bf-94d8b646a9ae => generated 1314 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:45:55.144443 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-768102be-4a7a-435e-8495-547d38b0f3fb tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Calling method '>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:45:55.145095 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-768102be-4a7a-435e-8495-547d38b0f3fb tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] [instance: 546a77fd-66e1-4d89-afa3-58d632b09186] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:45:55.150026 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG dbcounter [-] [124368] Writing DB stats nova_api:SELECT=72,nova_api:INSERT=3 {{(pid=124368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:45:55.161363 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-768102be-4a7a-435e-8495-547d38b0f3fb tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:45:55.161831 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-768102be-4a7a-435e-8495-547d38b0f3fb tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:45:55.162663 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-768102be-4a7a-435e-8495-547d38b0f3fb tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:45:55.163096 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-768102be-4a7a-435e-8495-547d38b0f3fb tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:45:55.352185 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-768102be-4a7a-435e-8495-547d38b0f3fb tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d7cacb73c8342579d9f990b0193487c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05df572327d54bd99595974b75898052', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:45:55.355759 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-9d39f1a3-8839-48e6-a5b4-3900655cc5d2 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:45:55.356382 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-9d39f1a3-8839-48e6-a5b4-3900655cc5d2 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] [instance: 5cf73c2b-28f6-49f1-a119-224c05679d2c] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:45:55.362878 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-9d39f1a3-8839-48e6-a5b4-3900655cc5d2 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:45:55.363343 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-9d39f1a3-8839-48e6-a5b4-3900655cc5d2 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:45:55.364646 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-9d39f1a3-8839-48e6-a5b4-3900655cc5d2 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:45:55.365390 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-9d39f1a3-8839-48e6-a5b4-3900655cc5d2 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:45:55.365686 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-768102be-4a7a-435e-8495-547d38b0f3fb tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] 10.222.0.20 "GET /compute/v2.1/servers/546a77fd-66e1-4d89-afa3-58d632b09186" status: 200 len: 1362 microversion: 2.1 time: 0.228972 Jul 06 13:45:55.377444 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 63/103] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:45:55 2022] GET /compute/v2.1/servers/546a77fd-66e1-4d89-afa3-58d632b09186 => generated 1362 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:45:55.527542 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-9d39f1a3-8839-48e6-a5b4-3900655cc5d2 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b572a8f465048558fc969b85b2aec5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd85f2a57a0847debf5aaf81aab7a638', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:45:55.537165 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-9d39f1a3-8839-48e6-a5b4-3900655cc5d2 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] 10.222.0.20 "GET /compute/v2.1/servers/5cf73c2b-28f6-49f1-a119-224c05679d2c" status: 200 len: 1366 microversion: 2.1 time: 0.185465 Jul 06 13:45:55.537843 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 41/104] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:45:55 2022] GET /compute/v2.1/servers/5cf73c2b-28f6-49f1-a119-224c05679d2c => generated 1366 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 06 13:45:55.907713 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-2bcd0e95-089b-4a13-8e16-9fa373f23612 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Calling method '>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:45:55.908586 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-2bcd0e95-089b-4a13-8e16-9fa373f23612 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] [instance: c801676d-524f-42fc-a2b8-fe4186986d95] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:45:55.915871 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-2bcd0e95-089b-4a13-8e16-9fa373f23612 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:45:55.916586 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-2bcd0e95-089b-4a13-8e16-9fa373f23612 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:45:55.917628 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-2bcd0e95-089b-4a13-8e16-9fa373f23612 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:45:55.918259 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-2bcd0e95-089b-4a13-8e16-9fa373f23612 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:45:56.083398 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-2ecfe367-bbf7-4827-b825-a997aba3ecb9 tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:45:56.084735 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-2ecfe367-bbf7-4827-b825-a997aba3ecb9 tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] [instance: 965c7a0f-fa3f-4f5c-92bf-94d8b646a9ae] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:45:56.096562 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-2ecfe367-bbf7-4827-b825-a997aba3ecb9 tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:45:56.097536 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-2ecfe367-bbf7-4827-b825-a997aba3ecb9 tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:45:56.098842 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-2ecfe367-bbf7-4827-b825-a997aba3ecb9 tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:45:56.100812 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-2ecfe367-bbf7-4827-b825-a997aba3ecb9 tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:45:56.109475 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG dbcounter [-] [124367] Writing DB stats nova_cell1:SELECT=91 {{(pid=124367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:45:56.147450 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-2bcd0e95-089b-4a13-8e16-9fa373f23612 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c83c05bec4f456d8aa7d51732ddc8af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b2a80a004e04da7ae12db9f3f87146f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:45:56.158055 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-2bcd0e95-089b-4a13-8e16-9fa373f23612 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] 10.222.0.20 "GET /compute/v2.1/servers/c801676d-524f-42fc-a2b8-fe4186986d95" status: 200 len: 1322 microversion: 2.1 time: 0.254126 Jul 06 13:45:56.158858 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 64/105] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:45:55 2022] GET /compute/v2.1/servers/c801676d-524f-42fc-a2b8-fe4186986d95 => generated 1322 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:45:56.280298 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-2ecfe367-bbf7-4827-b825-a997aba3ecb9 tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad0781ce20e54c3a9b7c61e0cccf6918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd48e24dbeaa241d7a97350fb2c8187b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:45:56.289638 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-2ecfe367-bbf7-4827-b825-a997aba3ecb9 tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] 10.222.0.20 "GET /compute/v2.1/servers/965c7a0f-fa3f-4f5c-92bf-94d8b646a9ae" status: 200 len: 1314 microversion: 2.1 time: 0.211723 Jul 06 13:45:56.291549 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 42/106] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:45:56 2022] GET /compute/v2.1/servers/965c7a0f-fa3f-4f5c-92bf-94d8b646a9ae => generated 1314 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:45:56.390515 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-ac9778e9-15d3-4f98-b5a9-00eb304f7f24 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Calling method '>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:45:56.391641 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-ac9778e9-15d3-4f98-b5a9-00eb304f7f24 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] [instance: 546a77fd-66e1-4d89-afa3-58d632b09186] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:45:56.398741 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-ac9778e9-15d3-4f98-b5a9-00eb304f7f24 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:45:56.399618 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-ac9778e9-15d3-4f98-b5a9-00eb304f7f24 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:45:56.400730 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-ac9778e9-15d3-4f98-b5a9-00eb304f7f24 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:45:56.401608 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-ac9778e9-15d3-4f98-b5a9-00eb304f7f24 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:45:56.556037 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-b8808b40-f930-4f52-a2c3-6ee6e9a9757f tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:45:56.557842 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-b8808b40-f930-4f52-a2c3-6ee6e9a9757f tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] [instance: 5cf73c2b-28f6-49f1-a119-224c05679d2c] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:45:56.564108 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-b8808b40-f930-4f52-a2c3-6ee6e9a9757f tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:45:56.564576 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-b8808b40-f930-4f52-a2c3-6ee6e9a9757f tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:45:56.565395 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-b8808b40-f930-4f52-a2c3-6ee6e9a9757f tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:45:56.565834 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-b8808b40-f930-4f52-a2c3-6ee6e9a9757f tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:45:56.782743 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-b8808b40-f930-4f52-a2c3-6ee6e9a9757f tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b572a8f465048558fc969b85b2aec5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd85f2a57a0847debf5aaf81aab7a638', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:45:56.803368 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-b8808b40-f930-4f52-a2c3-6ee6e9a9757f tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] 10.222.0.20 "GET /compute/v2.1/servers/5cf73c2b-28f6-49f1-a119-224c05679d2c" status: 200 len: 1366 microversion: 2.1 time: 0.251699 Jul 06 13:45:56.804329 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 43/107] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:45:56 2022] GET /compute/v2.1/servers/5cf73c2b-28f6-49f1-a119-224c05679d2c => generated 1366 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:45:56.810595 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [req-6c9d7e4a-92d1-4f0b-bb9d-5d2c20914702 req-96cac7c1-502b-4867-a77a-066ae0ed8bde service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "546a77fd-66e1-4d89-afa3-58d632b09186", "tag": "3ca14d5b-272c-4543-9380-0fbec0da4da8"}]} {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 06 13:45:56.812905 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-ac9778e9-15d3-4f98-b5a9-00eb304f7f24 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d7cacb73c8342579d9f990b0193487c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05df572327d54bd99595974b75898052', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:45:56.820788 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [req-6c9d7e4a-92d1-4f0b-bb9d-5d2c20914702 req-96cac7c1-502b-4867-a77a-066ae0ed8bde service nova] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:45:56.820938 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-ac9778e9-15d3-4f98-b5a9-00eb304f7f24 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] 10.222.0.20 "GET /compute/v2.1/servers/546a77fd-66e1-4d89-afa3-58d632b09186" status: 200 len: 1362 microversion: 2.1 time: 0.434658 Jul 06 13:45:56.821638 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [req-6c9d7e4a-92d1-4f0b-bb9d-5d2c20914702 req-96cac7c1-502b-4867-a77a-066ae0ed8bde service nova] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:45:56.831009 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 65/108] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:45:56 2022] GET /compute/v2.1/servers/546a77fd-66e1-4d89-afa3-58d632b09186 => generated 1362 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:45:56.836558 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.compute.server_external_events [req-6c9d7e4a-92d1-4f0b-bb9d-5d2c20914702 req-96cac7c1-502b-4867-a77a-066ae0ed8bde service nova] Creating event network-changed:3ca14d5b-272c-4543-9380-0fbec0da4da8 for instance 546a77fd-66e1-4d89-afa3-58d632b09186 on hv-cinder-81914 Jul 06 13:45:56.841874 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [req-6c9d7e4a-92d1-4f0b-bb9d-5d2c20914702 req-96cac7c1-502b-4867-a77a-066ae0ed8bde service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035459 Jul 06 13:45:56.843014 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 44/109] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 6 13:45:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 06 13:45:57.175656 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-75fdd119-b7e0-445a-bf75-4b682941d1f2 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Calling method '>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:45:57.176914 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-75fdd119-b7e0-445a-bf75-4b682941d1f2 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] [instance: c801676d-524f-42fc-a2b8-fe4186986d95] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:45:57.183137 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-75fdd119-b7e0-445a-bf75-4b682941d1f2 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:45:57.183651 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-75fdd119-b7e0-445a-bf75-4b682941d1f2 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:45:57.184503 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-75fdd119-b7e0-445a-bf75-4b682941d1f2 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:45:57.185183 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-75fdd119-b7e0-445a-bf75-4b682941d1f2 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:45:57.315564 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-2e749001-1752-4bd5-86e6-56f5a43e450f tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:45:57.317745 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-2e749001-1752-4bd5-86e6-56f5a43e450f tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] [instance: 965c7a0f-fa3f-4f5c-92bf-94d8b646a9ae] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:45:57.327698 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-2e749001-1752-4bd5-86e6-56f5a43e450f tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:45:57.328676 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-2e749001-1752-4bd5-86e6-56f5a43e450f tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:45:57.330461 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-2e749001-1752-4bd5-86e6-56f5a43e450f tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:45:57.331074 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-2e749001-1752-4bd5-86e6-56f5a43e450f tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:45:57.507614 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-2e749001-1752-4bd5-86e6-56f5a43e450f tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad0781ce20e54c3a9b7c61e0cccf6918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd48e24dbeaa241d7a97350fb2c8187b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:45:57.525860 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-2e749001-1752-4bd5-86e6-56f5a43e450f tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] 10.222.0.20 "GET /compute/v2.1/servers/965c7a0f-fa3f-4f5c-92bf-94d8b646a9ae" status: 200 len: 1314 microversion: 2.1 time: 0.212933 Jul 06 13:45:57.525860 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 45/110] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:45:57 2022] GET /compute/v2.1/servers/965c7a0f-fa3f-4f5c-92bf-94d8b646a9ae => generated 1314 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:45:57.820571 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-1e15e2a1-da9b-48a3-bd0e-732dcc3fc615 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:45:57.821832 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-1e15e2a1-da9b-48a3-bd0e-732dcc3fc615 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] [instance: 5cf73c2b-28f6-49f1-a119-224c05679d2c] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:45:57.828627 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-1e15e2a1-da9b-48a3-bd0e-732dcc3fc615 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:45:57.829197 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-1e15e2a1-da9b-48a3-bd0e-732dcc3fc615 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:45:57.830073 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-1e15e2a1-da9b-48a3-bd0e-732dcc3fc615 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:45:57.831954 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-1e15e2a1-da9b-48a3-bd0e-732dcc3fc615 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:45:58.028791 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-1e15e2a1-da9b-48a3-bd0e-732dcc3fc615 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b572a8f465048558fc969b85b2aec5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd85f2a57a0847debf5aaf81aab7a638', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:45:58.030993 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-75fdd119-b7e0-445a-bf75-4b682941d1f2 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c83c05bec4f456d8aa7d51732ddc8af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b2a80a004e04da7ae12db9f3f87146f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:45:58.040181 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-1e15e2a1-da9b-48a3-bd0e-732dcc3fc615 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] 10.222.0.20 "GET /compute/v2.1/servers/5cf73c2b-28f6-49f1-a119-224c05679d2c" status: 200 len: 1366 microversion: 2.1 time: 0.223379 Jul 06 13:45:58.041453 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 46/111] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:45:57 2022] GET /compute/v2.1/servers/5cf73c2b-28f6-49f1-a119-224c05679d2c => generated 1366 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 06 13:45:58.043714 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-75fdd119-b7e0-445a-bf75-4b682941d1f2 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] 10.222.0.20 "GET /compute/v2.1/servers/c801676d-524f-42fc-a2b8-fe4186986d95" status: 200 len: 1322 microversion: 2.1 time: 0.871446 Jul 06 13:45:58.044446 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 66/112] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:45:57 2022] GET /compute/v2.1/servers/c801676d-524f-42fc-a2b8-fe4186986d95 => generated 1322 bytes in 873 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:45:58.058657 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-3a7d4bbb-e243-42ed-b616-f4f46c2dc26b tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:45:58.059276 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-3a7d4bbb-e243-42ed-b616-f4f46c2dc26b tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] [instance: 546a77fd-66e1-4d89-afa3-58d632b09186] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:45:58.065713 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-3a7d4bbb-e243-42ed-b616-f4f46c2dc26b tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:45:58.066426 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-3a7d4bbb-e243-42ed-b616-f4f46c2dc26b tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:45:58.067896 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-3a7d4bbb-e243-42ed-b616-f4f46c2dc26b tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:45:58.068355 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-3a7d4bbb-e243-42ed-b616-f4f46c2dc26b tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:45:58.217355 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-3a7d4bbb-e243-42ed-b616-f4f46c2dc26b tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d7cacb73c8342579d9f990b0193487c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05df572327d54bd99595974b75898052', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:45:58.228160 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-3a7d4bbb-e243-42ed-b616-f4f46c2dc26b tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] 10.222.0.20 "GET /compute/v2.1/servers/546a77fd-66e1-4d89-afa3-58d632b09186" status: 200 len: 1362 microversion: 2.1 time: 0.183166 Jul 06 13:45:58.228354 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 47/113] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:45:58 2022] GET /compute/v2.1/servers/546a77fd-66e1-4d89-afa3-58d632b09186 => generated 1362 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:45:58.533626 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-43ea8965-7047-4719-81ce-8c24ad872e78 tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] Calling method '>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:45:58.534246 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-43ea8965-7047-4719-81ce-8c24ad872e78 tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] [instance: 965c7a0f-fa3f-4f5c-92bf-94d8b646a9ae] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:45:58.542591 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-43ea8965-7047-4719-81ce-8c24ad872e78 tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:45:58.542949 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-43ea8965-7047-4719-81ce-8c24ad872e78 tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:45:58.543733 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-43ea8965-7047-4719-81ce-8c24ad872e78 tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:45:58.544166 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-43ea8965-7047-4719-81ce-8c24ad872e78 tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:45:58.704667 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-43ea8965-7047-4719-81ce-8c24ad872e78 tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad0781ce20e54c3a9b7c61e0cccf6918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd48e24dbeaa241d7a97350fb2c8187b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:45:58.712271 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-43ea8965-7047-4719-81ce-8c24ad872e78 tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] 10.222.0.20 "GET /compute/v2.1/servers/965c7a0f-fa3f-4f5c-92bf-94d8b646a9ae" status: 200 len: 1314 microversion: 2.1 time: 0.182534 Jul 06 13:45:58.712841 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 67/114] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:45:58 2022] GET /compute/v2.1/servers/965c7a0f-fa3f-4f5c-92bf-94d8b646a9ae => generated 1314 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:45:59.058930 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-14da78ba-e122-4011-9bd6-eac0f2f8bfee tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:45:59.059685 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-14da78ba-e122-4011-9bd6-eac0f2f8bfee tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] [instance: 5cf73c2b-28f6-49f1-a119-224c05679d2c] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:45:59.061793 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-5f1dfb8d-7492-4cd5-b869-a05db5a56af2 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Calling method '>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:45:59.062571 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-5f1dfb8d-7492-4cd5-b869-a05db5a56af2 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] [instance: c801676d-524f-42fc-a2b8-fe4186986d95] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:45:59.069580 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-14da78ba-e122-4011-9bd6-eac0f2f8bfee tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:45:59.070265 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-5f1dfb8d-7492-4cd5-b869-a05db5a56af2 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:45:59.071024 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-5f1dfb8d-7492-4cd5-b869-a05db5a56af2 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:45:59.071847 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-14da78ba-e122-4011-9bd6-eac0f2f8bfee tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:45:59.072223 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-5f1dfb8d-7492-4cd5-b869-a05db5a56af2 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:45:59.072847 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-5f1dfb8d-7492-4cd5-b869-a05db5a56af2 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:45:59.073860 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-14da78ba-e122-4011-9bd6-eac0f2f8bfee tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:45:59.075069 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-14da78ba-e122-4011-9bd6-eac0f2f8bfee tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:45:59.288384 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-14da78ba-e122-4011-9bd6-eac0f2f8bfee tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b572a8f465048558fc969b85b2aec5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd85f2a57a0847debf5aaf81aab7a638', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:45:59.312763 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-14da78ba-e122-4011-9bd6-eac0f2f8bfee tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] 10.222.0.20 "GET /compute/v2.1/servers/5cf73c2b-28f6-49f1-a119-224c05679d2c" status: 200 len: 1366 microversion: 2.1 time: 0.259352 Jul 06 13:45:59.313901 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 48/115] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:45:59 2022] GET /compute/v2.1/servers/5cf73c2b-28f6-49f1-a119-224c05679d2c => generated 1366 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:45:59.320648 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-68149dbc-e2f1-4fa8-989c-86c4dd783ff6 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:45:59.321917 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-68149dbc-e2f1-4fa8-989c-86c4dd783ff6 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] [instance: 546a77fd-66e1-4d89-afa3-58d632b09186] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:45:59.328710 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-68149dbc-e2f1-4fa8-989c-86c4dd783ff6 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:45:59.329427 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-68149dbc-e2f1-4fa8-989c-86c4dd783ff6 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:45:59.330375 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-68149dbc-e2f1-4fa8-989c-86c4dd783ff6 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:45:59.330951 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-68149dbc-e2f1-4fa8-989c-86c4dd783ff6 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:45:59.372273 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-5f1dfb8d-7492-4cd5-b869-a05db5a56af2 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c83c05bec4f456d8aa7d51732ddc8af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b2a80a004e04da7ae12db9f3f87146f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:45:59.383641 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-5f1dfb8d-7492-4cd5-b869-a05db5a56af2 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] 10.222.0.20 "GET /compute/v2.1/servers/c801676d-524f-42fc-a2b8-fe4186986d95" status: 200 len: 1322 microversion: 2.1 time: 0.326165 Jul 06 13:45:59.384436 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 68/116] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:45:59 2022] GET /compute/v2.1/servers/c801676d-524f-42fc-a2b8-fe4186986d95 => generated 1322 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 06 13:45:59.546116 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-68149dbc-e2f1-4fa8-989c-86c4dd783ff6 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d7cacb73c8342579d9f990b0193487c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05df572327d54bd99595974b75898052', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:45:59.554812 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-68149dbc-e2f1-4fa8-989c-86c4dd783ff6 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] 10.222.0.20 "GET /compute/v2.1/servers/546a77fd-66e1-4d89-afa3-58d632b09186" status: 200 len: 1362 microversion: 2.1 time: 0.238989 Jul 06 13:45:59.555642 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 49/117] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:45:59 2022] GET /compute/v2.1/servers/546a77fd-66e1-4d89-afa3-58d632b09186 => generated 1362 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:45:59.729012 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-5c0a37d9-bead-4469-9faa-1849ef7ec9ed tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] Calling method '>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:45:59.729878 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-5c0a37d9-bead-4469-9faa-1849ef7ec9ed tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] [instance: 965c7a0f-fa3f-4f5c-92bf-94d8b646a9ae] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:45:59.736565 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-5c0a37d9-bead-4469-9faa-1849ef7ec9ed tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:45:59.737207 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-5c0a37d9-bead-4469-9faa-1849ef7ec9ed tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:45:59.738126 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-5c0a37d9-bead-4469-9faa-1849ef7ec9ed tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:45:59.738754 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-5c0a37d9-bead-4469-9faa-1849ef7ec9ed tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:45:59.910098 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-5c0a37d9-bead-4469-9faa-1849ef7ec9ed tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad0781ce20e54c3a9b7c61e0cccf6918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd48e24dbeaa241d7a97350fb2c8187b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:45:59.920422 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-5c0a37d9-bead-4469-9faa-1849ef7ec9ed tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] 10.222.0.20 "GET /compute/v2.1/servers/965c7a0f-fa3f-4f5c-92bf-94d8b646a9ae" status: 200 len: 1314 microversion: 2.1 time: 0.195111 Jul 06 13:45:59.921610 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 69/118] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:45:59 2022] GET /compute/v2.1/servers/965c7a0f-fa3f-4f5c-92bf-94d8b646a9ae => generated 1314 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:46:00.331105 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-1fff1136-cde0-44e3-98e8-8dee0ddf198a tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:46:00.331725 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-1fff1136-cde0-44e3-98e8-8dee0ddf198a tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] [instance: 5cf73c2b-28f6-49f1-a119-224c05679d2c] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:46:00.339690 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-1fff1136-cde0-44e3-98e8-8dee0ddf198a tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:46:00.340258 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-1fff1136-cde0-44e3-98e8-8dee0ddf198a tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:46:00.341088 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-1fff1136-cde0-44e3-98e8-8dee0ddf198a tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:46:00.341972 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-1fff1136-cde0-44e3-98e8-8dee0ddf198a tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:46:00.403573 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-b82b5eb5-1ef5-454b-bd08-a7f6347887f5 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Calling method '>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:46:00.404969 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-b82b5eb5-1ef5-454b-bd08-a7f6347887f5 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] [instance: c801676d-524f-42fc-a2b8-fe4186986d95] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:46:00.409607 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG dbcounter [-] [124368] Writing DB stats nova_cell0:SELECT=4 {{(pid=124368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:46:00.414890 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-b82b5eb5-1ef5-454b-bd08-a7f6347887f5 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:46:00.415745 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-b82b5eb5-1ef5-454b-bd08-a7f6347887f5 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:46:00.416896 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-b82b5eb5-1ef5-454b-bd08-a7f6347887f5 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:46:00.417534 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-b82b5eb5-1ef5-454b-bd08-a7f6347887f5 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:46:00.540097 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-1fff1136-cde0-44e3-98e8-8dee0ddf198a tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b572a8f465048558fc969b85b2aec5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd85f2a57a0847debf5aaf81aab7a638', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:46:00.552237 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-1fff1136-cde0-44e3-98e8-8dee0ddf198a tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] 10.222.0.20 "GET /compute/v2.1/servers/5cf73c2b-28f6-49f1-a119-224c05679d2c" status: 200 len: 1366 microversion: 2.1 time: 0.223312 Jul 06 13:46:00.558355 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 50/119] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:46:00 2022] GET /compute/v2.1/servers/5cf73c2b-28f6-49f1-a119-224c05679d2c => generated 1366 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:46:00.574544 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-580f8490-71e3-4939-8929-0fdf8b837222 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:46:00.575065 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-580f8490-71e3-4939-8929-0fdf8b837222 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] [instance: 546a77fd-66e1-4d89-afa3-58d632b09186] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:46:00.581560 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-580f8490-71e3-4939-8929-0fdf8b837222 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:46:00.582169 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-580f8490-71e3-4939-8929-0fdf8b837222 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:46:00.583028 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-580f8490-71e3-4939-8929-0fdf8b837222 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:46:00.583548 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-580f8490-71e3-4939-8929-0fdf8b837222 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:46:00.604551 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-b82b5eb5-1ef5-454b-bd08-a7f6347887f5 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c83c05bec4f456d8aa7d51732ddc8af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b2a80a004e04da7ae12db9f3f87146f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:46:00.617918 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-b82b5eb5-1ef5-454b-bd08-a7f6347887f5 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] 10.222.0.20 "GET /compute/v2.1/servers/c801676d-524f-42fc-a2b8-fe4186986d95" status: 200 len: 1322 microversion: 2.1 time: 0.217369 Jul 06 13:46:00.618871 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 70/120] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:46:00 2022] GET /compute/v2.1/servers/c801676d-524f-42fc-a2b8-fe4186986d95 => generated 1322 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:46:00.738914 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-580f8490-71e3-4939-8929-0fdf8b837222 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d7cacb73c8342579d9f990b0193487c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05df572327d54bd99595974b75898052', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:46:00.748224 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-580f8490-71e3-4939-8929-0fdf8b837222 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] 10.222.0.20 "GET /compute/v2.1/servers/546a77fd-66e1-4d89-afa3-58d632b09186" status: 200 len: 1362 microversion: 2.1 time: 0.179207 Jul 06 13:46:00.749187 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 51/121] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:46:00 2022] GET /compute/v2.1/servers/546a77fd-66e1-4d89-afa3-58d632b09186 => generated 1362 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:46:00.941211 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-2d43ff77-1472-48ae-869d-371787bc5255 tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] Calling method '>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:46:00.941211 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-2d43ff77-1472-48ae-869d-371787bc5255 tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] [instance: 965c7a0f-fa3f-4f5c-92bf-94d8b646a9ae] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:46:00.948503 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-2d43ff77-1472-48ae-869d-371787bc5255 tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:46:00.948503 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-2d43ff77-1472-48ae-869d-371787bc5255 tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:46:00.950909 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-2d43ff77-1472-48ae-869d-371787bc5255 tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:46:00.955135 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-2d43ff77-1472-48ae-869d-371787bc5255 tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:46:01.110131 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-2d43ff77-1472-48ae-869d-371787bc5255 tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad0781ce20e54c3a9b7c61e0cccf6918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd48e24dbeaa241d7a97350fb2c8187b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:46:01.118034 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-2d43ff77-1472-48ae-869d-371787bc5255 tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] 10.222.0.20 "GET /compute/v2.1/servers/965c7a0f-fa3f-4f5c-92bf-94d8b646a9ae" status: 200 len: 1314 microversion: 2.1 time: 0.183043 Jul 06 13:46:01.118608 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 71/122] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:46:00 2022] GET /compute/v2.1/servers/965c7a0f-fa3f-4f5c-92bf-94d8b646a9ae => generated 1314 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:46:01.577504 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-52f8fe57-3c9d-488c-a2ef-84648cd2a9ea tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:46:01.578117 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-52f8fe57-3c9d-488c-a2ef-84648cd2a9ea tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] [instance: 5cf73c2b-28f6-49f1-a119-224c05679d2c] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:46:01.584340 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-52f8fe57-3c9d-488c-a2ef-84648cd2a9ea tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:46:01.584891 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-52f8fe57-3c9d-488c-a2ef-84648cd2a9ea tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:46:01.586096 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-52f8fe57-3c9d-488c-a2ef-84648cd2a9ea tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:46:01.586625 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-52f8fe57-3c9d-488c-a2ef-84648cd2a9ea tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:46:01.640005 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-9f471ea6-3288-48f8-bc23-674b548cf768 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Calling method '>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:46:01.641368 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-9f471ea6-3288-48f8-bc23-674b548cf768 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] [instance: c801676d-524f-42fc-a2b8-fe4186986d95] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:46:01.649156 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-9f471ea6-3288-48f8-bc23-674b548cf768 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:46:01.650012 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-9f471ea6-3288-48f8-bc23-674b548cf768 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:46:01.650851 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-9f471ea6-3288-48f8-bc23-674b548cf768 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:46:01.651731 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-9f471ea6-3288-48f8-bc23-674b548cf768 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:46:01.751179 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-52f8fe57-3c9d-488c-a2ef-84648cd2a9ea tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b572a8f465048558fc969b85b2aec5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd85f2a57a0847debf5aaf81aab7a638', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:46:01.759585 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-52f8fe57-3c9d-488c-a2ef-84648cd2a9ea tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] 10.222.0.20 "GET /compute/v2.1/servers/5cf73c2b-28f6-49f1-a119-224c05679d2c" status: 200 len: 1366 microversion: 2.1 time: 0.186293 Jul 06 13:46:01.771167 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 52/123] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:46:01 2022] GET /compute/v2.1/servers/5cf73c2b-28f6-49f1-a119-224c05679d2c => generated 1366 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 06 13:46:01.778197 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-bcfd2059-883a-4011-989b-5cd05b009948 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:46:01.779018 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-bcfd2059-883a-4011-989b-5cd05b009948 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] [instance: 546a77fd-66e1-4d89-afa3-58d632b09186] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:46:01.785466 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-bcfd2059-883a-4011-989b-5cd05b009948 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:46:01.786110 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-bcfd2059-883a-4011-989b-5cd05b009948 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:46:01.787063 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-bcfd2059-883a-4011-989b-5cd05b009948 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:46:01.787738 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-bcfd2059-883a-4011-989b-5cd05b009948 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:46:01.873952 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-9f471ea6-3288-48f8-bc23-674b548cf768 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c83c05bec4f456d8aa7d51732ddc8af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b2a80a004e04da7ae12db9f3f87146f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:46:01.882558 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-9f471ea6-3288-48f8-bc23-674b548cf768 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] 10.222.0.20 "GET /compute/v2.1/servers/c801676d-524f-42fc-a2b8-fe4186986d95" status: 200 len: 1322 microversion: 2.1 time: 0.246769 Jul 06 13:46:01.884029 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 72/124] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:46:01 2022] GET /compute/v2.1/servers/c801676d-524f-42fc-a2b8-fe4186986d95 => generated 1322 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:46:01.938372 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-bcfd2059-883a-4011-989b-5cd05b009948 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d7cacb73c8342579d9f990b0193487c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05df572327d54bd99595974b75898052', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:46:01.946282 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-bcfd2059-883a-4011-989b-5cd05b009948 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] 10.222.0.20 "GET /compute/v2.1/servers/546a77fd-66e1-4d89-afa3-58d632b09186" status: 200 len: 1362 microversion: 2.1 time: 0.173619 Jul 06 13:46:01.946841 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 53/125] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:46:01 2022] GET /compute/v2.1/servers/546a77fd-66e1-4d89-afa3-58d632b09186 => generated 1362 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:46:02.136180 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-e56b2ee6-a758-4ef4-8b68-a4103cb6e31a tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] Calling method '>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:46:02.136828 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-e56b2ee6-a758-4ef4-8b68-a4103cb6e31a tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] [instance: 965c7a0f-fa3f-4f5c-92bf-94d8b646a9ae] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:46:02.143289 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-e56b2ee6-a758-4ef4-8b68-a4103cb6e31a tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:46:02.143821 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-e56b2ee6-a758-4ef4-8b68-a4103cb6e31a tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:46:02.144673 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-e56b2ee6-a758-4ef4-8b68-a4103cb6e31a tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:46:02.145137 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-e56b2ee6-a758-4ef4-8b68-a4103cb6e31a tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:46:02.290655 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-e56b2ee6-a758-4ef4-8b68-a4103cb6e31a tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad0781ce20e54c3a9b7c61e0cccf6918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd48e24dbeaa241d7a97350fb2c8187b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:46:02.299707 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-e56b2ee6-a758-4ef4-8b68-a4103cb6e31a tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] 10.222.0.20 "GET /compute/v2.1/servers/965c7a0f-fa3f-4f5c-92bf-94d8b646a9ae" status: 200 len: 1314 microversion: 2.1 time: 0.167912 Jul 06 13:46:02.300353 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 73/126] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:46:02 2022] GET /compute/v2.1/servers/965c7a0f-fa3f-4f5c-92bf-94d8b646a9ae => generated 1314 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:46:02.779278 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-b8fb397c-9f13-44ee-8944-2ee0885fb8d4 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:46:02.780366 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-b8fb397c-9f13-44ee-8944-2ee0885fb8d4 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] [instance: 5cf73c2b-28f6-49f1-a119-224c05679d2c] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:46:02.786930 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-b8fb397c-9f13-44ee-8944-2ee0885fb8d4 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:46:02.787482 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-b8fb397c-9f13-44ee-8944-2ee0885fb8d4 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:46:02.788906 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-b8fb397c-9f13-44ee-8944-2ee0885fb8d4 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:46:02.789639 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-b8fb397c-9f13-44ee-8944-2ee0885fb8d4 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:46:02.900145 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-6e078a69-90ba-4eb6-8f48-3d6fde90666f tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Calling method '>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:46:02.901230 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-6e078a69-90ba-4eb6-8f48-3d6fde90666f tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] [instance: c801676d-524f-42fc-a2b8-fe4186986d95] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:46:02.907094 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-6e078a69-90ba-4eb6-8f48-3d6fde90666f tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:46:02.907542 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-6e078a69-90ba-4eb6-8f48-3d6fde90666f tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:46:02.908295 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-6e078a69-90ba-4eb6-8f48-3d6fde90666f tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:46:02.908728 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-6e078a69-90ba-4eb6-8f48-3d6fde90666f tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:46:02.921908 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-b8fb397c-9f13-44ee-8944-2ee0885fb8d4 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b572a8f465048558fc969b85b2aec5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd85f2a57a0847debf5aaf81aab7a638', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:46:02.932477 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-b8fb397c-9f13-44ee-8944-2ee0885fb8d4 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] 10.222.0.20 "GET /compute/v2.1/servers/5cf73c2b-28f6-49f1-a119-224c05679d2c" status: 200 len: 1366 microversion: 2.1 time: 0.157864 Jul 06 13:46:02.933466 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 54/127] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:46:02 2022] GET /compute/v2.1/servers/5cf73c2b-28f6-49f1-a119-224c05679d2c => generated 1366 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:46:02.963010 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-a83726c0-1b3b-4db0-a8d8-5778321bc0cf tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:46:02.963651 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-a83726c0-1b3b-4db0-a8d8-5778321bc0cf tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] [instance: 546a77fd-66e1-4d89-afa3-58d632b09186] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:46:02.970074 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-a83726c0-1b3b-4db0-a8d8-5778321bc0cf tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:46:02.970530 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-a83726c0-1b3b-4db0-a8d8-5778321bc0cf tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:46:02.971329 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-a83726c0-1b3b-4db0-a8d8-5778321bc0cf tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:46:02.971763 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-a83726c0-1b3b-4db0-a8d8-5778321bc0cf tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:46:03.051711 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-6e078a69-90ba-4eb6-8f48-3d6fde90666f tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c83c05bec4f456d8aa7d51732ddc8af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b2a80a004e04da7ae12db9f3f87146f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:46:03.059332 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-6e078a69-90ba-4eb6-8f48-3d6fde90666f tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] 10.222.0.20 "GET /compute/v2.1/servers/c801676d-524f-42fc-a2b8-fe4186986d95" status: 200 len: 1322 microversion: 2.1 time: 0.163564 Jul 06 13:46:03.059895 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 74/128] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:46:02 2022] GET /compute/v2.1/servers/c801676d-524f-42fc-a2b8-fe4186986d95 => generated 1322 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 06 13:46:03.105351 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-a83726c0-1b3b-4db0-a8d8-5778321bc0cf tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d7cacb73c8342579d9f990b0193487c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05df572327d54bd99595974b75898052', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:46:03.112799 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-a83726c0-1b3b-4db0-a8d8-5778321bc0cf tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] 10.222.0.20 "GET /compute/v2.1/servers/546a77fd-66e1-4d89-afa3-58d632b09186" status: 200 len: 1362 microversion: 2.1 time: 0.154404 Jul 06 13:46:03.113401 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 55/129] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:46:02 2022] GET /compute/v2.1/servers/546a77fd-66e1-4d89-afa3-58d632b09186 => generated 1362 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 06 13:46:03.317305 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-fb509d1d-6913-4d33-a796-57995cc01d8f tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] Calling method '>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:46:03.318014 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-fb509d1d-6913-4d33-a796-57995cc01d8f tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] [instance: 965c7a0f-fa3f-4f5c-92bf-94d8b646a9ae] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:46:03.324597 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-fb509d1d-6913-4d33-a796-57995cc01d8f tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:46:03.325079 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-fb509d1d-6913-4d33-a796-57995cc01d8f tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:46:03.325844 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-fb509d1d-6913-4d33-a796-57995cc01d8f tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:46:03.326276 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-fb509d1d-6913-4d33-a796-57995cc01d8f tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:46:03.345209 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG dbcounter [-] [124368] Writing DB stats nova_cell1:SELECT=100 {{(pid=124368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:46:03.459074 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-fb509d1d-6913-4d33-a796-57995cc01d8f tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad0781ce20e54c3a9b7c61e0cccf6918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd48e24dbeaa241d7a97350fb2c8187b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:46:03.467129 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-fb509d1d-6913-4d33-a796-57995cc01d8f tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] 10.222.0.20 "GET /compute/v2.1/servers/965c7a0f-fa3f-4f5c-92bf-94d8b646a9ae" status: 200 len: 1314 microversion: 2.1 time: 0.153655 Jul 06 13:46:03.467691 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 75/130] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:46:03 2022] GET /compute/v2.1/servers/965c7a0f-fa3f-4f5c-92bf-94d8b646a9ae => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:46:03.949367 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-5730b09d-4215-49e5-bb7d-37409524f2d4 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:46:03.949981 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-5730b09d-4215-49e5-bb7d-37409524f2d4 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] [instance: 5cf73c2b-28f6-49f1-a119-224c05679d2c] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:46:03.956096 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-5730b09d-4215-49e5-bb7d-37409524f2d4 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:46:03.956549 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-5730b09d-4215-49e5-bb7d-37409524f2d4 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:46:03.957338 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-5730b09d-4215-49e5-bb7d-37409524f2d4 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:46:03.957773 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-5730b09d-4215-49e5-bb7d-37409524f2d4 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:46:04.076397 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-3f44a5eb-b636-4d57-b1ff-b83b0fed61a7 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Calling method '>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:46:04.077030 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-3f44a5eb-b636-4d57-b1ff-b83b0fed61a7 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] [instance: c801676d-524f-42fc-a2b8-fe4186986d95] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:46:04.082963 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-3f44a5eb-b636-4d57-b1ff-b83b0fed61a7 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:46:04.083357 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-3f44a5eb-b636-4d57-b1ff-b83b0fed61a7 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:46:04.084118 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-3f44a5eb-b636-4d57-b1ff-b83b0fed61a7 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:46:04.084558 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-3f44a5eb-b636-4d57-b1ff-b83b0fed61a7 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:46:04.089650 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-5730b09d-4215-49e5-bb7d-37409524f2d4 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b572a8f465048558fc969b85b2aec5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd85f2a57a0847debf5aaf81aab7a638', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:46:04.097125 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-5730b09d-4215-49e5-bb7d-37409524f2d4 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] 10.222.0.20 "GET /compute/v2.1/servers/5cf73c2b-28f6-49f1-a119-224c05679d2c" status: 200 len: 1366 microversion: 2.1 time: 0.152343 Jul 06 13:46:04.097693 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 56/131] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:46:03 2022] GET /compute/v2.1/servers/5cf73c2b-28f6-49f1-a119-224c05679d2c => generated 1366 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:46:04.129096 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-17a2c825-4524-4064-ac14-07f59dbeec99 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:46:04.130190 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-17a2c825-4524-4064-ac14-07f59dbeec99 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] [instance: 546a77fd-66e1-4d89-afa3-58d632b09186] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:46:04.136769 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-17a2c825-4524-4064-ac14-07f59dbeec99 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:46:04.137248 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-17a2c825-4524-4064-ac14-07f59dbeec99 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:46:04.138007 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-17a2c825-4524-4064-ac14-07f59dbeec99 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:46:04.138436 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-17a2c825-4524-4064-ac14-07f59dbeec99 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:46:04.220181 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-3f44a5eb-b636-4d57-b1ff-b83b0fed61a7 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c83c05bec4f456d8aa7d51732ddc8af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b2a80a004e04da7ae12db9f3f87146f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:46:04.228215 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-3f44a5eb-b636-4d57-b1ff-b83b0fed61a7 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] 10.222.0.20 "GET /compute/v2.1/servers/c801676d-524f-42fc-a2b8-fe4186986d95" status: 200 len: 1322 microversion: 2.1 time: 0.155582 Jul 06 13:46:04.228882 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 76/132] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:46:04 2022] GET /compute/v2.1/servers/c801676d-524f-42fc-a2b8-fe4186986d95 => generated 1322 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 06 13:46:04.267161 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-17a2c825-4524-4064-ac14-07f59dbeec99 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d7cacb73c8342579d9f990b0193487c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05df572327d54bd99595974b75898052', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:46:04.274911 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-17a2c825-4524-4064-ac14-07f59dbeec99 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] 10.222.0.20 "GET /compute/v2.1/servers/546a77fd-66e1-4d89-afa3-58d632b09186" status: 200 len: 1362 microversion: 2.1 time: 0.149654 Jul 06 13:46:04.275481 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 57/133] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:46:04 2022] GET /compute/v2.1/servers/546a77fd-66e1-4d89-afa3-58d632b09186 => generated 1362 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 06 13:46:04.483448 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-61b0913b-2a41-42a6-8a49-92dc9316de60 tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] Calling method '>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:46:04.484058 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-61b0913b-2a41-42a6-8a49-92dc9316de60 tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] [instance: 965c7a0f-fa3f-4f5c-92bf-94d8b646a9ae] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:46:04.490034 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-61b0913b-2a41-42a6-8a49-92dc9316de60 tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:46:04.490478 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-61b0913b-2a41-42a6-8a49-92dc9316de60 tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:46:04.491226 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-61b0913b-2a41-42a6-8a49-92dc9316de60 tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:46:04.492380 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-61b0913b-2a41-42a6-8a49-92dc9316de60 tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:46:04.624446 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-61b0913b-2a41-42a6-8a49-92dc9316de60 tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad0781ce20e54c3a9b7c61e0cccf6918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd48e24dbeaa241d7a97350fb2c8187b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:46:04.633211 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-61b0913b-2a41-42a6-8a49-92dc9316de60 tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] 10.222.0.20 "GET /compute/v2.1/servers/965c7a0f-fa3f-4f5c-92bf-94d8b646a9ae" status: 200 len: 1314 microversion: 2.1 time: 0.153435 Jul 06 13:46:04.634049 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 77/134] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:46:04 2022] GET /compute/v2.1/servers/965c7a0f-fa3f-4f5c-92bf-94d8b646a9ae => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:46:05.114797 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-43f6e8ea-0e10-4177-834e-95d99af51f53 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:46:05.115436 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-43f6e8ea-0e10-4177-834e-95d99af51f53 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] [instance: 5cf73c2b-28f6-49f1-a119-224c05679d2c] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:46:05.119286 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG dbcounter [-] [124367] Writing DB stats nova_cell0:SELECT=2 {{(pid=124367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:46:05.126220 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-43f6e8ea-0e10-4177-834e-95d99af51f53 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:46:05.127008 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-43f6e8ea-0e10-4177-834e-95d99af51f53 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:46:05.128319 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-43f6e8ea-0e10-4177-834e-95d99af51f53 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:46:05.129119 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-43f6e8ea-0e10-4177-834e-95d99af51f53 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:46:05.244826 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-c8021e22-9940-4720-99c6-46bc6a85d0e6 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Calling method '>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:46:05.245477 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-c8021e22-9940-4720-99c6-46bc6a85d0e6 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] [instance: c801676d-524f-42fc-a2b8-fe4186986d95] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:46:05.251593 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-c8021e22-9940-4720-99c6-46bc6a85d0e6 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:46:05.252045 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-c8021e22-9940-4720-99c6-46bc6a85d0e6 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:46:05.252809 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-c8021e22-9940-4720-99c6-46bc6a85d0e6 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:46:05.253273 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-c8021e22-9940-4720-99c6-46bc6a85d0e6 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:46:05.276796 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-43f6e8ea-0e10-4177-834e-95d99af51f53 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b572a8f465048558fc969b85b2aec5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd85f2a57a0847debf5aaf81aab7a638', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:46:05.284879 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-43f6e8ea-0e10-4177-834e-95d99af51f53 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] 10.222.0.20 "GET /compute/v2.1/servers/5cf73c2b-28f6-49f1-a119-224c05679d2c" status: 200 len: 1366 microversion: 2.1 time: 0.174809 Jul 06 13:46:05.285598 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 58/135] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:46:05 2022] GET /compute/v2.1/servers/5cf73c2b-28f6-49f1-a119-224c05679d2c => generated 1366 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:46:05.294236 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-f344c9f4-8a2a-472c-b72d-6c5d97968a5b tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:46:05.294836 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-f344c9f4-8a2a-472c-b72d-6c5d97968a5b tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] [instance: 546a77fd-66e1-4d89-afa3-58d632b09186] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:46:05.301835 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-f344c9f4-8a2a-472c-b72d-6c5d97968a5b tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:46:05.301835 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-f344c9f4-8a2a-472c-b72d-6c5d97968a5b tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:46:05.305027 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-f344c9f4-8a2a-472c-b72d-6c5d97968a5b tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:46:05.305027 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-f344c9f4-8a2a-472c-b72d-6c5d97968a5b tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:46:05.320300 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG dbcounter [-] [124367] Writing DB stats nova_cell1:SELECT=100 {{(pid=124367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:46:05.400873 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-c8021e22-9940-4720-99c6-46bc6a85d0e6 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c83c05bec4f456d8aa7d51732ddc8af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b2a80a004e04da7ae12db9f3f87146f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:46:05.411377 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-c8021e22-9940-4720-99c6-46bc6a85d0e6 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] 10.222.0.20 "GET /compute/v2.1/servers/c801676d-524f-42fc-a2b8-fe4186986d95" status: 200 len: 1322 microversion: 2.1 time: 0.170538 Jul 06 13:46:05.412212 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 78/136] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:46:05 2022] GET /compute/v2.1/servers/c801676d-524f-42fc-a2b8-fe4186986d95 => generated 1322 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 06 13:46:05.445524 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-f344c9f4-8a2a-472c-b72d-6c5d97968a5b tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d7cacb73c8342579d9f990b0193487c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05df572327d54bd99595974b75898052', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:46:05.453393 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-f344c9f4-8a2a-472c-b72d-6c5d97968a5b tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] 10.222.0.20 "GET /compute/v2.1/servers/546a77fd-66e1-4d89-afa3-58d632b09186" status: 200 len: 1362 microversion: 2.1 time: 0.162904 Jul 06 13:46:05.454295 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 59/137] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:46:05 2022] GET /compute/v2.1/servers/546a77fd-66e1-4d89-afa3-58d632b09186 => generated 1362 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 06 13:46:05.649566 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-b546bf24-0ad5-42af-b600-e5453ee6f7d9 tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] Calling method '>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:46:05.650099 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-b546bf24-0ad5-42af-b600-e5453ee6f7d9 tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] [instance: 965c7a0f-fa3f-4f5c-92bf-94d8b646a9ae] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:46:05.655891 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-b546bf24-0ad5-42af-b600-e5453ee6f7d9 tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:46:05.656334 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-b546bf24-0ad5-42af-b600-e5453ee6f7d9 tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:46:05.657106 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-b546bf24-0ad5-42af-b600-e5453ee6f7d9 tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:46:05.657543 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-b546bf24-0ad5-42af-b600-e5453ee6f7d9 tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:46:05.791758 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-b546bf24-0ad5-42af-b600-e5453ee6f7d9 tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad0781ce20e54c3a9b7c61e0cccf6918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd48e24dbeaa241d7a97350fb2c8187b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:46:05.799180 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-b546bf24-0ad5-42af-b600-e5453ee6f7d9 tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] 10.222.0.20 "GET /compute/v2.1/servers/965c7a0f-fa3f-4f5c-92bf-94d8b646a9ae" status: 200 len: 1314 microversion: 2.1 time: 0.153770 Jul 06 13:46:05.799768 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 79/138] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:46:05 2022] GET /compute/v2.1/servers/965c7a0f-fa3f-4f5c-92bf-94d8b646a9ae => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:46:06.303680 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-61460ded-4385-4d15-a20b-12b121cf4eea tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:46:06.304673 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-61460ded-4385-4d15-a20b-12b121cf4eea tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] [instance: 5cf73c2b-28f6-49f1-a119-224c05679d2c] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:46:06.312084 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-61460ded-4385-4d15-a20b-12b121cf4eea tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:46:06.312717 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-61460ded-4385-4d15-a20b-12b121cf4eea tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:46:06.313522 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-61460ded-4385-4d15-a20b-12b121cf4eea tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:46:06.313953 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-61460ded-4385-4d15-a20b-12b121cf4eea tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:46:06.431069 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-018dd20f-0b9e-45b6-8f52-d8a0ba5c12be tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Calling method '>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:46:06.431688 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-018dd20f-0b9e-45b6-8f52-d8a0ba5c12be tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] [instance: c801676d-524f-42fc-a2b8-fe4186986d95] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:46:06.437913 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-018dd20f-0b9e-45b6-8f52-d8a0ba5c12be tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:46:06.438356 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-018dd20f-0b9e-45b6-8f52-d8a0ba5c12be tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:46:06.439314 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-018dd20f-0b9e-45b6-8f52-d8a0ba5c12be tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:46:06.439751 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-018dd20f-0b9e-45b6-8f52-d8a0ba5c12be tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:46:06.477038 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-61460ded-4385-4d15-a20b-12b121cf4eea tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b572a8f465048558fc969b85b2aec5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd85f2a57a0847debf5aaf81aab7a638', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:46:06.486801 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-61460ded-4385-4d15-a20b-12b121cf4eea tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] 10.222.0.20 "GET /compute/v2.1/servers/5cf73c2b-28f6-49f1-a119-224c05679d2c" status: 200 len: 1366 microversion: 2.1 time: 0.189119 Jul 06 13:46:06.487637 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 60/139] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:46:06 2022] GET /compute/v2.1/servers/5cf73c2b-28f6-49f1-a119-224c05679d2c => generated 1366 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:46:06.495480 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-acb3af21-f7f6-4f12-8a7d-86d55291a9d9 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:46:06.496083 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-acb3af21-f7f6-4f12-8a7d-86d55291a9d9 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] [instance: 546a77fd-66e1-4d89-afa3-58d632b09186] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:46:06.503961 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-acb3af21-f7f6-4f12-8a7d-86d55291a9d9 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:46:06.504752 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-acb3af21-f7f6-4f12-8a7d-86d55291a9d9 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:46:06.506017 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-acb3af21-f7f6-4f12-8a7d-86d55291a9d9 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:46:06.506718 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-acb3af21-f7f6-4f12-8a7d-86d55291a9d9 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:46:06.595144 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-018dd20f-0b9e-45b6-8f52-d8a0ba5c12be tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c83c05bec4f456d8aa7d51732ddc8af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b2a80a004e04da7ae12db9f3f87146f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:46:06.604171 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-018dd20f-0b9e-45b6-8f52-d8a0ba5c12be tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] 10.222.0.20 "GET /compute/v2.1/servers/c801676d-524f-42fc-a2b8-fe4186986d95" status: 200 len: 1322 microversion: 2.1 time: 0.177793 Jul 06 13:46:06.605142 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 80/140] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:46:06 2022] GET /compute/v2.1/servers/c801676d-524f-42fc-a2b8-fe4186986d95 => generated 1322 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 06 13:46:06.667864 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-acb3af21-f7f6-4f12-8a7d-86d55291a9d9 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d7cacb73c8342579d9f990b0193487c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05df572327d54bd99595974b75898052', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:46:06.675214 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-acb3af21-f7f6-4f12-8a7d-86d55291a9d9 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] 10.222.0.20 "GET /compute/v2.1/servers/546a77fd-66e1-4d89-afa3-58d632b09186" status: 200 len: 1362 microversion: 2.1 time: 0.186219 Jul 06 13:46:06.675777 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 61/141] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:46:06 2022] GET /compute/v2.1/servers/546a77fd-66e1-4d89-afa3-58d632b09186 => generated 1362 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:46:06.818288 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-04ab163c-0f78-49bf-82a9-f5f0190ccd45 tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] Calling method '>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:46:06.819022 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-04ab163c-0f78-49bf-82a9-f5f0190ccd45 tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] [instance: 965c7a0f-fa3f-4f5c-92bf-94d8b646a9ae] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:46:06.827910 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-04ab163c-0f78-49bf-82a9-f5f0190ccd45 tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:46:06.828360 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-04ab163c-0f78-49bf-82a9-f5f0190ccd45 tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:46:06.829159 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-04ab163c-0f78-49bf-82a9-f5f0190ccd45 tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:46:06.829597 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-04ab163c-0f78-49bf-82a9-f5f0190ccd45 tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:46:06.968663 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-04ab163c-0f78-49bf-82a9-f5f0190ccd45 tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad0781ce20e54c3a9b7c61e0cccf6918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd48e24dbeaa241d7a97350fb2c8187b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:46:06.976853 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-04ab163c-0f78-49bf-82a9-f5f0190ccd45 tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] 10.222.0.20 "GET /compute/v2.1/servers/965c7a0f-fa3f-4f5c-92bf-94d8b646a9ae" status: 200 len: 1314 microversion: 2.1 time: 0.162464 Jul 06 13:46:06.977445 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 81/142] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:46:06 2022] GET /compute/v2.1/servers/965c7a0f-fa3f-4f5c-92bf-94d8b646a9ae => generated 1314 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 06 13:46:07.505670 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-f36ea391-f653-43d0-8b13-bf6da8c1472c tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:46:07.506393 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-f36ea391-f653-43d0-8b13-bf6da8c1472c tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] [instance: 5cf73c2b-28f6-49f1-a119-224c05679d2c] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:46:07.513280 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-f36ea391-f653-43d0-8b13-bf6da8c1472c tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:46:07.513726 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-f36ea391-f653-43d0-8b13-bf6da8c1472c tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:46:07.514490 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-f36ea391-f653-43d0-8b13-bf6da8c1472c tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:46:07.514916 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-f36ea391-f653-43d0-8b13-bf6da8c1472c tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:46:07.621733 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-4d19779e-43c8-4a40-a093-a4642a80deef tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Calling method '>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:46:07.622471 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-4d19779e-43c8-4a40-a093-a4642a80deef tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] [instance: c801676d-524f-42fc-a2b8-fe4186986d95] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:46:07.628282 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-4d19779e-43c8-4a40-a093-a4642a80deef tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:46:07.628726 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-4d19779e-43c8-4a40-a093-a4642a80deef tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:46:07.629554 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-4d19779e-43c8-4a40-a093-a4642a80deef tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:46:07.629999 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-4d19779e-43c8-4a40-a093-a4642a80deef tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:46:07.649253 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-f36ea391-f653-43d0-8b13-bf6da8c1472c tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b572a8f465048558fc969b85b2aec5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd85f2a57a0847debf5aaf81aab7a638', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:46:07.656800 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-f36ea391-f653-43d0-8b13-bf6da8c1472c tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] 10.222.0.20 "GET /compute/v2.1/servers/5cf73c2b-28f6-49f1-a119-224c05679d2c" status: 200 len: 1366 microversion: 2.1 time: 0.155135 Jul 06 13:46:07.657714 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 62/143] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:46:07 2022] GET /compute/v2.1/servers/5cf73c2b-28f6-49f1-a119-224c05679d2c => generated 1366 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:46:07.692577 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-d77f77a8-351b-4147-9a6d-04391744e2f6 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:46:07.693419 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-d77f77a8-351b-4147-9a6d-04391744e2f6 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] [instance: 546a77fd-66e1-4d89-afa3-58d632b09186] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:46:07.700273 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-d77f77a8-351b-4147-9a6d-04391744e2f6 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:46:07.700740 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-d77f77a8-351b-4147-9a6d-04391744e2f6 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:46:07.701621 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-d77f77a8-351b-4147-9a6d-04391744e2f6 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:46:07.702064 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-d77f77a8-351b-4147-9a6d-04391744e2f6 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:46:07.762625 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-4d19779e-43c8-4a40-a093-a4642a80deef tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c83c05bec4f456d8aa7d51732ddc8af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b2a80a004e04da7ae12db9f3f87146f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:46:07.769999 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-4d19779e-43c8-4a40-a093-a4642a80deef tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] 10.222.0.20 "GET /compute/v2.1/servers/c801676d-524f-42fc-a2b8-fe4186986d95" status: 200 len: 1322 microversion: 2.1 time: 0.152127 Jul 06 13:46:07.770567 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 82/144] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:46:07 2022] GET /compute/v2.1/servers/c801676d-524f-42fc-a2b8-fe4186986d95 => generated 1322 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 06 13:46:07.835689 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-d77f77a8-351b-4147-9a6d-04391744e2f6 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d7cacb73c8342579d9f990b0193487c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05df572327d54bd99595974b75898052', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:46:07.843352 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-d77f77a8-351b-4147-9a6d-04391744e2f6 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] 10.222.0.20 "GET /compute/v2.1/servers/546a77fd-66e1-4d89-afa3-58d632b09186" status: 200 len: 1362 microversion: 2.1 time: 0.154534 Jul 06 13:46:07.844362 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 63/145] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:46:07 2022] GET /compute/v2.1/servers/546a77fd-66e1-4d89-afa3-58d632b09186 => generated 1362 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 06 13:46:07.994721 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-4cb2377e-a967-4fff-b8ab-37d723731d6a tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] Calling method '>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:46:07.995363 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-4cb2377e-a967-4fff-b8ab-37d723731d6a tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] [instance: 965c7a0f-fa3f-4f5c-92bf-94d8b646a9ae] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:46:08.001439 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-4cb2377e-a967-4fff-b8ab-37d723731d6a tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:46:08.001895 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-4cb2377e-a967-4fff-b8ab-37d723731d6a tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:46:08.002646 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-4cb2377e-a967-4fff-b8ab-37d723731d6a tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:46:08.003078 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-4cb2377e-a967-4fff-b8ab-37d723731d6a tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:46:08.133592 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-4cb2377e-a967-4fff-b8ab-37d723731d6a tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad0781ce20e54c3a9b7c61e0cccf6918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd48e24dbeaa241d7a97350fb2c8187b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:46:08.140937 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-4cb2377e-a967-4fff-b8ab-37d723731d6a tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] 10.222.0.20 "GET /compute/v2.1/servers/965c7a0f-fa3f-4f5c-92bf-94d8b646a9ae" status: 200 len: 1314 microversion: 2.1 time: 0.151162 Jul 06 13:46:08.141530 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 83/146] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:46:07 2022] GET /compute/v2.1/servers/965c7a0f-fa3f-4f5c-92bf-94d8b646a9ae => generated 1314 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:46:08.673495 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-ac3d0930-c8c4-4870-b5b7-ec25dd2b866f tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:46:08.674100 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-ac3d0930-c8c4-4870-b5b7-ec25dd2b866f tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] [instance: 5cf73c2b-28f6-49f1-a119-224c05679d2c] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:46:08.682243 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-ac3d0930-c8c4-4870-b5b7-ec25dd2b866f tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:46:08.682692 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-ac3d0930-c8c4-4870-b5b7-ec25dd2b866f tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:46:08.683449 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-ac3d0930-c8c4-4870-b5b7-ec25dd2b866f tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:46:08.683880 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-ac3d0930-c8c4-4870-b5b7-ec25dd2b866f tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:46:08.786416 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-3dd0f494-c660-4200-bf19-78abcf8d0264 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Calling method '>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:46:08.787018 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-3dd0f494-c660-4200-bf19-78abcf8d0264 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] [instance: c801676d-524f-42fc-a2b8-fe4186986d95] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:46:08.792948 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-3dd0f494-c660-4200-bf19-78abcf8d0264 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:46:08.793363 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-3dd0f494-c660-4200-bf19-78abcf8d0264 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:46:08.794129 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-3dd0f494-c660-4200-bf19-78abcf8d0264 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:46:08.794554 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-3dd0f494-c660-4200-bf19-78abcf8d0264 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:46:08.811902 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-ac3d0930-c8c4-4870-b5b7-ec25dd2b866f tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b572a8f465048558fc969b85b2aec5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd85f2a57a0847debf5aaf81aab7a638', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:46:08.820026 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-ac3d0930-c8c4-4870-b5b7-ec25dd2b866f tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] 10.222.0.20 "GET /compute/v2.1/servers/5cf73c2b-28f6-49f1-a119-224c05679d2c" status: 200 len: 1366 microversion: 2.1 time: 0.149747 Jul 06 13:46:08.821152 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 64/147] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:46:08 2022] GET /compute/v2.1/servers/5cf73c2b-28f6-49f1-a119-224c05679d2c => generated 1366 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:46:08.861188 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-8884c040-18d5-403d-93e7-1a03cb4a6c4a tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:46:08.861804 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-8884c040-18d5-403d-93e7-1a03cb4a6c4a tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] [instance: 546a77fd-66e1-4d89-afa3-58d632b09186] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:46:08.867918 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-8884c040-18d5-403d-93e7-1a03cb4a6c4a tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:46:08.868368 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-8884c040-18d5-403d-93e7-1a03cb4a6c4a tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:46:08.869160 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-8884c040-18d5-403d-93e7-1a03cb4a6c4a tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:46:08.869595 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-8884c040-18d5-403d-93e7-1a03cb4a6c4a tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:46:08.923800 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-3dd0f494-c660-4200-bf19-78abcf8d0264 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c83c05bec4f456d8aa7d51732ddc8af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b2a80a004e04da7ae12db9f3f87146f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:46:08.932208 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-3dd0f494-c660-4200-bf19-78abcf8d0264 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] 10.222.0.20 "GET /compute/v2.1/servers/c801676d-524f-42fc-a2b8-fe4186986d95" status: 200 len: 1322 microversion: 2.1 time: 0.149585 Jul 06 13:46:08.932779 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 84/148] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:46:08 2022] GET /compute/v2.1/servers/c801676d-524f-42fc-a2b8-fe4186986d95 => generated 1322 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 06 13:46:09.000937 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-8884c040-18d5-403d-93e7-1a03cb4a6c4a tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d7cacb73c8342579d9f990b0193487c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05df572327d54bd99595974b75898052', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:46:09.009424 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-8884c040-18d5-403d-93e7-1a03cb4a6c4a tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] 10.222.0.20 "GET /compute/v2.1/servers/546a77fd-66e1-4d89-afa3-58d632b09186" status: 200 len: 1362 microversion: 2.1 time: 0.152147 Jul 06 13:46:09.009988 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 65/149] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:46:08 2022] GET /compute/v2.1/servers/546a77fd-66e1-4d89-afa3-58d632b09186 => generated 1362 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 06 13:46:09.157319 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-cd19a8ff-e172-48dc-83c7-b36b82901f2e tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] Calling method '>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:46:09.157949 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-cd19a8ff-e172-48dc-83c7-b36b82901f2e tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] [instance: 965c7a0f-fa3f-4f5c-92bf-94d8b646a9ae] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:46:09.163910 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-cd19a8ff-e172-48dc-83c7-b36b82901f2e tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:46:09.164346 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-cd19a8ff-e172-48dc-83c7-b36b82901f2e tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:46:09.165124 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-cd19a8ff-e172-48dc-83c7-b36b82901f2e tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:46:09.165553 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-cd19a8ff-e172-48dc-83c7-b36b82901f2e tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:46:09.292815 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-cd19a8ff-e172-48dc-83c7-b36b82901f2e tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad0781ce20e54c3a9b7c61e0cccf6918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd48e24dbeaa241d7a97350fb2c8187b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:46:09.300548 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-cd19a8ff-e172-48dc-83c7-b36b82901f2e tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] 10.222.0.20 "GET /compute/v2.1/servers/965c7a0f-fa3f-4f5c-92bf-94d8b646a9ae" status: 200 len: 1314 microversion: 2.1 time: 0.146965 Jul 06 13:46:09.301694 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 85/150] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:46:09 2022] GET /compute/v2.1/servers/965c7a0f-fa3f-4f5c-92bf-94d8b646a9ae => generated 1314 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:46:09.837680 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-11a20b15-b04b-4ab8-949e-5c44a1269b77 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:46:09.838287 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-11a20b15-b04b-4ab8-949e-5c44a1269b77 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] [instance: 5cf73c2b-28f6-49f1-a119-224c05679d2c] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:46:09.844225 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-11a20b15-b04b-4ab8-949e-5c44a1269b77 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:46:09.844673 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-11a20b15-b04b-4ab8-949e-5c44a1269b77 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:46:09.845461 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-11a20b15-b04b-4ab8-949e-5c44a1269b77 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:46:09.845897 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-11a20b15-b04b-4ab8-949e-5c44a1269b77 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:46:09.949227 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-23dbb318-b3d1-49f5-bc95-5b459d1ada06 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Calling method '>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:46:09.949857 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-23dbb318-b3d1-49f5-bc95-5b459d1ada06 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] [instance: c801676d-524f-42fc-a2b8-fe4186986d95] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:46:09.956296 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-23dbb318-b3d1-49f5-bc95-5b459d1ada06 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:46:09.956744 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-23dbb318-b3d1-49f5-bc95-5b459d1ada06 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:46:09.957744 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-23dbb318-b3d1-49f5-bc95-5b459d1ada06 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:46:09.958175 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-23dbb318-b3d1-49f5-bc95-5b459d1ada06 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:46:10.107264 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-23dbb318-b3d1-49f5-bc95-5b459d1ada06 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c83c05bec4f456d8aa7d51732ddc8af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b2a80a004e04da7ae12db9f3f87146f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:46:10.114596 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-23dbb318-b3d1-49f5-bc95-5b459d1ada06 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] 10.222.0.20 "GET /compute/v2.1/servers/c801676d-524f-42fc-a2b8-fe4186986d95" status: 200 len: 1322 microversion: 2.1 time: 0.169331 Jul 06 13:46:10.115155 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 86/151] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:46:09 2022] GET /compute/v2.1/servers/c801676d-524f-42fc-a2b8-fe4186986d95 => generated 1322 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:46:10.119890 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-d06c3e64-9bc0-4993-8d7a-05930e0281b8 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Calling method '>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:46:10.120490 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-d06c3e64-9bc0-4993-8d7a-05930e0281b8 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] [instance: 546a77fd-66e1-4d89-afa3-58d632b09186] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:46:10.126345 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-d06c3e64-9bc0-4993-8d7a-05930e0281b8 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:46:10.126987 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-d06c3e64-9bc0-4993-8d7a-05930e0281b8 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:46:10.127898 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-d06c3e64-9bc0-4993-8d7a-05930e0281b8 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:46:10.128474 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-d06c3e64-9bc0-4993-8d7a-05930e0281b8 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:46:10.166697 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-11a20b15-b04b-4ab8-949e-5c44a1269b77 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b572a8f465048558fc969b85b2aec5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd85f2a57a0847debf5aaf81aab7a638', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:46:10.179833 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-11a20b15-b04b-4ab8-949e-5c44a1269b77 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] 10.222.0.20 "GET /compute/v2.1/servers/5cf73c2b-28f6-49f1-a119-224c05679d2c" status: 200 len: 1366 microversion: 2.1 time: 0.346253 Jul 06 13:46:10.180474 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 66/152] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:46:09 2022] GET /compute/v2.1/servers/5cf73c2b-28f6-49f1-a119-224c05679d2c => generated 1366 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:46:10.271261 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-d06c3e64-9bc0-4993-8d7a-05930e0281b8 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d7cacb73c8342579d9f990b0193487c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05df572327d54bd99595974b75898052', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:46:10.279448 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-d06c3e64-9bc0-4993-8d7a-05930e0281b8 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] 10.222.0.20 "GET /compute/v2.1/servers/546a77fd-66e1-4d89-afa3-58d632b09186" status: 200 len: 1362 microversion: 2.1 time: 0.163191 Jul 06 13:46:10.280013 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 87/153] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:46:10 2022] GET /compute/v2.1/servers/546a77fd-66e1-4d89-afa3-58d632b09186 => generated 1362 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:46:10.318722 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-edf292cf-cb77-4156-8d5e-aa0d7eb5e6c8 tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:46:10.319066 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-edf292cf-cb77-4156-8d5e-aa0d7eb5e6c8 tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] [instance: 965c7a0f-fa3f-4f5c-92bf-94d8b646a9ae] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:46:10.326578 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-edf292cf-cb77-4156-8d5e-aa0d7eb5e6c8 tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:46:10.327131 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-edf292cf-cb77-4156-8d5e-aa0d7eb5e6c8 tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:46:10.328117 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-edf292cf-cb77-4156-8d5e-aa0d7eb5e6c8 tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:46:10.328687 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-edf292cf-cb77-4156-8d5e-aa0d7eb5e6c8 tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:46:10.466609 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-edf292cf-cb77-4156-8d5e-aa0d7eb5e6c8 tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad0781ce20e54c3a9b7c61e0cccf6918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd48e24dbeaa241d7a97350fb2c8187b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:46:10.474046 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-edf292cf-cb77-4156-8d5e-aa0d7eb5e6c8 tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] 10.222.0.20 "GET /compute/v2.1/servers/965c7a0f-fa3f-4f5c-92bf-94d8b646a9ae" status: 200 len: 1314 microversion: 2.1 time: 0.159764 Jul 06 13:46:10.474613 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 67/154] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:46:10 2022] GET /compute/v2.1/servers/965c7a0f-fa3f-4f5c-92bf-94d8b646a9ae => generated 1314 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:46:11.133444 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-ed6b4e64-1451-4e52-b79b-a01d0d5d1ccc tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Calling method '>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:46:11.135716 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-ed6b4e64-1451-4e52-b79b-a01d0d5d1ccc tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] [instance: c801676d-524f-42fc-a2b8-fe4186986d95] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:46:11.146679 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-ed6b4e64-1451-4e52-b79b-a01d0d5d1ccc tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:46:11.147232 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-ed6b4e64-1451-4e52-b79b-a01d0d5d1ccc tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:46:11.148671 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-ed6b4e64-1451-4e52-b79b-a01d0d5d1ccc tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:46:11.149598 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-ed6b4e64-1451-4e52-b79b-a01d0d5d1ccc tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:46:11.198622 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-8b8cce2c-c311-46c3-9bd4-6da0c1a4d350 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:46:11.199183 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-8b8cce2c-c311-46c3-9bd4-6da0c1a4d350 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] [instance: 5cf73c2b-28f6-49f1-a119-224c05679d2c] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:46:11.210710 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-8b8cce2c-c311-46c3-9bd4-6da0c1a4d350 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:46:11.211283 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-8b8cce2c-c311-46c3-9bd4-6da0c1a4d350 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:46:11.212233 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-8b8cce2c-c311-46c3-9bd4-6da0c1a4d350 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:46:11.212773 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-8b8cce2c-c311-46c3-9bd4-6da0c1a4d350 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:46:11.557929 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-ed6b4e64-1451-4e52-b79b-a01d0d5d1ccc tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c83c05bec4f456d8aa7d51732ddc8af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b2a80a004e04da7ae12db9f3f87146f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:46:11.566305 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-ed6b4e64-1451-4e52-b79b-a01d0d5d1ccc tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] 10.222.0.20 "GET /compute/v2.1/servers/c801676d-524f-42fc-a2b8-fe4186986d95" status: 200 len: 1322 microversion: 2.1 time: 0.438173 Jul 06 13:46:11.571895 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 88/155] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:46:11 2022] GET /compute/v2.1/servers/c801676d-524f-42fc-a2b8-fe4186986d95 => generated 1322 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:46:11.581634 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-4fe6a6aa-5ad4-4da7-be6e-10bdbaec08cb tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Calling method '>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:46:11.583641 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-4fe6a6aa-5ad4-4da7-be6e-10bdbaec08cb tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] [instance: 546a77fd-66e1-4d89-afa3-58d632b09186] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:46:11.595451 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-4fe6a6aa-5ad4-4da7-be6e-10bdbaec08cb tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:46:11.596419 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-4fe6a6aa-5ad4-4da7-be6e-10bdbaec08cb tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:46:11.599066 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-4fe6a6aa-5ad4-4da7-be6e-10bdbaec08cb tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:46:11.600337 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-4fe6a6aa-5ad4-4da7-be6e-10bdbaec08cb tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:46:11.751139 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-8b8cce2c-c311-46c3-9bd4-6da0c1a4d350 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b572a8f465048558fc969b85b2aec5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd85f2a57a0847debf5aaf81aab7a638', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:46:11.768253 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-8b8cce2c-c311-46c3-9bd4-6da0c1a4d350 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] 10.222.0.20 "GET /compute/v2.1/servers/5cf73c2b-28f6-49f1-a119-224c05679d2c" status: 200 len: 1366 microversion: 2.1 time: 0.574228 Jul 06 13:46:11.768850 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 68/156] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:46:11 2022] GET /compute/v2.1/servers/5cf73c2b-28f6-49f1-a119-224c05679d2c => generated 1366 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 06 13:46:11.786508 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-f2da7006-2ccd-461c-a444-c595c7c02f7d tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:46:11.787126 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-f2da7006-2ccd-461c-a444-c595c7c02f7d tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] [instance: 965c7a0f-fa3f-4f5c-92bf-94d8b646a9ae] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:46:11.793747 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-f2da7006-2ccd-461c-a444-c595c7c02f7d tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:46:11.794424 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-f2da7006-2ccd-461c-a444-c595c7c02f7d tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:46:11.795349 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-f2da7006-2ccd-461c-a444-c595c7c02f7d tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:46:11.795922 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-f2da7006-2ccd-461c-a444-c595c7c02f7d tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:46:11.900856 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-4fe6a6aa-5ad4-4da7-be6e-10bdbaec08cb tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d7cacb73c8342579d9f990b0193487c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05df572327d54bd99595974b75898052', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:46:11.910717 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-4fe6a6aa-5ad4-4da7-be6e-10bdbaec08cb tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] 10.222.0.20 "GET /compute/v2.1/servers/546a77fd-66e1-4d89-afa3-58d632b09186" status: 200 len: 1362 microversion: 2.1 time: 0.334907 Jul 06 13:46:11.917524 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 89/157] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:46:11 2022] GET /compute/v2.1/servers/546a77fd-66e1-4d89-afa3-58d632b09186 => generated 1362 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:46:11.949590 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-f2da7006-2ccd-461c-a444-c595c7c02f7d tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad0781ce20e54c3a9b7c61e0cccf6918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd48e24dbeaa241d7a97350fb2c8187b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:46:11.957174 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-f2da7006-2ccd-461c-a444-c595c7c02f7d tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] 10.222.0.20 "GET /compute/v2.1/servers/965c7a0f-fa3f-4f5c-92bf-94d8b646a9ae" status: 200 len: 1314 microversion: 2.1 time: 0.187341 Jul 06 13:46:11.957749 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 69/158] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:46:11 2022] GET /compute/v2.1/servers/965c7a0f-fa3f-4f5c-92bf-94d8b646a9ae => generated 1314 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:46:12.589220 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-645d9e60-b133-46f9-8606-9d909af9d92d tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Calling method '>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:46:12.589826 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-645d9e60-b133-46f9-8606-9d909af9d92d tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] [instance: c801676d-524f-42fc-a2b8-fe4186986d95] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:46:12.596278 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-645d9e60-b133-46f9-8606-9d909af9d92d tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:46:12.596726 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-645d9e60-b133-46f9-8606-9d909af9d92d tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:46:12.597513 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-645d9e60-b133-46f9-8606-9d909af9d92d tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:46:12.597941 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-645d9e60-b133-46f9-8606-9d909af9d92d tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:46:12.731281 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-645d9e60-b133-46f9-8606-9d909af9d92d tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c83c05bec4f456d8aa7d51732ddc8af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b2a80a004e04da7ae12db9f3f87146f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:46:12.739293 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-645d9e60-b133-46f9-8606-9d909af9d92d tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] 10.222.0.20 "GET /compute/v2.1/servers/c801676d-524f-42fc-a2b8-fe4186986d95" status: 200 len: 1322 microversion: 2.1 time: 0.154233 Jul 06 13:46:12.749392 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 90/159] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:46:12 2022] GET /compute/v2.1/servers/c801676d-524f-42fc-a2b8-fe4186986d95 => generated 1322 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:46:12.786814 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-a92bceee-5053-4f18-9795-8c367ae957f5 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:46:12.787506 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-a92bceee-5053-4f18-9795-8c367ae957f5 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] [instance: 5cf73c2b-28f6-49f1-a119-224c05679d2c] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:46:12.794443 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-a92bceee-5053-4f18-9795-8c367ae957f5 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:46:12.794972 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-a92bceee-5053-4f18-9795-8c367ae957f5 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:46:12.795808 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-a92bceee-5053-4f18-9795-8c367ae957f5 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:46:12.796344 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-a92bceee-5053-4f18-9795-8c367ae957f5 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:46:12.932787 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-a92bceee-5053-4f18-9795-8c367ae957f5 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b572a8f465048558fc969b85b2aec5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd85f2a57a0847debf5aaf81aab7a638', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:46:12.934151 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-e2930d1e-fe3c-490e-91d6-a9be29ed3473 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Calling method '>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:46:12.934770 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-e2930d1e-fe3c-490e-91d6-a9be29ed3473 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] [instance: 546a77fd-66e1-4d89-afa3-58d632b09186] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:46:12.940464 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-a92bceee-5053-4f18-9795-8c367ae957f5 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] 10.222.0.20 "GET /compute/v2.1/servers/5cf73c2b-28f6-49f1-a119-224c05679d2c" status: 200 len: 1366 microversion: 2.1 time: 0.158286 Jul 06 13:46:12.941052 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 70/160] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:46:12 2022] GET /compute/v2.1/servers/5cf73c2b-28f6-49f1-a119-224c05679d2c => generated 1366 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:46:12.941202 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-e2930d1e-fe3c-490e-91d6-a9be29ed3473 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:46:12.941573 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-e2930d1e-fe3c-490e-91d6-a9be29ed3473 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:46:12.942347 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-e2930d1e-fe3c-490e-91d6-a9be29ed3473 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:46:12.942786 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-e2930d1e-fe3c-490e-91d6-a9be29ed3473 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:46:12.975610 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-54f41213-96f0-4646-94cf-e8cc1fe232d9 tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:46:12.976044 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-54f41213-96f0-4646-94cf-e8cc1fe232d9 tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] [instance: 965c7a0f-fa3f-4f5c-92bf-94d8b646a9ae] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:46:12.982624 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-54f41213-96f0-4646-94cf-e8cc1fe232d9 tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:46:12.983073 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-54f41213-96f0-4646-94cf-e8cc1fe232d9 tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:46:12.983837 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-54f41213-96f0-4646-94cf-e8cc1fe232d9 tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:46:12.984262 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-54f41213-96f0-4646-94cf-e8cc1fe232d9 tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:46:13.121878 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-54f41213-96f0-4646-94cf-e8cc1fe232d9 tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad0781ce20e54c3a9b7c61e0cccf6918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd48e24dbeaa241d7a97350fb2c8187b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:46:13.129753 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-54f41213-96f0-4646-94cf-e8cc1fe232d9 tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] 10.222.0.20 "GET /compute/v2.1/servers/965c7a0f-fa3f-4f5c-92bf-94d8b646a9ae" status: 200 len: 1314 microversion: 2.1 time: 0.158062 Jul 06 13:46:13.130331 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 71/161] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:46:12 2022] GET /compute/v2.1/servers/965c7a0f-fa3f-4f5c-92bf-94d8b646a9ae => generated 1314 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 06 13:46:13.145472 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-e2930d1e-fe3c-490e-91d6-a9be29ed3473 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d7cacb73c8342579d9f990b0193487c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05df572327d54bd99595974b75898052', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:46:13.152960 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-e2930d1e-fe3c-490e-91d6-a9be29ed3473 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] 10.222.0.20 "GET /compute/v2.1/servers/546a77fd-66e1-4d89-afa3-58d632b09186" status: 200 len: 1362 microversion: 2.1 time: 0.222961 Jul 06 13:46:13.153898 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 91/162] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:46:12 2022] GET /compute/v2.1/servers/546a77fd-66e1-4d89-afa3-58d632b09186 => generated 1362 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 06 13:46:13.756259 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-9a07cf9c-eeed-4a06-bee1-3413d1761a02 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:46:13.756861 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-9a07cf9c-eeed-4a06-bee1-3413d1761a02 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] [instance: c801676d-524f-42fc-a2b8-fe4186986d95] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:46:13.760146 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG dbcounter [-] [124367] Writing DB stats nova_api:SELECT=83 {{(pid=124367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:46:13.765091 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-9a07cf9c-eeed-4a06-bee1-3413d1761a02 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:46:13.765900 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-9a07cf9c-eeed-4a06-bee1-3413d1761a02 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:46:13.766675 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-9a07cf9c-eeed-4a06-bee1-3413d1761a02 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:46:13.767103 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-9a07cf9c-eeed-4a06-bee1-3413d1761a02 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:46:13.953883 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-9a07cf9c-eeed-4a06-bee1-3413d1761a02 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c83c05bec4f456d8aa7d51732ddc8af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b2a80a004e04da7ae12db9f3f87146f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:46:13.957819 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-156b32f2-77fd-4981-acde-6d79621a20c2 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Calling method '>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:46:13.958753 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-156b32f2-77fd-4981-acde-6d79621a20c2 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] [instance: 5cf73c2b-28f6-49f1-a119-224c05679d2c] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:46:13.962137 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-9a07cf9c-eeed-4a06-bee1-3413d1761a02 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] 10.222.0.20 "GET /compute/v2.1/servers/c801676d-524f-42fc-a2b8-fe4186986d95" status: 200 len: 1322 microversion: 2.1 time: 0.209686 Jul 06 13:46:13.962712 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 72/163] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:46:13 2022] GET /compute/v2.1/servers/c801676d-524f-42fc-a2b8-fe4186986d95 => generated 1322 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:46:13.971426 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-156b32f2-77fd-4981-acde-6d79621a20c2 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:46:13.971426 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-156b32f2-77fd-4981-acde-6d79621a20c2 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:46:13.971426 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-156b32f2-77fd-4981-acde-6d79621a20c2 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:46:13.971426 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-156b32f2-77fd-4981-acde-6d79621a20c2 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:46:13.971772 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG dbcounter [-] [124368] Writing DB stats nova_cell1:SELECT=100 {{(pid=124368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:46:14.107487 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-156b32f2-77fd-4981-acde-6d79621a20c2 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b572a8f465048558fc969b85b2aec5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd85f2a57a0847debf5aaf81aab7a638', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:46:14.117782 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-156b32f2-77fd-4981-acde-6d79621a20c2 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] 10.222.0.20 "GET /compute/v2.1/servers/5cf73c2b-28f6-49f1-a119-224c05679d2c" status: 200 len: 1366 microversion: 2.1 time: 0.163505 Jul 06 13:46:14.118440 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 92/164] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:46:13 2022] GET /compute/v2.1/servers/5cf73c2b-28f6-49f1-a119-224c05679d2c => generated 1366 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 06 13:46:14.150102 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-591d63f3-e813-448f-bb39-28771b3f58a4 tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:46:14.151306 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-591d63f3-e813-448f-bb39-28771b3f58a4 tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] [instance: 965c7a0f-fa3f-4f5c-92bf-94d8b646a9ae] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:46:14.157861 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-591d63f3-e813-448f-bb39-28771b3f58a4 tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:46:14.158313 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-591d63f3-e813-448f-bb39-28771b3f58a4 tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:46:14.159102 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-591d63f3-e813-448f-bb39-28771b3f58a4 tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:46:14.159534 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-591d63f3-e813-448f-bb39-28771b3f58a4 tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:46:14.170486 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-abf88a49-ebfe-46a9-9338-9a6a01ecbebf tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Calling method '>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:46:14.171110 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-abf88a49-ebfe-46a9-9338-9a6a01ecbebf tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] [instance: 546a77fd-66e1-4d89-afa3-58d632b09186] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:46:14.179561 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-abf88a49-ebfe-46a9-9338-9a6a01ecbebf tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:46:14.180395 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-abf88a49-ebfe-46a9-9338-9a6a01ecbebf tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:46:14.180827 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-abf88a49-ebfe-46a9-9338-9a6a01ecbebf tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:46:14.181296 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-abf88a49-ebfe-46a9-9338-9a6a01ecbebf tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:46:14.352122 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-abf88a49-ebfe-46a9-9338-9a6a01ecbebf tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d7cacb73c8342579d9f990b0193487c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05df572327d54bd99595974b75898052', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:46:14.360174 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-abf88a49-ebfe-46a9-9338-9a6a01ecbebf tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] 10.222.0.20 "GET /compute/v2.1/servers/546a77fd-66e1-4d89-afa3-58d632b09186" status: 200 len: 1362 microversion: 2.1 time: 0.193421 Jul 06 13:46:14.360759 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 93/165] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:46:14 2022] GET /compute/v2.1/servers/546a77fd-66e1-4d89-afa3-58d632b09186 => generated 1362 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:46:14.373747 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-591d63f3-e813-448f-bb39-28771b3f58a4 tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad0781ce20e54c3a9b7c61e0cccf6918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd48e24dbeaa241d7a97350fb2c8187b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:46:14.381314 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-591d63f3-e813-448f-bb39-28771b3f58a4 tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] 10.222.0.20 "GET /compute/v2.1/servers/965c7a0f-fa3f-4f5c-92bf-94d8b646a9ae" status: 200 len: 1314 microversion: 2.1 time: 0.237056 Jul 06 13:46:14.382082 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 73/166] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:46:14 2022] GET /compute/v2.1/servers/965c7a0f-fa3f-4f5c-92bf-94d8b646a9ae => generated 1314 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:46:14.981309 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-88f7c674-b047-425f-9459-602135fa94ae tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Calling method '>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:46:14.981927 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-88f7c674-b047-425f-9459-602135fa94ae tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] [instance: c801676d-524f-42fc-a2b8-fe4186986d95] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:46:14.987915 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-88f7c674-b047-425f-9459-602135fa94ae tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:46:14.988362 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-88f7c674-b047-425f-9459-602135fa94ae tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:46:14.989150 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-88f7c674-b047-425f-9459-602135fa94ae tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:46:14.989584 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-88f7c674-b047-425f-9459-602135fa94ae tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:46:15.124221 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-88f7c674-b047-425f-9459-602135fa94ae tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c83c05bec4f456d8aa7d51732ddc8af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b2a80a004e04da7ae12db9f3f87146f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:46:15.132604 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-88f7c674-b047-425f-9459-602135fa94ae tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] 10.222.0.20 "GET /compute/v2.1/servers/c801676d-524f-42fc-a2b8-fe4186986d95" status: 200 len: 1322 microversion: 2.1 time: 0.156743 Jul 06 13:46:15.133525 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 94/167] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:46:14 2022] GET /compute/v2.1/servers/c801676d-524f-42fc-a2b8-fe4186986d95 => generated 1322 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:46:15.136256 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-b840d11e-8e43-4200-99bf-05efaa0b1438 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:46:15.136891 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-b840d11e-8e43-4200-99bf-05efaa0b1438 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] [instance: 5cf73c2b-28f6-49f1-a119-224c05679d2c] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:46:15.142929 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-b840d11e-8e43-4200-99bf-05efaa0b1438 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:46:15.143380 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-b840d11e-8e43-4200-99bf-05efaa0b1438 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:46:15.144163 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-b840d11e-8e43-4200-99bf-05efaa0b1438 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:46:15.144592 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-b840d11e-8e43-4200-99bf-05efaa0b1438 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:46:15.279298 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-b840d11e-8e43-4200-99bf-05efaa0b1438 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b572a8f465048558fc969b85b2aec5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd85f2a57a0847debf5aaf81aab7a638', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:46:15.287078 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-b840d11e-8e43-4200-99bf-05efaa0b1438 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] 10.222.0.20 "GET /compute/v2.1/servers/5cf73c2b-28f6-49f1-a119-224c05679d2c" status: 200 len: 1366 microversion: 2.1 time: 0.156056 Jul 06 13:46:15.287663 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 74/168] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:46:15 2022] GET /compute/v2.1/servers/5cf73c2b-28f6-49f1-a119-224c05679d2c => generated 1366 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:46:15.376642 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-8220dd8a-7e99-436a-95f0-84598ad6bf02 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Calling method '>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:46:15.377299 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-8220dd8a-7e99-436a-95f0-84598ad6bf02 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] [instance: 546a77fd-66e1-4d89-afa3-58d632b09186] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:46:15.383538 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-8220dd8a-7e99-436a-95f0-84598ad6bf02 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:46:15.384096 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-8220dd8a-7e99-436a-95f0-84598ad6bf02 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:46:15.384871 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-8220dd8a-7e99-436a-95f0-84598ad6bf02 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:46:15.385335 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-8220dd8a-7e99-436a-95f0-84598ad6bf02 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:46:15.399296 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-3fe28665-c7ff-4994-95a2-9de0e2538901 tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:46:15.399954 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-3fe28665-c7ff-4994-95a2-9de0e2538901 tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] [instance: 965c7a0f-fa3f-4f5c-92bf-94d8b646a9ae] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:46:15.406351 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-3fe28665-c7ff-4994-95a2-9de0e2538901 tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:46:15.406797 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-3fe28665-c7ff-4994-95a2-9de0e2538901 tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:46:15.407556 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-3fe28665-c7ff-4994-95a2-9de0e2538901 tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:46:15.407975 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-3fe28665-c7ff-4994-95a2-9de0e2538901 tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:46:15.522883 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-8220dd8a-7e99-436a-95f0-84598ad6bf02 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d7cacb73c8342579d9f990b0193487c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05df572327d54bd99595974b75898052', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:46:15.532062 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-8220dd8a-7e99-436a-95f0-84598ad6bf02 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] 10.222.0.20 "GET /compute/v2.1/servers/546a77fd-66e1-4d89-afa3-58d632b09186" status: 200 len: 1362 microversion: 2.1 time: 0.158624 Jul 06 13:46:15.533139 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 95/169] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:46:15 2022] GET /compute/v2.1/servers/546a77fd-66e1-4d89-afa3-58d632b09186 => generated 1362 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:46:15.556536 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-3fe28665-c7ff-4994-95a2-9de0e2538901 tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad0781ce20e54c3a9b7c61e0cccf6918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd48e24dbeaa241d7a97350fb2c8187b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:46:15.565986 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-3fe28665-c7ff-4994-95a2-9de0e2538901 tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] 10.222.0.20 "GET /compute/v2.1/servers/965c7a0f-fa3f-4f5c-92bf-94d8b646a9ae" status: 200 len: 1314 microversion: 2.1 time: 0.171402 Jul 06 13:46:15.566571 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 75/170] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:46:15 2022] GET /compute/v2.1/servers/965c7a0f-fa3f-4f5c-92bf-94d8b646a9ae => generated 1314 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 06 13:46:16.149326 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-cdabf0cf-2249-404f-bc1d-b012a1ecd2dc tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Calling method '>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:46:16.149933 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-cdabf0cf-2249-404f-bc1d-b012a1ecd2dc tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] [instance: c801676d-524f-42fc-a2b8-fe4186986d95] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:46:16.155887 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-cdabf0cf-2249-404f-bc1d-b012a1ecd2dc tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:46:16.156420 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-cdabf0cf-2249-404f-bc1d-b012a1ecd2dc tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:46:16.157251 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-cdabf0cf-2249-404f-bc1d-b012a1ecd2dc tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:46:16.157729 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-cdabf0cf-2249-404f-bc1d-b012a1ecd2dc tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:46:16.303417 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-cdabf0cf-2249-404f-bc1d-b012a1ecd2dc tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c83c05bec4f456d8aa7d51732ddc8af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b2a80a004e04da7ae12db9f3f87146f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:46:16.304603 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-208edf27-230e-4505-8002-36df8e2ffcc6 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:46:16.305364 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-208edf27-230e-4505-8002-36df8e2ffcc6 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] [instance: 5cf73c2b-28f6-49f1-a119-224c05679d2c] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:46:16.311459 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-208edf27-230e-4505-8002-36df8e2ffcc6 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:46:16.312097 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-208edf27-230e-4505-8002-36df8e2ffcc6 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:46:16.312379 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-cdabf0cf-2249-404f-bc1d-b012a1ecd2dc tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] 10.222.0.20 "GET /compute/v2.1/servers/c801676d-524f-42fc-a2b8-fe4186986d95" status: 200 len: 1322 microversion: 2.1 time: 0.166860 Jul 06 13:46:16.312863 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-208edf27-230e-4505-8002-36df8e2ffcc6 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:46:16.312981 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 96/171] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:46:16 2022] GET /compute/v2.1/servers/c801676d-524f-42fc-a2b8-fe4186986d95 => generated 1322 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:46:16.313654 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-208edf27-230e-4505-8002-36df8e2ffcc6 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:46:16.317822 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG dbcounter [-] [124367] Writing DB stats nova_cell1:SELECT=100 {{(pid=124367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:46:16.450578 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-208edf27-230e-4505-8002-36df8e2ffcc6 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b572a8f465048558fc969b85b2aec5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd85f2a57a0847debf5aaf81aab7a638', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:46:16.457874 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-208edf27-230e-4505-8002-36df8e2ffcc6 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] 10.222.0.20 "GET /compute/v2.1/servers/5cf73c2b-28f6-49f1-a119-224c05679d2c" status: 200 len: 1366 microversion: 2.1 time: 0.158114 Jul 06 13:46:16.458430 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 76/172] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:46:16 2022] GET /compute/v2.1/servers/5cf73c2b-28f6-49f1-a119-224c05679d2c => generated 1366 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 06 13:46:16.549179 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-bd402f20-4392-4579-a366-907c0b3b51e5 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Calling method '>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:46:16.549786 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-bd402f20-4392-4579-a366-907c0b3b51e5 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] [instance: 546a77fd-66e1-4d89-afa3-58d632b09186] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:46:16.556157 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-bd402f20-4392-4579-a366-907c0b3b51e5 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:46:16.556599 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-bd402f20-4392-4579-a366-907c0b3b51e5 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:46:16.557394 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-bd402f20-4392-4579-a366-907c0b3b51e5 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:46:16.557822 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-bd402f20-4392-4579-a366-907c0b3b51e5 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:46:16.583616 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-d979c285-08db-48ad-a6df-88b774e69116 tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:46:16.584227 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-d979c285-08db-48ad-a6df-88b774e69116 tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] [instance: 965c7a0f-fa3f-4f5c-92bf-94d8b646a9ae] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:46:16.591460 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-d979c285-08db-48ad-a6df-88b774e69116 tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:46:16.591908 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-d979c285-08db-48ad-a6df-88b774e69116 tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:46:16.592699 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-d979c285-08db-48ad-a6df-88b774e69116 tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:46:16.593161 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-d979c285-08db-48ad-a6df-88b774e69116 tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:46:16.694482 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-bd402f20-4392-4579-a366-907c0b3b51e5 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d7cacb73c8342579d9f990b0193487c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05df572327d54bd99595974b75898052', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:46:16.702199 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-bd402f20-4392-4579-a366-907c0b3b51e5 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] 10.222.0.20 "GET /compute/v2.1/servers/546a77fd-66e1-4d89-afa3-58d632b09186" status: 200 len: 1362 microversion: 2.1 time: 0.156878 Jul 06 13:46:16.702800 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 97/173] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:46:16 2022] GET /compute/v2.1/servers/546a77fd-66e1-4d89-afa3-58d632b09186 => generated 1362 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:46:16.729632 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-d979c285-08db-48ad-a6df-88b774e69116 tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad0781ce20e54c3a9b7c61e0cccf6918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd48e24dbeaa241d7a97350fb2c8187b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:46:16.737200 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-d979c285-08db-48ad-a6df-88b774e69116 tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] 10.222.0.20 "GET /compute/v2.1/servers/965c7a0f-fa3f-4f5c-92bf-94d8b646a9ae" status: 200 len: 1314 microversion: 2.1 time: 0.157452 Jul 06 13:46:16.737761 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 77/174] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:46:16 2022] GET /compute/v2.1/servers/965c7a0f-fa3f-4f5c-92bf-94d8b646a9ae => generated 1314 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 06 13:46:17.329260 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-d76fecd3-9978-49e0-8b1b-942ff5fec345 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Calling method '>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:46:17.330005 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-d76fecd3-9978-49e0-8b1b-942ff5fec345 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] [instance: c801676d-524f-42fc-a2b8-fe4186986d95] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:46:17.335819 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-d76fecd3-9978-49e0-8b1b-942ff5fec345 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:46:17.336267 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-d76fecd3-9978-49e0-8b1b-942ff5fec345 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:46:17.337042 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-d76fecd3-9978-49e0-8b1b-942ff5fec345 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:46:17.337474 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-d76fecd3-9978-49e0-8b1b-942ff5fec345 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:46:17.476878 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-f9f379b9-4e3f-4d41-958c-94590954e9bf tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:46:17.478405 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-f9f379b9-4e3f-4d41-958c-94590954e9bf tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] [instance: 5cf73c2b-28f6-49f1-a119-224c05679d2c] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:46:17.486234 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-f9f379b9-4e3f-4d41-958c-94590954e9bf tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:46:17.486800 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-f9f379b9-4e3f-4d41-958c-94590954e9bf tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:46:17.487814 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-f9f379b9-4e3f-4d41-958c-94590954e9bf tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:46:17.488379 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-f9f379b9-4e3f-4d41-958c-94590954e9bf tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:46:17.490989 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-d76fecd3-9978-49e0-8b1b-942ff5fec345 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c83c05bec4f456d8aa7d51732ddc8af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b2a80a004e04da7ae12db9f3f87146f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:46:17.501848 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-d76fecd3-9978-49e0-8b1b-942ff5fec345 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] 10.222.0.20 "GET /compute/v2.1/servers/c801676d-524f-42fc-a2b8-fe4186986d95" status: 200 len: 1322 microversion: 2.1 time: 0.176227 Jul 06 13:46:17.503308 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 98/175] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:46:17 2022] GET /compute/v2.1/servers/c801676d-524f-42fc-a2b8-fe4186986d95 => generated 1322 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:46:17.658005 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-f9f379b9-4e3f-4d41-958c-94590954e9bf tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b572a8f465048558fc969b85b2aec5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd85f2a57a0847debf5aaf81aab7a638', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:46:17.666750 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-f9f379b9-4e3f-4d41-958c-94590954e9bf tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] 10.222.0.20 "GET /compute/v2.1/servers/5cf73c2b-28f6-49f1-a119-224c05679d2c" status: 200 len: 1366 microversion: 2.1 time: 0.195431 Jul 06 13:46:17.667435 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 78/176] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:46:17 2022] GET /compute/v2.1/servers/5cf73c2b-28f6-49f1-a119-224c05679d2c => generated 1366 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:46:17.719119 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-fc9db32a-218a-4d2d-ab7d-92a0ce6a8e2a tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Calling method '>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:46:17.719756 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-fc9db32a-218a-4d2d-ab7d-92a0ce6a8e2a tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] [instance: 546a77fd-66e1-4d89-afa3-58d632b09186] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:46:17.726268 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-fc9db32a-218a-4d2d-ab7d-92a0ce6a8e2a tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:46:17.726874 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-fc9db32a-218a-4d2d-ab7d-92a0ce6a8e2a tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:46:17.727877 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-fc9db32a-218a-4d2d-ab7d-92a0ce6a8e2a tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:46:17.728329 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-fc9db32a-218a-4d2d-ab7d-92a0ce6a8e2a tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:46:17.754814 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-de28754f-4f72-4174-a54b-22d0d86c8c37 tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:46:17.755390 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-de28754f-4f72-4174-a54b-22d0d86c8c37 tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] [instance: 965c7a0f-fa3f-4f5c-92bf-94d8b646a9ae] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:46:17.761920 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-de28754f-4f72-4174-a54b-22d0d86c8c37 tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:46:17.762362 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-de28754f-4f72-4174-a54b-22d0d86c8c37 tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:46:17.763112 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-de28754f-4f72-4174-a54b-22d0d86c8c37 tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:46:17.763533 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-de28754f-4f72-4174-a54b-22d0d86c8c37 tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:46:17.857741 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-fc9db32a-218a-4d2d-ab7d-92a0ce6a8e2a tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d7cacb73c8342579d9f990b0193487c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05df572327d54bd99595974b75898052', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:46:17.865130 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-fc9db32a-218a-4d2d-ab7d-92a0ce6a8e2a tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] 10.222.0.20 "GET /compute/v2.1/servers/546a77fd-66e1-4d89-afa3-58d632b09186" status: 200 len: 1362 microversion: 2.1 time: 0.150032 Jul 06 13:46:17.865933 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 99/177] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:46:17 2022] GET /compute/v2.1/servers/546a77fd-66e1-4d89-afa3-58d632b09186 => generated 1362 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:46:17.896775 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-de28754f-4f72-4174-a54b-22d0d86c8c37 tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad0781ce20e54c3a9b7c61e0cccf6918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd48e24dbeaa241d7a97350fb2c8187b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:46:17.904890 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-de28754f-4f72-4174-a54b-22d0d86c8c37 tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] 10.222.0.20 "GET /compute/v2.1/servers/965c7a0f-fa3f-4f5c-92bf-94d8b646a9ae" status: 200 len: 1314 microversion: 2.1 time: 0.153861 Jul 06 13:46:17.905634 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 79/178] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:46:17 2022] GET /compute/v2.1/servers/965c7a0f-fa3f-4f5c-92bf-94d8b646a9ae => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 06 13:46:18.522217 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-85b0e7bf-9278-4955-ae98-bc9ef22f8603 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Calling method '>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:46:18.523734 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-85b0e7bf-9278-4955-ae98-bc9ef22f8603 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] [instance: c801676d-524f-42fc-a2b8-fe4186986d95] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:46:18.532291 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-85b0e7bf-9278-4955-ae98-bc9ef22f8603 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:46:18.533046 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-85b0e7bf-9278-4955-ae98-bc9ef22f8603 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:46:18.533993 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-85b0e7bf-9278-4955-ae98-bc9ef22f8603 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:46:18.535061 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-85b0e7bf-9278-4955-ae98-bc9ef22f8603 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:46:18.626070 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [req-cf605fca-2a3d-4bfc-816a-e23acf087f38 req-87404ffa-220d-4934-a5d2-4fec589e5463 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "965c7a0f-fa3f-4f5c-92bf-94d8b646a9ae", "name": "network-vif-plugged", "status": "completed", "tag": "8a192dda-4324-4e22-921f-fbd7d7236d23"}]} {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 06 13:46:18.641265 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [req-cf605fca-2a3d-4bfc-816a-e23acf087f38 req-87404ffa-220d-4934-a5d2-4fec589e5463 service nova] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:46:18.642171 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [req-cf605fca-2a3d-4bfc-816a-e23acf087f38 req-87404ffa-220d-4934-a5d2-4fec589e5463 service nova] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:46:18.669429 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.compute.server_external_events [req-cf605fca-2a3d-4bfc-816a-e23acf087f38 req-87404ffa-220d-4934-a5d2-4fec589e5463 service nova] Creating event network-vif-plugged:8a192dda-4324-4e22-921f-fbd7d7236d23 for instance 965c7a0f-fa3f-4f5c-92bf-94d8b646a9ae on hv-cinder-81914 Jul 06 13:46:18.684016 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [req-cf605fca-2a3d-4bfc-816a-e23acf087f38 req-87404ffa-220d-4934-a5d2-4fec589e5463 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.132727 Jul 06 13:46:18.688249 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 80/179] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 6 13:46:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 06 13:46:18.702306 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-4f1800d9-5592-40ab-a389-4958faf40de7 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:46:18.708102 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-4f1800d9-5592-40ab-a389-4958faf40de7 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] [instance: 5cf73c2b-28f6-49f1-a119-224c05679d2c] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:46:18.723774 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-4f1800d9-5592-40ab-a389-4958faf40de7 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:46:18.724241 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-4f1800d9-5592-40ab-a389-4958faf40de7 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:46:18.725043 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-4f1800d9-5592-40ab-a389-4958faf40de7 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:46:18.726947 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-4f1800d9-5592-40ab-a389-4958faf40de7 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:46:18.768089 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-85b0e7bf-9278-4955-ae98-bc9ef22f8603 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c83c05bec4f456d8aa7d51732ddc8af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b2a80a004e04da7ae12db9f3f87146f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:46:18.777193 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-85b0e7bf-9278-4955-ae98-bc9ef22f8603 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] 10.222.0.20 "GET /compute/v2.1/servers/c801676d-524f-42fc-a2b8-fe4186986d95" status: 200 len: 1322 microversion: 2.1 time: 0.261858 Jul 06 13:46:18.790620 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 100/180] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:46:18 2022] GET /compute/v2.1/servers/c801676d-524f-42fc-a2b8-fe4186986d95 => generated 1322 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:46:18.884041 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-1daf3245-77bb-4a9e-8c21-e606429e5b73 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Calling method '>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:46:18.885300 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-1daf3245-77bb-4a9e-8c21-e606429e5b73 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] [instance: 546a77fd-66e1-4d89-afa3-58d632b09186] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:46:18.893407 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-1daf3245-77bb-4a9e-8c21-e606429e5b73 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:46:18.894277 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-4f1800d9-5592-40ab-a389-4958faf40de7 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b572a8f465048558fc969b85b2aec5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd85f2a57a0847debf5aaf81aab7a638', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:46:18.894793 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-1daf3245-77bb-4a9e-8c21-e606429e5b73 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:46:18.896026 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-1daf3245-77bb-4a9e-8c21-e606429e5b73 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:46:18.896871 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-1daf3245-77bb-4a9e-8c21-e606429e5b73 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:46:18.904831 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-4f1800d9-5592-40ab-a389-4958faf40de7 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] 10.222.0.20 "GET /compute/v2.1/servers/5cf73c2b-28f6-49f1-a119-224c05679d2c" status: 200 len: 1366 microversion: 2.1 time: 0.215070 Jul 06 13:46:18.905446 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 81/181] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:46:18 2022] GET /compute/v2.1/servers/5cf73c2b-28f6-49f1-a119-224c05679d2c => generated 1366 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:46:18.922295 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-c46c8c99-8b20-4126-a8ee-50f003bc3299 tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:46:18.923231 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-c46c8c99-8b20-4126-a8ee-50f003bc3299 tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] [instance: 965c7a0f-fa3f-4f5c-92bf-94d8b646a9ae] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:46:18.931969 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-c46c8c99-8b20-4126-a8ee-50f003bc3299 tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:46:18.932713 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-c46c8c99-8b20-4126-a8ee-50f003bc3299 tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:46:18.934351 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-c46c8c99-8b20-4126-a8ee-50f003bc3299 tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:46:18.935048 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-c46c8c99-8b20-4126-a8ee-50f003bc3299 tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:46:19.149382 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-c46c8c99-8b20-4126-a8ee-50f003bc3299 tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad0781ce20e54c3a9b7c61e0cccf6918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd48e24dbeaa241d7a97350fb2c8187b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:46:19.157612 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-1daf3245-77bb-4a9e-8c21-e606429e5b73 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d7cacb73c8342579d9f990b0193487c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05df572327d54bd99595974b75898052', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:46:19.158689 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-c46c8c99-8b20-4126-a8ee-50f003bc3299 tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] 10.222.0.20 "GET /compute/v2.1/servers/965c7a0f-fa3f-4f5c-92bf-94d8b646a9ae" status: 200 len: 1314 microversion: 2.1 time: 0.239982 Jul 06 13:46:19.161112 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 82/182] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:46:18 2022] GET /compute/v2.1/servers/965c7a0f-fa3f-4f5c-92bf-94d8b646a9ae => generated 1314 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 06 13:46:19.172162 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-1daf3245-77bb-4a9e-8c21-e606429e5b73 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] 10.222.0.20 "GET /compute/v2.1/servers/546a77fd-66e1-4d89-afa3-58d632b09186" status: 200 len: 1362 microversion: 2.1 time: 0.293267 Jul 06 13:46:19.173095 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 101/183] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:46:18 2022] GET /compute/v2.1/servers/546a77fd-66e1-4d89-afa3-58d632b09186 => generated 1362 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 06 13:46:19.796567 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-6c242e96-b952-4c3c-b3c1-71135552d82e tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:46:19.797987 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-6c242e96-b952-4c3c-b3c1-71135552d82e tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] [instance: c801676d-524f-42fc-a2b8-fe4186986d95] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:46:19.806297 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-6c242e96-b952-4c3c-b3c1-71135552d82e tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:46:19.806949 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-6c242e96-b952-4c3c-b3c1-71135552d82e tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:46:19.807879 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-6c242e96-b952-4c3c-b3c1-71135552d82e tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:46:19.808637 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-6c242e96-b952-4c3c-b3c1-71135552d82e tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:46:19.922405 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-4bab4177-2131-4f06-bdd4-2ddcfd963c6c tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Calling method '>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:46:19.923155 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-4bab4177-2131-4f06-bdd4-2ddcfd963c6c tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] [instance: 5cf73c2b-28f6-49f1-a119-224c05679d2c] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:46:19.931510 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-4bab4177-2131-4f06-bdd4-2ddcfd963c6c tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:46:19.932225 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-4bab4177-2131-4f06-bdd4-2ddcfd963c6c tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:46:19.933309 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-4bab4177-2131-4f06-bdd4-2ddcfd963c6c tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:46:19.933941 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-4bab4177-2131-4f06-bdd4-2ddcfd963c6c tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:46:19.955696 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-6c242e96-b952-4c3c-b3c1-71135552d82e tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c83c05bec4f456d8aa7d51732ddc8af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b2a80a004e04da7ae12db9f3f87146f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:46:19.964112 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-6c242e96-b952-4c3c-b3c1-71135552d82e tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] 10.222.0.20 "GET /compute/v2.1/servers/c801676d-524f-42fc-a2b8-fe4186986d95" status: 200 len: 1322 microversion: 2.1 time: 0.171939 Jul 06 13:46:19.964936 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 83/184] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:46:19 2022] GET /compute/v2.1/servers/c801676d-524f-42fc-a2b8-fe4186986d95 => generated 1322 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:46:20.079941 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-4bab4177-2131-4f06-bdd4-2ddcfd963c6c tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b572a8f465048558fc969b85b2aec5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd85f2a57a0847debf5aaf81aab7a638', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:46:20.088263 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-4bab4177-2131-4f06-bdd4-2ddcfd963c6c tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] 10.222.0.20 "GET /compute/v2.1/servers/5cf73c2b-28f6-49f1-a119-224c05679d2c" status: 200 len: 1366 microversion: 2.1 time: 0.169850 Jul 06 13:46:20.088840 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 102/185] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:46:19 2022] GET /compute/v2.1/servers/5cf73c2b-28f6-49f1-a119-224c05679d2c => generated 1366 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 06 13:46:20.176479 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-326a1550-74df-4893-afab-e5e3f7da1b48 tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:46:20.177113 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-326a1550-74df-4893-afab-e5e3f7da1b48 tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] [instance: 965c7a0f-fa3f-4f5c-92bf-94d8b646a9ae] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:46:20.183961 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-326a1550-74df-4893-afab-e5e3f7da1b48 tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:46:20.184407 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-326a1550-74df-4893-afab-e5e3f7da1b48 tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:46:20.185495 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-326a1550-74df-4893-afab-e5e3f7da1b48 tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:46:20.185924 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-326a1550-74df-4893-afab-e5e3f7da1b48 tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:46:20.190325 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-b269eef9-6b11-4594-ae5b-0c694a80c729 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Calling method '>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:46:20.190945 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-b269eef9-6b11-4594-ae5b-0c694a80c729 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] [instance: 546a77fd-66e1-4d89-afa3-58d632b09186] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:46:20.197245 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-b269eef9-6b11-4594-ae5b-0c694a80c729 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:46:20.197696 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-b269eef9-6b11-4594-ae5b-0c694a80c729 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:46:20.198474 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-b269eef9-6b11-4594-ae5b-0c694a80c729 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:46:20.198909 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-b269eef9-6b11-4594-ae5b-0c694a80c729 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:46:20.342639 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-b269eef9-6b11-4594-ae5b-0c694a80c729 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d7cacb73c8342579d9f990b0193487c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05df572327d54bd99595974b75898052', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:46:20.350405 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-b269eef9-6b11-4594-ae5b-0c694a80c729 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] 10.222.0.20 "GET /compute/v2.1/servers/546a77fd-66e1-4d89-afa3-58d632b09186" status: 200 len: 1362 microversion: 2.1 time: 0.164135 Jul 06 13:46:20.351677 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 103/186] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:46:20 2022] GET /compute/v2.1/servers/546a77fd-66e1-4d89-afa3-58d632b09186 => generated 1362 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:46:20.392971 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-326a1550-74df-4893-afab-e5e3f7da1b48 tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad0781ce20e54c3a9b7c61e0cccf6918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd48e24dbeaa241d7a97350fb2c8187b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:46:20.401113 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-326a1550-74df-4893-afab-e5e3f7da1b48 tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] 10.222.0.20 "GET /compute/v2.1/servers/965c7a0f-fa3f-4f5c-92bf-94d8b646a9ae" status: 200 len: 1314 microversion: 2.1 time: 0.228711 Jul 06 13:46:20.401691 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 84/187] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:46:20 2022] GET /compute/v2.1/servers/965c7a0f-fa3f-4f5c-92bf-94d8b646a9ae => generated 1314 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:46:20.721156 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [req-fd18f7cb-d51f-44b4-8f56-77d52011467e req-8c69511c-0a52-4032-9836-bc720e00d82d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c801676d-524f-42fc-a2b8-fe4186986d95", "name": "network-vif-plugged", "status": "completed", "tag": "13a49a96-2359-4685-a057-014466405458"}]} {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 06 13:46:20.729833 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [req-fd18f7cb-d51f-44b4-8f56-77d52011467e req-8c69511c-0a52-4032-9836-bc720e00d82d service nova] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:46:20.730271 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [req-fd18f7cb-d51f-44b4-8f56-77d52011467e req-8c69511c-0a52-4032-9836-bc720e00d82d service nova] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:46:20.745568 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.compute.server_external_events [req-fd18f7cb-d51f-44b4-8f56-77d52011467e req-8c69511c-0a52-4032-9836-bc720e00d82d service nova] Creating event network-vif-plugged:13a49a96-2359-4685-a057-014466405458 for instance c801676d-524f-42fc-a2b8-fe4186986d95 on hv-cinder-81914 Jul 06 13:46:20.750847 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [req-fd18f7cb-d51f-44b4-8f56-77d52011467e req-8c69511c-0a52-4032-9836-bc720e00d82d service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033181 Jul 06 13:46:20.751768 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 104/188] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 6 13:46:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 06 13:46:20.981322 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-87ff640f-4f17-4631-9e67-a279e91f86f6 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:46:20.982018 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-87ff640f-4f17-4631-9e67-a279e91f86f6 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] [instance: c801676d-524f-42fc-a2b8-fe4186986d95] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:46:20.990671 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-87ff640f-4f17-4631-9e67-a279e91f86f6 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:46:20.990671 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-87ff640f-4f17-4631-9e67-a279e91f86f6 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:46:20.990671 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-87ff640f-4f17-4631-9e67-a279e91f86f6 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:46:20.990671 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-87ff640f-4f17-4631-9e67-a279e91f86f6 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:46:21.109304 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-2ec3f6eb-bf47-4ac1-9915-585f65e57c80 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Calling method '>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:46:21.112172 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-2ec3f6eb-bf47-4ac1-9915-585f65e57c80 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] [instance: 5cf73c2b-28f6-49f1-a119-224c05679d2c] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:46:21.121632 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-2ec3f6eb-bf47-4ac1-9915-585f65e57c80 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:46:21.122642 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-2ec3f6eb-bf47-4ac1-9915-585f65e57c80 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:46:21.123915 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-2ec3f6eb-bf47-4ac1-9915-585f65e57c80 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:46:21.124837 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-2ec3f6eb-bf47-4ac1-9915-585f65e57c80 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:46:21.131469 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-87ff640f-4f17-4631-9e67-a279e91f86f6 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c83c05bec4f456d8aa7d51732ddc8af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b2a80a004e04da7ae12db9f3f87146f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:46:21.150442 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-87ff640f-4f17-4631-9e67-a279e91f86f6 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] 10.222.0.20 "GET /compute/v2.1/servers/c801676d-524f-42fc-a2b8-fe4186986d95" status: 200 len: 1322 microversion: 2.1 time: 0.172106 Jul 06 13:46:21.153043 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 85/189] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:46:20 2022] GET /compute/v2.1/servers/c801676d-524f-42fc-a2b8-fe4186986d95 => generated 1322 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 06 13:46:21.279783 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-2ec3f6eb-bf47-4ac1-9915-585f65e57c80 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b572a8f465048558fc969b85b2aec5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd85f2a57a0847debf5aaf81aab7a638', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:46:21.287349 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-2ec3f6eb-bf47-4ac1-9915-585f65e57c80 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] 10.222.0.20 "GET /compute/v2.1/servers/5cf73c2b-28f6-49f1-a119-224c05679d2c" status: 200 len: 1366 microversion: 2.1 time: 0.185445 Jul 06 13:46:21.288148 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 105/190] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:46:21 2022] GET /compute/v2.1/servers/5cf73c2b-28f6-49f1-a119-224c05679d2c => generated 1366 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 06 13:46:21.368334 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-1b6bc38f-5fa5-467d-b60b-7f4778b14879 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:46:21.368939 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-1b6bc38f-5fa5-467d-b60b-7f4778b14879 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] [instance: 546a77fd-66e1-4d89-afa3-58d632b09186] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:46:21.374868 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-1b6bc38f-5fa5-467d-b60b-7f4778b14879 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:46:21.375305 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-1b6bc38f-5fa5-467d-b60b-7f4778b14879 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:46:21.376068 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-1b6bc38f-5fa5-467d-b60b-7f4778b14879 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:46:21.376491 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-1b6bc38f-5fa5-467d-b60b-7f4778b14879 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:46:21.418207 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-9fcc0418-42ca-4acc-bc43-501245d4ccc0 tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] Calling method '>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:46:21.418809 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-9fcc0418-42ca-4acc-bc43-501245d4ccc0 tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] [instance: 965c7a0f-fa3f-4f5c-92bf-94d8b646a9ae] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:46:21.425521 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-9fcc0418-42ca-4acc-bc43-501245d4ccc0 tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:46:21.426262 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-9fcc0418-42ca-4acc-bc43-501245d4ccc0 tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:46:21.427128 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-9fcc0418-42ca-4acc-bc43-501245d4ccc0 tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:46:21.427637 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-9fcc0418-42ca-4acc-bc43-501245d4ccc0 tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:46:21.563047 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-9fcc0418-42ca-4acc-bc43-501245d4ccc0 tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad0781ce20e54c3a9b7c61e0cccf6918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd48e24dbeaa241d7a97350fb2c8187b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:46:21.563215 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-1b6bc38f-5fa5-467d-b60b-7f4778b14879 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d7cacb73c8342579d9f990b0193487c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05df572327d54bd99595974b75898052', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:46:21.571502 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-1b6bc38f-5fa5-467d-b60b-7f4778b14879 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] 10.222.0.20 "GET /compute/v2.1/servers/546a77fd-66e1-4d89-afa3-58d632b09186" status: 200 len: 1362 microversion: 2.1 time: 0.207636 Jul 06 13:46:21.571911 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-9fcc0418-42ca-4acc-bc43-501245d4ccc0 tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] 10.222.0.20 "GET /compute/v2.1/servers/965c7a0f-fa3f-4f5c-92bf-94d8b646a9ae" status: 200 len: 1314 microversion: 2.1 time: 0.157304 Jul 06 13:46:21.572373 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 86/191] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:46:21 2022] GET /compute/v2.1/servers/546a77fd-66e1-4d89-afa3-58d632b09186 => generated 1362 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:46:21.577264 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 106/192] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:46:21 2022] GET /compute/v2.1/servers/965c7a0f-fa3f-4f5c-92bf-94d8b646a9ae => generated 1314 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 06 13:46:22.169023 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-078fc5ae-50a8-4ccf-9842-7a92e9f63ef1 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:46:22.172616 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-078fc5ae-50a8-4ccf-9842-7a92e9f63ef1 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] [instance: c801676d-524f-42fc-a2b8-fe4186986d95] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:46:22.182948 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-078fc5ae-50a8-4ccf-9842-7a92e9f63ef1 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:46:22.196946 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-078fc5ae-50a8-4ccf-9842-7a92e9f63ef1 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:46:22.197978 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-078fc5ae-50a8-4ccf-9842-7a92e9f63ef1 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:46:22.200111 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-078fc5ae-50a8-4ccf-9842-7a92e9f63ef1 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:46:22.304711 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-1b319af5-f074-43c9-89b0-689d9943155a tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Calling method '>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:46:22.310576 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-1b319af5-f074-43c9-89b0-689d9943155a tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] [instance: 5cf73c2b-28f6-49f1-a119-224c05679d2c] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:46:22.318172 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-1b319af5-f074-43c9-89b0-689d9943155a tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:46:22.319021 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-1b319af5-f074-43c9-89b0-689d9943155a tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:46:22.320257 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-1b319af5-f074-43c9-89b0-689d9943155a tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:46:22.320904 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-1b319af5-f074-43c9-89b0-689d9943155a tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:46:22.371077 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-078fc5ae-50a8-4ccf-9842-7a92e9f63ef1 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c83c05bec4f456d8aa7d51732ddc8af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b2a80a004e04da7ae12db9f3f87146f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:46:22.378966 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-078fc5ae-50a8-4ccf-9842-7a92e9f63ef1 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] 10.222.0.20 "GET /compute/v2.1/servers/c801676d-524f-42fc-a2b8-fe4186986d95" status: 200 len: 1322 microversion: 2.1 time: 0.214864 Jul 06 13:46:22.379688 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 87/193] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:46:22 2022] GET /compute/v2.1/servers/c801676d-524f-42fc-a2b8-fe4186986d95 => generated 1322 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:46:22.537340 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-1b319af5-f074-43c9-89b0-689d9943155a tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b572a8f465048558fc969b85b2aec5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd85f2a57a0847debf5aaf81aab7a638', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:46:22.547523 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-1b319af5-f074-43c9-89b0-689d9943155a tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] 10.222.0.20 "GET /compute/v2.1/servers/5cf73c2b-28f6-49f1-a119-224c05679d2c" status: 200 len: 1366 microversion: 2.1 time: 0.247651 Jul 06 13:46:22.548376 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 107/194] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:46:22 2022] GET /compute/v2.1/servers/5cf73c2b-28f6-49f1-a119-224c05679d2c => generated 1366 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:46:22.588371 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-c78829eb-0db9-4f80-9282-4b4d2eec12b5 tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:46:22.589106 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-c78829eb-0db9-4f80-9282-4b4d2eec12b5 tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] [instance: 965c7a0f-fa3f-4f5c-92bf-94d8b646a9ae] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:46:22.601350 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-c78829eb-0db9-4f80-9282-4b4d2eec12b5 tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:46:22.602791 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-5c47c25a-f0e8-4ce5-b3a3-dabc64eaf968 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Calling method '>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:46:22.603245 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-c78829eb-0db9-4f80-9282-4b4d2eec12b5 tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:46:22.604878 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-5c47c25a-f0e8-4ce5-b3a3-dabc64eaf968 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] [instance: 546a77fd-66e1-4d89-afa3-58d632b09186] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:46:22.605160 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-c78829eb-0db9-4f80-9282-4b4d2eec12b5 tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:46:22.608542 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-c78829eb-0db9-4f80-9282-4b4d2eec12b5 tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:46:22.615138 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-5c47c25a-f0e8-4ce5-b3a3-dabc64eaf968 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:46:22.620433 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-5c47c25a-f0e8-4ce5-b3a3-dabc64eaf968 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:46:22.630747 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-5c47c25a-f0e8-4ce5-b3a3-dabc64eaf968 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:46:22.631589 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-5c47c25a-f0e8-4ce5-b3a3-dabc64eaf968 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:46:22.785149 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-c78829eb-0db9-4f80-9282-4b4d2eec12b5 tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad0781ce20e54c3a9b7c61e0cccf6918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd48e24dbeaa241d7a97350fb2c8187b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:46:22.798505 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-c78829eb-0db9-4f80-9282-4b4d2eec12b5 tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] 10.222.0.20 "GET /compute/v2.1/servers/965c7a0f-fa3f-4f5c-92bf-94d8b646a9ae" status: 200 len: 1314 microversion: 2.1 time: 0.214541 Jul 06 13:46:22.801860 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 88/195] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:46:22 2022] GET /compute/v2.1/servers/965c7a0f-fa3f-4f5c-92bf-94d8b646a9ae => generated 1314 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:46:22.883075 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-5c47c25a-f0e8-4ce5-b3a3-dabc64eaf968 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d7cacb73c8342579d9f990b0193487c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05df572327d54bd99595974b75898052', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:46:22.892617 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-5c47c25a-f0e8-4ce5-b3a3-dabc64eaf968 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] 10.222.0.20 "GET /compute/v2.1/servers/546a77fd-66e1-4d89-afa3-58d632b09186" status: 200 len: 1362 microversion: 2.1 time: 0.298015 Jul 06 13:46:22.903250 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 108/196] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:46:22 2022] GET /compute/v2.1/servers/546a77fd-66e1-4d89-afa3-58d632b09186 => generated 1362 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:46:23.396810 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-a8ed43a6-8870-4b07-9357-18779daf06a3 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:46:23.397662 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-a8ed43a6-8870-4b07-9357-18779daf06a3 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] [instance: c801676d-524f-42fc-a2b8-fe4186986d95] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:46:23.404753 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-a8ed43a6-8870-4b07-9357-18779daf06a3 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:46:23.405320 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-a8ed43a6-8870-4b07-9357-18779daf06a3 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:46:23.406135 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-a8ed43a6-8870-4b07-9357-18779daf06a3 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:46:23.406549 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-a8ed43a6-8870-4b07-9357-18779daf06a3 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:46:23.565035 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-64e0c9e8-8318-4c4c-a331-d94b85a42ee1 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Calling method '>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:46:23.565846 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-64e0c9e8-8318-4c4c-a331-d94b85a42ee1 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] [instance: 5cf73c2b-28f6-49f1-a119-224c05679d2c] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:46:23.575741 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-64e0c9e8-8318-4c4c-a331-d94b85a42ee1 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:46:23.577185 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-64e0c9e8-8318-4c4c-a331-d94b85a42ee1 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:46:23.578398 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-64e0c9e8-8318-4c4c-a331-d94b85a42ee1 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:46:23.579057 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-64e0c9e8-8318-4c4c-a331-d94b85a42ee1 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:46:23.607096 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG dbcounter [-] [124368] Writing DB stats nova_cell1:SELECT=100 {{(pid=124368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:46:23.750944 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-a8ed43a6-8870-4b07-9357-18779daf06a3 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c83c05bec4f456d8aa7d51732ddc8af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b2a80a004e04da7ae12db9f3f87146f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:46:23.760079 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-a8ed43a6-8870-4b07-9357-18779daf06a3 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] 10.222.0.20 "GET /compute/v2.1/servers/c801676d-524f-42fc-a2b8-fe4186986d95" status: 200 len: 1322 microversion: 2.1 time: 0.367661 Jul 06 13:46:23.760728 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 89/197] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:46:23 2022] GET /compute/v2.1/servers/c801676d-524f-42fc-a2b8-fe4186986d95 => generated 1322 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:46:23.775036 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-64e0c9e8-8318-4c4c-a331-d94b85a42ee1 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b572a8f465048558fc969b85b2aec5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd85f2a57a0847debf5aaf81aab7a638', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:46:23.782594 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-64e0c9e8-8318-4c4c-a331-d94b85a42ee1 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] 10.222.0.20 "GET /compute/v2.1/servers/5cf73c2b-28f6-49f1-a119-224c05679d2c" status: 200 len: 1366 microversion: 2.1 time: 0.221696 Jul 06 13:46:23.783394 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 109/198] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:46:23 2022] GET /compute/v2.1/servers/5cf73c2b-28f6-49f1-a119-224c05679d2c => generated 1366 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 06 13:46:23.817566 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-59794e09-37f0-469f-9286-3958e6616ad5 tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:46:23.819453 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-59794e09-37f0-469f-9286-3958e6616ad5 tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] [instance: 965c7a0f-fa3f-4f5c-92bf-94d8b646a9ae] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:46:23.826080 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-59794e09-37f0-469f-9286-3958e6616ad5 tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:46:23.826527 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-59794e09-37f0-469f-9286-3958e6616ad5 tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:46:23.827569 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-59794e09-37f0-469f-9286-3958e6616ad5 tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:46:23.827726 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-59794e09-37f0-469f-9286-3958e6616ad5 tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:46:23.911009 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-98581ebf-aede-486f-b882-e4d866a690bb tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Calling method '>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:46:23.911919 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-98581ebf-aede-486f-b882-e4d866a690bb tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] [instance: 546a77fd-66e1-4d89-afa3-58d632b09186] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:46:23.933373 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-98581ebf-aede-486f-b882-e4d866a690bb tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:46:23.934546 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-98581ebf-aede-486f-b882-e4d866a690bb tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:46:23.935545 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-98581ebf-aede-486f-b882-e4d866a690bb tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:46:23.937647 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-98581ebf-aede-486f-b882-e4d866a690bb tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:46:24.093303 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-59794e09-37f0-469f-9286-3958e6616ad5 tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad0781ce20e54c3a9b7c61e0cccf6918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd48e24dbeaa241d7a97350fb2c8187b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:46:24.102199 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-59794e09-37f0-469f-9286-3958e6616ad5 tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] 10.222.0.20 "GET /compute/v2.1/servers/965c7a0f-fa3f-4f5c-92bf-94d8b646a9ae" status: 200 len: 1314 microversion: 2.1 time: 0.290196 Jul 06 13:46:24.104472 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 90/199] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:46:23 2022] GET /compute/v2.1/servers/965c7a0f-fa3f-4f5c-92bf-94d8b646a9ae => generated 1314 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:46:24.148297 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-98581ebf-aede-486f-b882-e4d866a690bb tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d7cacb73c8342579d9f990b0193487c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05df572327d54bd99595974b75898052', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:46:24.167219 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-98581ebf-aede-486f-b882-e4d866a690bb tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] 10.222.0.20 "GET /compute/v2.1/servers/546a77fd-66e1-4d89-afa3-58d632b09186" status: 200 len: 1362 microversion: 2.1 time: 0.259990 Jul 06 13:46:24.168091 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 110/200] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:46:23 2022] GET /compute/v2.1/servers/546a77fd-66e1-4d89-afa3-58d632b09186 => generated 1362 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 06 13:46:24.791503 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-575ff738-ad07-403d-9eb3-1d96581bd1d9 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:46:24.792115 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-575ff738-ad07-403d-9eb3-1d96581bd1d9 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] [instance: c801676d-524f-42fc-a2b8-fe4186986d95] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:46:24.801452 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-63e322c9-dc5a-4aec-a278-4e4abacefb16 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Calling method '>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:46:24.802076 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-63e322c9-dc5a-4aec-a278-4e4abacefb16 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] [instance: 5cf73c2b-28f6-49f1-a119-224c05679d2c] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:46:24.807770 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-575ff738-ad07-403d-9eb3-1d96581bd1d9 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:46:24.808566 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-575ff738-ad07-403d-9eb3-1d96581bd1d9 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:46:24.810612 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-575ff738-ad07-403d-9eb3-1d96581bd1d9 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:46:24.811613 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-575ff738-ad07-403d-9eb3-1d96581bd1d9 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:46:24.822062 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-63e322c9-dc5a-4aec-a278-4e4abacefb16 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:46:24.822517 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-63e322c9-dc5a-4aec-a278-4e4abacefb16 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:46:24.823299 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-63e322c9-dc5a-4aec-a278-4e4abacefb16 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:46:24.823899 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-63e322c9-dc5a-4aec-a278-4e4abacefb16 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:46:25.023260 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-63e322c9-dc5a-4aec-a278-4e4abacefb16 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b572a8f465048558fc969b85b2aec5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd85f2a57a0847debf5aaf81aab7a638', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:46:25.034453 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-63e322c9-dc5a-4aec-a278-4e4abacefb16 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] 10.222.0.20 "GET /compute/v2.1/servers/5cf73c2b-28f6-49f1-a119-224c05679d2c" status: 200 len: 1366 microversion: 2.1 time: 0.238608 Jul 06 13:46:25.035262 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 111/201] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:46:24 2022] GET /compute/v2.1/servers/5cf73c2b-28f6-49f1-a119-224c05679d2c => generated 1366 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 06 13:46:25.120553 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-69b5dee8-cba8-4fe5-841b-9f2bb76faace tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] Calling method '>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:46:25.121409 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-69b5dee8-cba8-4fe5-841b-9f2bb76faace tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] [instance: 965c7a0f-fa3f-4f5c-92bf-94d8b646a9ae] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:46:25.127737 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-69b5dee8-cba8-4fe5-841b-9f2bb76faace tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:46:25.128265 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-69b5dee8-cba8-4fe5-841b-9f2bb76faace tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:46:25.129162 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-69b5dee8-cba8-4fe5-841b-9f2bb76faace tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:46:25.129683 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-69b5dee8-cba8-4fe5-841b-9f2bb76faace tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:46:25.189967 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-575ff738-ad07-403d-9eb3-1d96581bd1d9 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c83c05bec4f456d8aa7d51732ddc8af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b2a80a004e04da7ae12db9f3f87146f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:46:25.199794 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-575ff738-ad07-403d-9eb3-1d96581bd1d9 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] 10.222.0.20 "GET /compute/v2.1/servers/c801676d-524f-42fc-a2b8-fe4186986d95" status: 200 len: 1322 microversion: 2.1 time: 0.424319 Jul 06 13:46:25.200875 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 91/202] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:46:24 2022] GET /compute/v2.1/servers/c801676d-524f-42fc-a2b8-fe4186986d95 => generated 1322 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:46:25.206207 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-48a073e1-151e-405f-a163-caf9931c654c tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:46:25.207110 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-48a073e1-151e-405f-a163-caf9931c654c tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] [instance: 546a77fd-66e1-4d89-afa3-58d632b09186] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:46:25.237336 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-48a073e1-151e-405f-a163-caf9931c654c tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:46:25.241111 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-48a073e1-151e-405f-a163-caf9931c654c tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:46:25.242250 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-48a073e1-151e-405f-a163-caf9931c654c tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:46:25.245618 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-48a073e1-151e-405f-a163-caf9931c654c tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:46:25.337523 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-69b5dee8-cba8-4fe5-841b-9f2bb76faace tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad0781ce20e54c3a9b7c61e0cccf6918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd48e24dbeaa241d7a97350fb2c8187b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:46:25.345878 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-69b5dee8-cba8-4fe5-841b-9f2bb76faace tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] 10.222.0.20 "GET /compute/v2.1/servers/965c7a0f-fa3f-4f5c-92bf-94d8b646a9ae" status: 200 len: 1314 microversion: 2.1 time: 0.230648 Jul 06 13:46:25.347218 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 112/203] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:46:25 2022] GET /compute/v2.1/servers/965c7a0f-fa3f-4f5c-92bf-94d8b646a9ae => generated 1314 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:46:25.512121 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-48a073e1-151e-405f-a163-caf9931c654c tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d7cacb73c8342579d9f990b0193487c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05df572327d54bd99595974b75898052', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:46:25.519691 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-48a073e1-151e-405f-a163-caf9931c654c tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] 10.222.0.20 "GET /compute/v2.1/servers/546a77fd-66e1-4d89-afa3-58d632b09186" status: 200 len: 1362 microversion: 2.1 time: 0.317490 Jul 06 13:46:25.520344 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 92/204] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:46:25 2022] GET /compute/v2.1/servers/546a77fd-66e1-4d89-afa3-58d632b09186 => generated 1362 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:46:26.050646 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-a2259f77-bbd8-48cc-92ee-333d781c674b tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Calling method '>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:46:26.052142 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-a2259f77-bbd8-48cc-92ee-333d781c674b tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] [instance: 5cf73c2b-28f6-49f1-a119-224c05679d2c] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:46:26.054471 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG dbcounter [-] [124368] Writing DB stats nova_api:SELECT=100 {{(pid=124368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:46:26.060479 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-a2259f77-bbd8-48cc-92ee-333d781c674b tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:46:26.061091 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-a2259f77-bbd8-48cc-92ee-333d781c674b tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:46:26.061932 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-a2259f77-bbd8-48cc-92ee-333d781c674b tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:46:26.062432 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-a2259f77-bbd8-48cc-92ee-333d781c674b tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:46:26.216091 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-a2259f77-bbd8-48cc-92ee-333d781c674b tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b572a8f465048558fc969b85b2aec5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd85f2a57a0847debf5aaf81aab7a638', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:46:26.216922 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-05068276-8838-4f0d-9238-8baf7b002436 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:46:26.217568 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-05068276-8838-4f0d-9238-8baf7b002436 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] [instance: c801676d-524f-42fc-a2b8-fe4186986d95] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:46:26.224148 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-05068276-8838-4f0d-9238-8baf7b002436 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:46:26.224325 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-a2259f77-bbd8-48cc-92ee-333d781c674b tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] 10.222.0.20 "GET /compute/v2.1/servers/5cf73c2b-28f6-49f1-a119-224c05679d2c" status: 200 len: 1366 microversion: 2.1 time: 0.177194 Jul 06 13:46:26.225076 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-05068276-8838-4f0d-9238-8baf7b002436 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:46:26.226773 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-05068276-8838-4f0d-9238-8baf7b002436 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:46:26.227409 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-05068276-8838-4f0d-9238-8baf7b002436 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:46:26.233788 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 113/205] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:46:26 2022] GET /compute/v2.1/servers/5cf73c2b-28f6-49f1-a119-224c05679d2c => generated 1366 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:46:26.249243 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG dbcounter [-] [124367] Writing DB stats nova_cell1:SELECT=100 {{(pid=124367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:46:26.366327 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-349b27fe-d9b5-4f84-a813-117aba18ac41 tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] Calling method '>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:46:26.367145 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-349b27fe-d9b5-4f84-a813-117aba18ac41 tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] [instance: 965c7a0f-fa3f-4f5c-92bf-94d8b646a9ae] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:46:26.374373 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-349b27fe-d9b5-4f84-a813-117aba18ac41 tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:46:26.374826 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-349b27fe-d9b5-4f84-a813-117aba18ac41 tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:46:26.375606 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-349b27fe-d9b5-4f84-a813-117aba18ac41 tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:46:26.376047 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-349b27fe-d9b5-4f84-a813-117aba18ac41 tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:46:26.418427 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-05068276-8838-4f0d-9238-8baf7b002436 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c83c05bec4f456d8aa7d51732ddc8af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b2a80a004e04da7ae12db9f3f87146f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:46:26.426377 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-05068276-8838-4f0d-9238-8baf7b002436 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] 10.222.0.20 "GET /compute/v2.1/servers/c801676d-524f-42fc-a2b8-fe4186986d95" status: 200 len: 1322 microversion: 2.1 time: 0.213230 Jul 06 13:46:26.426950 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 93/206] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:46:26 2022] GET /compute/v2.1/servers/c801676d-524f-42fc-a2b8-fe4186986d95 => generated 1322 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 06 13:46:26.525672 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-349b27fe-d9b5-4f84-a813-117aba18ac41 tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad0781ce20e54c3a9b7c61e0cccf6918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd48e24dbeaa241d7a97350fb2c8187b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:46:26.534343 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-349b27fe-d9b5-4f84-a813-117aba18ac41 tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] 10.222.0.20 "GET /compute/v2.1/servers/965c7a0f-fa3f-4f5c-92bf-94d8b646a9ae" status: 200 len: 1314 microversion: 2.1 time: 0.173325 Jul 06 13:46:26.535078 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 114/207] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:46:26 2022] GET /compute/v2.1/servers/965c7a0f-fa3f-4f5c-92bf-94d8b646a9ae => generated 1314 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:46:26.540730 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-e66820fe-4ffd-4f70-aeb6-6237fa32efd5 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:46:26.540730 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-e66820fe-4ffd-4f70-aeb6-6237fa32efd5 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] [instance: 546a77fd-66e1-4d89-afa3-58d632b09186] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:46:26.545192 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-e66820fe-4ffd-4f70-aeb6-6237fa32efd5 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:46:26.545647 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-e66820fe-4ffd-4f70-aeb6-6237fa32efd5 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:46:26.546415 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-e66820fe-4ffd-4f70-aeb6-6237fa32efd5 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:46:26.546847 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-e66820fe-4ffd-4f70-aeb6-6237fa32efd5 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:46:26.685879 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-e66820fe-4ffd-4f70-aeb6-6237fa32efd5 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d7cacb73c8342579d9f990b0193487c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05df572327d54bd99595974b75898052', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:46:26.693308 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-e66820fe-4ffd-4f70-aeb6-6237fa32efd5 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] 10.222.0.20 "GET /compute/v2.1/servers/546a77fd-66e1-4d89-afa3-58d632b09186" status: 200 len: 1362 microversion: 2.1 time: 0.159687 Jul 06 13:46:26.694801 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 94/208] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:46:26 2022] GET /compute/v2.1/servers/546a77fd-66e1-4d89-afa3-58d632b09186 => generated 1362 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 06 13:46:27.240453 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-07c9ea13-6fbe-42b2-b338-d06e9090c971 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Calling method '>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:46:27.243052 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-07c9ea13-6fbe-42b2-b338-d06e9090c971 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] [instance: 5cf73c2b-28f6-49f1-a119-224c05679d2c] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:46:27.248306 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-07c9ea13-6fbe-42b2-b338-d06e9090c971 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:46:27.248928 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-07c9ea13-6fbe-42b2-b338-d06e9090c971 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:46:27.249864 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-07c9ea13-6fbe-42b2-b338-d06e9090c971 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:46:27.250513 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-07c9ea13-6fbe-42b2-b338-d06e9090c971 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:46:27.447909 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-76346dff-e8bf-4e51-8223-8590e43612df tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:46:27.448537 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-76346dff-e8bf-4e51-8223-8590e43612df tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] [instance: c801676d-524f-42fc-a2b8-fe4186986d95] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:46:27.453779 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-07c9ea13-6fbe-42b2-b338-d06e9090c971 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b572a8f465048558fc969b85b2aec5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd85f2a57a0847debf5aaf81aab7a638', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:46:27.462795 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-76346dff-e8bf-4e51-8223-8590e43612df tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:46:27.463188 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-07c9ea13-6fbe-42b2-b338-d06e9090c971 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] 10.222.0.20 "GET /compute/v2.1/servers/5cf73c2b-28f6-49f1-a119-224c05679d2c" status: 200 len: 1366 microversion: 2.1 time: 0.226124 Jul 06 13:46:27.463915 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-76346dff-e8bf-4e51-8223-8590e43612df tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:46:27.464152 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 115/209] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:46:27 2022] GET /compute/v2.1/servers/5cf73c2b-28f6-49f1-a119-224c05679d2c => generated 1366 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:46:27.465116 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-76346dff-e8bf-4e51-8223-8590e43612df tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:46:27.465781 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-76346dff-e8bf-4e51-8223-8590e43612df tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:46:27.554889 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-66cbcd2f-ee5f-40f7-87ac-f95c20947fa9 tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] Calling method '>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:46:27.555770 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-66cbcd2f-ee5f-40f7-87ac-f95c20947fa9 tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] [instance: 965c7a0f-fa3f-4f5c-92bf-94d8b646a9ae] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:46:27.562244 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-66cbcd2f-ee5f-40f7-87ac-f95c20947fa9 tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:46:27.562699 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-66cbcd2f-ee5f-40f7-87ac-f95c20947fa9 tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:46:27.563839 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-66cbcd2f-ee5f-40f7-87ac-f95c20947fa9 tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:46:27.564470 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-66cbcd2f-ee5f-40f7-87ac-f95c20947fa9 tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:46:27.710261 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-66cbcd2f-ee5f-40f7-87ac-f95c20947fa9 tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad0781ce20e54c3a9b7c61e0cccf6918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd48e24dbeaa241d7a97350fb2c8187b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:46:27.717864 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-66cbcd2f-ee5f-40f7-87ac-f95c20947fa9 tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] 10.222.0.20 "GET /compute/v2.1/servers/965c7a0f-fa3f-4f5c-92bf-94d8b646a9ae" status: 200 len: 1314 microversion: 2.1 time: 0.167658 Jul 06 13:46:27.727733 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 116/210] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:46:27 2022] GET /compute/v2.1/servers/965c7a0f-fa3f-4f5c-92bf-94d8b646a9ae => generated 1314 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:46:27.732549 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-868f972a-a079-4ca0-8a2c-4f91327291d4 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Calling method '>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:46:27.733445 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-868f972a-a079-4ca0-8a2c-4f91327291d4 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] [instance: 546a77fd-66e1-4d89-afa3-58d632b09186] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:46:27.735077 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-76346dff-e8bf-4e51-8223-8590e43612df tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c83c05bec4f456d8aa7d51732ddc8af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b2a80a004e04da7ae12db9f3f87146f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:46:27.741249 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-868f972a-a079-4ca0-8a2c-4f91327291d4 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:46:27.742011 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-868f972a-a079-4ca0-8a2c-4f91327291d4 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:46:27.743013 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-868f972a-a079-4ca0-8a2c-4f91327291d4 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:46:27.743646 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-868f972a-a079-4ca0-8a2c-4f91327291d4 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:46:27.747688 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-76346dff-e8bf-4e51-8223-8590e43612df tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] 10.222.0.20 "GET /compute/v2.1/servers/c801676d-524f-42fc-a2b8-fe4186986d95" status: 200 len: 1322 microversion: 2.1 time: 0.307719 Jul 06 13:46:27.751664 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 95/211] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:46:27 2022] GET /compute/v2.1/servers/c801676d-524f-42fc-a2b8-fe4186986d95 => generated 1322 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 06 13:46:27.899737 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-868f972a-a079-4ca0-8a2c-4f91327291d4 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d7cacb73c8342579d9f990b0193487c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05df572327d54bd99595974b75898052', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:46:27.907812 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-868f972a-a079-4ca0-8a2c-4f91327291d4 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] 10.222.0.20 "GET /compute/v2.1/servers/546a77fd-66e1-4d89-afa3-58d632b09186" status: 200 len: 1362 microversion: 2.1 time: 0.178941 Jul 06 13:46:27.908652 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 117/212] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:46:27 2022] GET /compute/v2.1/servers/546a77fd-66e1-4d89-afa3-58d632b09186 => generated 1362 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:46:28.484761 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-04bbc9f8-5c16-4068-aaa5-967c60020283 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:46:28.485994 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-04bbc9f8-5c16-4068-aaa5-967c60020283 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] [instance: 5cf73c2b-28f6-49f1-a119-224c05679d2c] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:46:28.493581 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-04bbc9f8-5c16-4068-aaa5-967c60020283 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:46:28.494190 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-04bbc9f8-5c16-4068-aaa5-967c60020283 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:46:28.495124 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-04bbc9f8-5c16-4068-aaa5-967c60020283 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:46:28.496016 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-04bbc9f8-5c16-4068-aaa5-967c60020283 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:46:28.735150 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-23623549-0792-4d4c-af1f-a5c03e081ecf tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] Calling method '>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:46:28.735766 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-23623549-0792-4d4c-af1f-a5c03e081ecf tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] [instance: 965c7a0f-fa3f-4f5c-92bf-94d8b646a9ae] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:46:28.738908 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-04bbc9f8-5c16-4068-aaa5-967c60020283 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b572a8f465048558fc969b85b2aec5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd85f2a57a0847debf5aaf81aab7a638', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:46:28.750703 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-23623549-0792-4d4c-af1f-a5c03e081ecf tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:46:28.752722 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-23623549-0792-4d4c-af1f-a5c03e081ecf tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:46:28.757392 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-23623549-0792-4d4c-af1f-a5c03e081ecf tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:46:28.759452 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-23623549-0792-4d4c-af1f-a5c03e081ecf tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:46:28.761708 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-04bbc9f8-5c16-4068-aaa5-967c60020283 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] 10.222.0.20 "GET /compute/v2.1/servers/5cf73c2b-28f6-49f1-a119-224c05679d2c" status: 200 len: 1366 microversion: 2.1 time: 0.283512 Jul 06 13:46:28.772659 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 96/213] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:46:28 2022] GET /compute/v2.1/servers/5cf73c2b-28f6-49f1-a119-224c05679d2c => generated 1366 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:46:28.783556 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-1516e170-7370-4616-9cc9-568a19d871e0 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:46:28.785463 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-1516e170-7370-4616-9cc9-568a19d871e0 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] [instance: c801676d-524f-42fc-a2b8-fe4186986d95] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:46:28.797250 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-1516e170-7370-4616-9cc9-568a19d871e0 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:46:28.802246 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-1516e170-7370-4616-9cc9-568a19d871e0 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:46:28.803148 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-1516e170-7370-4616-9cc9-568a19d871e0 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:46:28.804257 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-1516e170-7370-4616-9cc9-568a19d871e0 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:46:29.035994 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-23623549-0792-4d4c-af1f-a5c03e081ecf tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad0781ce20e54c3a9b7c61e0cccf6918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd48e24dbeaa241d7a97350fb2c8187b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:46:29.059217 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-23623549-0792-4d4c-af1f-a5c03e081ecf tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] 10.222.0.20 "GET /compute/v2.1/servers/965c7a0f-fa3f-4f5c-92bf-94d8b646a9ae" status: 200 len: 1314 microversion: 2.1 time: 0.328022 Jul 06 13:46:29.075424 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 118/214] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:46:28 2022] GET /compute/v2.1/servers/965c7a0f-fa3f-4f5c-92bf-94d8b646a9ae => generated 1314 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 06 13:46:29.077450 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-1516e170-7370-4616-9cc9-568a19d871e0 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c83c05bec4f456d8aa7d51732ddc8af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b2a80a004e04da7ae12db9f3f87146f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:46:29.088240 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-10fc2684-631a-4b31-8a3f-3dfa66c39a59 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Calling method '>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:46:29.089160 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-10fc2684-631a-4b31-8a3f-3dfa66c39a59 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] [instance: 546a77fd-66e1-4d89-afa3-58d632b09186] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:46:29.090374 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-1516e170-7370-4616-9cc9-568a19d871e0 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] 10.222.0.20 "GET /compute/v2.1/servers/c801676d-524f-42fc-a2b8-fe4186986d95" status: 200 len: 1322 microversion: 2.1 time: 0.313664 Jul 06 13:46:29.092017 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 97/215] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:46:28 2022] GET /compute/v2.1/servers/c801676d-524f-42fc-a2b8-fe4186986d95 => generated 1322 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:46:29.097478 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-10fc2684-631a-4b31-8a3f-3dfa66c39a59 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:46:29.097925 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-10fc2684-631a-4b31-8a3f-3dfa66c39a59 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:46:29.098729 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-10fc2684-631a-4b31-8a3f-3dfa66c39a59 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:46:29.099163 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-10fc2684-631a-4b31-8a3f-3dfa66c39a59 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:46:29.448382 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-10fc2684-631a-4b31-8a3f-3dfa66c39a59 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d7cacb73c8342579d9f990b0193487c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05df572327d54bd99595974b75898052', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:46:29.460757 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-10fc2684-631a-4b31-8a3f-3dfa66c39a59 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] 10.222.0.20 "GET /compute/v2.1/servers/546a77fd-66e1-4d89-afa3-58d632b09186" status: 200 len: 1362 microversion: 2.1 time: 0.383972 Jul 06 13:46:29.466194 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 119/216] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:46:29 2022] GET /compute/v2.1/servers/546a77fd-66e1-4d89-afa3-58d632b09186 => generated 1362 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:46:29.781655 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-ece19f7b-802a-4941-b656-63e835cd8e96 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:46:29.782891 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-ece19f7b-802a-4941-b656-63e835cd8e96 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] [instance: 5cf73c2b-28f6-49f1-a119-224c05679d2c] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:46:29.799776 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-ece19f7b-802a-4941-b656-63e835cd8e96 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:46:29.800492 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-ece19f7b-802a-4941-b656-63e835cd8e96 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:46:29.801977 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-ece19f7b-802a-4941-b656-63e835cd8e96 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:46:29.802778 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-ece19f7b-802a-4941-b656-63e835cd8e96 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:46:30.080597 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-30db5e09-fc0c-4ccc-8ae3-90550590f93e tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] Calling method '>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:46:30.082424 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-30db5e09-fc0c-4ccc-8ae3-90550590f93e tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] [instance: 965c7a0f-fa3f-4f5c-92bf-94d8b646a9ae] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:46:30.095593 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-30db5e09-fc0c-4ccc-8ae3-90550590f93e tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:46:30.097468 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-30db5e09-fc0c-4ccc-8ae3-90550590f93e tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:46:30.099008 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-30db5e09-fc0c-4ccc-8ae3-90550590f93e tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:46:30.099923 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-30db5e09-fc0c-4ccc-8ae3-90550590f93e tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:46:30.182590 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-ece19f7b-802a-4941-b656-63e835cd8e96 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b572a8f465048558fc969b85b2aec5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd85f2a57a0847debf5aaf81aab7a638', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:46:30.205575 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-ece19f7b-802a-4941-b656-63e835cd8e96 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] 10.222.0.20 "GET /compute/v2.1/servers/5cf73c2b-28f6-49f1-a119-224c05679d2c" status: 200 len: 1366 microversion: 2.1 time: 0.418861 Jul 06 13:46:30.206703 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 98/217] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:46:29 2022] GET /compute/v2.1/servers/5cf73c2b-28f6-49f1-a119-224c05679d2c => generated 1366 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:46:30.236497 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-80f22538-f598-47fb-a29f-017719695a82 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:46:30.241429 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-80f22538-f598-47fb-a29f-017719695a82 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] [instance: c801676d-524f-42fc-a2b8-fe4186986d95] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:46:30.254475 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-80f22538-f598-47fb-a29f-017719695a82 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:46:30.255212 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-80f22538-f598-47fb-a29f-017719695a82 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:46:30.257124 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-80f22538-f598-47fb-a29f-017719695a82 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:46:30.257747 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-80f22538-f598-47fb-a29f-017719695a82 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:46:30.544603 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-30db5e09-fc0c-4ccc-8ae3-90550590f93e tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad0781ce20e54c3a9b7c61e0cccf6918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd48e24dbeaa241d7a97350fb2c8187b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:46:30.556936 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-30db5e09-fc0c-4ccc-8ae3-90550590f93e tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] 10.222.0.20 "GET /compute/v2.1/servers/965c7a0f-fa3f-4f5c-92bf-94d8b646a9ae" status: 200 len: 1314 microversion: 2.1 time: 0.482966 Jul 06 13:46:30.557599 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 120/218] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:46:30 2022] GET /compute/v2.1/servers/965c7a0f-fa3f-4f5c-92bf-94d8b646a9ae => generated 1314 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:46:30.566805 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-87363a9e-c8e4-4d37-9c38-0663ad1fd9c0 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Calling method '>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:46:30.566805 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-87363a9e-c8e4-4d37-9c38-0663ad1fd9c0 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] [instance: 546a77fd-66e1-4d89-afa3-58d632b09186] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:46:30.581786 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-80f22538-f598-47fb-a29f-017719695a82 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c83c05bec4f456d8aa7d51732ddc8af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b2a80a004e04da7ae12db9f3f87146f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:46:30.582190 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-87363a9e-c8e4-4d37-9c38-0663ad1fd9c0 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:46:30.584844 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-87363a9e-c8e4-4d37-9c38-0663ad1fd9c0 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:46:30.587521 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-87363a9e-c8e4-4d37-9c38-0663ad1fd9c0 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:46:30.587997 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-87363a9e-c8e4-4d37-9c38-0663ad1fd9c0 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:46:30.593399 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-80f22538-f598-47fb-a29f-017719695a82 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] 10.222.0.20 "GET /compute/v2.1/servers/c801676d-524f-42fc-a2b8-fe4186986d95" status: 200 len: 1322 microversion: 2.1 time: 0.384233 Jul 06 13:46:30.593987 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 99/219] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:46:30 2022] GET /compute/v2.1/servers/c801676d-524f-42fc-a2b8-fe4186986d95 => generated 1322 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:46:31.050376 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-87363a9e-c8e4-4d37-9c38-0663ad1fd9c0 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d7cacb73c8342579d9f990b0193487c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05df572327d54bd99595974b75898052', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:46:31.060748 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-87363a9e-c8e4-4d37-9c38-0663ad1fd9c0 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] 10.222.0.20 "GET /compute/v2.1/servers/546a77fd-66e1-4d89-afa3-58d632b09186" status: 200 len: 1362 microversion: 2.1 time: 0.502017 Jul 06 13:46:31.061505 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 121/220] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:46:30 2022] GET /compute/v2.1/servers/546a77fd-66e1-4d89-afa3-58d632b09186 => generated 1362 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:46:31.227747 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-fa3d1e34-ab6e-458d-9601-06a5eaf37e7b tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:46:31.231968 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-fa3d1e34-ab6e-458d-9601-06a5eaf37e7b tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] [instance: 5cf73c2b-28f6-49f1-a119-224c05679d2c] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:46:31.282348 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-fa3d1e34-ab6e-458d-9601-06a5eaf37e7b tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:46:31.282819 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-fa3d1e34-ab6e-458d-9601-06a5eaf37e7b tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:46:31.293149 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-fa3d1e34-ab6e-458d-9601-06a5eaf37e7b tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:46:31.293615 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-fa3d1e34-ab6e-458d-9601-06a5eaf37e7b tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:46:31.574821 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-f49de7dd-a3ed-4d0c-89f9-09b54db39ed7 tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] Calling method '>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:46:31.575443 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-f49de7dd-a3ed-4d0c-89f9-09b54db39ed7 tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] [instance: 965c7a0f-fa3f-4f5c-92bf-94d8b646a9ae] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:46:31.591133 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-f49de7dd-a3ed-4d0c-89f9-09b54db39ed7 tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:46:31.592296 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-f49de7dd-a3ed-4d0c-89f9-09b54db39ed7 tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:46:31.598355 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-f49de7dd-a3ed-4d0c-89f9-09b54db39ed7 tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:46:31.598810 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-f49de7dd-a3ed-4d0c-89f9-09b54db39ed7 tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:46:31.610340 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-fa3d1e34-ab6e-458d-9601-06a5eaf37e7b tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b572a8f465048558fc969b85b2aec5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd85f2a57a0847debf5aaf81aab7a638', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:46:31.622810 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-fa3d1e34-ab6e-458d-9601-06a5eaf37e7b tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] 10.222.0.20 "GET /compute/v2.1/servers/5cf73c2b-28f6-49f1-a119-224c05679d2c" status: 200 len: 1366 microversion: 2.1 time: 0.402680 Jul 06 13:46:31.623939 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 100/221] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:46:31 2022] GET /compute/v2.1/servers/5cf73c2b-28f6-49f1-a119-224c05679d2c => generated 1366 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:46:31.638720 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-514b20a7-b312-4919-932e-9d2c14561d15 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:46:31.648338 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-514b20a7-b312-4919-932e-9d2c14561d15 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] [instance: c801676d-524f-42fc-a2b8-fe4186986d95] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:46:31.666399 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-514b20a7-b312-4919-932e-9d2c14561d15 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:46:31.667061 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-514b20a7-b312-4919-932e-9d2c14561d15 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:46:31.670515 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-514b20a7-b312-4919-932e-9d2c14561d15 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:46:31.670990 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-514b20a7-b312-4919-932e-9d2c14561d15 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:46:31.998733 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-514b20a7-b312-4919-932e-9d2c14561d15 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c83c05bec4f456d8aa7d51732ddc8af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b2a80a004e04da7ae12db9f3f87146f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:46:32.008276 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-514b20a7-b312-4919-932e-9d2c14561d15 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] 10.222.0.20 "GET /compute/v2.1/servers/c801676d-524f-42fc-a2b8-fe4186986d95" status: 200 len: 1322 microversion: 2.1 time: 0.383089 Jul 06 13:46:32.009175 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 101/222] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:46:31 2022] GET /compute/v2.1/servers/c801676d-524f-42fc-a2b8-fe4186986d95 => generated 1322 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:46:32.080159 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-e1b3f34c-dba1-4c94-ae7e-9feea25c2ba9 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:46:32.080856 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-e1b3f34c-dba1-4c94-ae7e-9feea25c2ba9 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] [instance: 546a77fd-66e1-4d89-afa3-58d632b09186] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:46:32.098636 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-e1b3f34c-dba1-4c94-ae7e-9feea25c2ba9 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:46:32.099194 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-e1b3f34c-dba1-4c94-ae7e-9feea25c2ba9 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:46:32.100562 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-e1b3f34c-dba1-4c94-ae7e-9feea25c2ba9 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:46:32.101140 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-e1b3f34c-dba1-4c94-ae7e-9feea25c2ba9 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:46:32.116765 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-f49de7dd-a3ed-4d0c-89f9-09b54db39ed7 tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad0781ce20e54c3a9b7c61e0cccf6918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd48e24dbeaa241d7a97350fb2c8187b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:46:32.132721 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-f49de7dd-a3ed-4d0c-89f9-09b54db39ed7 tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] 10.222.0.20 "GET /compute/v2.1/servers/965c7a0f-fa3f-4f5c-92bf-94d8b646a9ae" status: 200 len: 1314 microversion: 2.1 time: 0.562613 Jul 06 13:46:32.133373 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 122/223] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:46:31 2022] GET /compute/v2.1/servers/965c7a0f-fa3f-4f5c-92bf-94d8b646a9ae => generated 1314 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:46:32.422065 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-e1b3f34c-dba1-4c94-ae7e-9feea25c2ba9 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d7cacb73c8342579d9f990b0193487c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05df572327d54bd99595974b75898052', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:46:32.437342 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-e1b3f34c-dba1-4c94-ae7e-9feea25c2ba9 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] 10.222.0.20 "GET /compute/v2.1/servers/546a77fd-66e1-4d89-afa3-58d632b09186" status: 200 len: 1362 microversion: 2.1 time: 0.362704 Jul 06 13:46:32.439054 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 102/224] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:46:32 2022] GET /compute/v2.1/servers/546a77fd-66e1-4d89-afa3-58d632b09186 => generated 1362 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:46:32.647142 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-7fb81e22-2b89-43f2-9afa-88b8cd380478 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Calling method '>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:46:32.648389 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-7fb81e22-2b89-43f2-9afa-88b8cd380478 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] [instance: 5cf73c2b-28f6-49f1-a119-224c05679d2c] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:46:32.659545 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-7fb81e22-2b89-43f2-9afa-88b8cd380478 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:46:32.660125 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-7fb81e22-2b89-43f2-9afa-88b8cd380478 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:46:32.660856 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-7fb81e22-2b89-43f2-9afa-88b8cd380478 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:46:32.661347 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-7fb81e22-2b89-43f2-9afa-88b8cd380478 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:46:32.983990 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-7fb81e22-2b89-43f2-9afa-88b8cd380478 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b572a8f465048558fc969b85b2aec5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd85f2a57a0847debf5aaf81aab7a638', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:46:32.992745 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-7fb81e22-2b89-43f2-9afa-88b8cd380478 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] 10.222.0.20 "GET /compute/v2.1/servers/5cf73c2b-28f6-49f1-a119-224c05679d2c" status: 200 len: 1366 microversion: 2.1 time: 0.350449 Jul 06 13:46:33.007060 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 123/225] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:46:32 2022] GET /compute/v2.1/servers/5cf73c2b-28f6-49f1-a119-224c05679d2c => generated 1366 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:46:33.027216 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-22314e51-b888-4761-a904-758243f42094 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Calling method '>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:46:33.027992 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-22314e51-b888-4761-a904-758243f42094 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] [instance: c801676d-524f-42fc-a2b8-fe4186986d95] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:46:33.035221 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-22314e51-b888-4761-a904-758243f42094 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:46:33.041315 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-22314e51-b888-4761-a904-758243f42094 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:46:33.042168 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-22314e51-b888-4761-a904-758243f42094 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:46:33.042616 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-22314e51-b888-4761-a904-758243f42094 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:46:33.257966 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-22314e51-b888-4761-a904-758243f42094 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c83c05bec4f456d8aa7d51732ddc8af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b2a80a004e04da7ae12db9f3f87146f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:46:33.266150 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-22314e51-b888-4761-a904-758243f42094 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] 10.222.0.20 "GET /compute/v2.1/servers/c801676d-524f-42fc-a2b8-fe4186986d95" status: 200 len: 1322 microversion: 2.1 time: 0.243334 Jul 06 13:46:33.276593 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 124/226] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:46:33 2022] GET /compute/v2.1/servers/c801676d-524f-42fc-a2b8-fe4186986d95 => generated 1322 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:46:33.295425 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-60e7c651-4fea-4e0c-92a1-5db2f9740685 tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] Calling method '>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:46:33.298432 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-60e7c651-4fea-4e0c-92a1-5db2f9740685 tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] [instance: 965c7a0f-fa3f-4f5c-92bf-94d8b646a9ae] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:46:33.327566 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-60e7c651-4fea-4e0c-92a1-5db2f9740685 tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:46:33.329244 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-60e7c651-4fea-4e0c-92a1-5db2f9740685 tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:46:33.330069 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-60e7c651-4fea-4e0c-92a1-5db2f9740685 tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:46:33.330511 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-60e7c651-4fea-4e0c-92a1-5db2f9740685 tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:46:33.453275 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-7781d474-c72b-4927-83f5-ae97c282e1bb tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] Action: 'create', calling method: .version_select at 0x7ffbc4522310>, body: {"keypair": {"name": "tempest-TestShelveInstance-135657547", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGyFqCR7UcO7oeuvDz16IHrolVa6e3Q777BpIarKfc0oVK4KN0o1hbap/8FCw3t7K1S+B95Zy7wwDMWKuQucSIOkV36ylC/tGilZLDJc/4qScEPCvvRa9qZhnnB098Pkmw=="}} {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 06 13:46:33.488565 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.quota [None req-7781d474-c72b-4927-83f5-ae97c282e1bb tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] Getting quotas for project 1727f66e37f94cc6971b574c8635e078. Resources: {'key_pairs'} {{(pid=124367) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 06 13:46:33.495261 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.quota [None req-7781d474-c72b-4927-83f5-ae97c282e1bb tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] Getting quotas for user 53d00e4198e240c8a5c2fbe8bd241b45 and project 1727f66e37f94cc6971b574c8635e078. Resources: {'key_pairs'} {{(pid=124367) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 06 13:46:33.542795 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-7781d474-c72b-4927-83f5-ae97c282e1bb tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.609143 Jul 06 13:46:33.543695 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 103/227] 10.222.0.20 () {60 vars in 1158 bytes} [Wed Jul 6 13:46:32 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 06 13:46:33.552431 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-0650d811-117e-4f87-a412-38cd3fa118b8 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:46:33.553054 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-0650d811-117e-4f87-a412-38cd3fa118b8 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] [instance: 546a77fd-66e1-4d89-afa3-58d632b09186] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:46:33.559685 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-0650d811-117e-4f87-a412-38cd3fa118b8 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:46:33.560313 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-0650d811-117e-4f87-a412-38cd3fa118b8 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:46:33.561113 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-0650d811-117e-4f87-a412-38cd3fa118b8 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:46:33.561535 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-0650d811-117e-4f87-a412-38cd3fa118b8 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:46:33.600361 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-60e7c651-4fea-4e0c-92a1-5db2f9740685 tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad0781ce20e54c3a9b7c61e0cccf6918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd48e24dbeaa241d7a97350fb2c8187b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:46:33.609398 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-60e7c651-4fea-4e0c-92a1-5db2f9740685 tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] 10.222.0.20 "GET /compute/v2.1/servers/965c7a0f-fa3f-4f5c-92bf-94d8b646a9ae" status: 200 len: 1314 microversion: 2.1 time: 0.331375 Jul 06 13:46:33.610780 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 125/228] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:46:33 2022] GET /compute/v2.1/servers/965c7a0f-fa3f-4f5c-92bf-94d8b646a9ae => generated 1314 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:46:33.775793 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-0650d811-117e-4f87-a412-38cd3fa118b8 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d7cacb73c8342579d9f990b0193487c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05df572327d54bd99595974b75898052', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:46:33.784735 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-0650d811-117e-4f87-a412-38cd3fa118b8 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] 10.222.0.20 "GET /compute/v2.1/servers/546a77fd-66e1-4d89-afa3-58d632b09186" status: 200 len: 1362 microversion: 2.1 time: 0.238498 Jul 06 13:46:33.797149 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 104/229] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:46:33 2022] GET /compute/v2.1/servers/546a77fd-66e1-4d89-afa3-58d632b09186 => generated 1362 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:46:34.014308 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-616e6c38-d6fa-4fa0-a013-26730792a29a tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Calling method '>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:46:34.015615 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-616e6c38-d6fa-4fa0-a013-26730792a29a tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] [instance: 5cf73c2b-28f6-49f1-a119-224c05679d2c] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:46:34.025728 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-616e6c38-d6fa-4fa0-a013-26730792a29a tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:46:34.028329 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-616e6c38-d6fa-4fa0-a013-26730792a29a tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:46:34.030366 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-616e6c38-d6fa-4fa0-a013-26730792a29a tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:46:34.030818 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-616e6c38-d6fa-4fa0-a013-26730792a29a tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:46:34.042626 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG dbcounter [-] [124368] Writing DB stats nova_cell1:SELECT=100 {{(pid=124368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:46:34.288186 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-d8b3f0b9-cf13-4f5a-85b8-de1a62e7a81d tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:46:34.290829 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-d8b3f0b9-cf13-4f5a-85b8-de1a62e7a81d tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] [instance: c801676d-524f-42fc-a2b8-fe4186986d95] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:46:34.306555 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-d8b3f0b9-cf13-4f5a-85b8-de1a62e7a81d tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:46:34.307050 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-d8b3f0b9-cf13-4f5a-85b8-de1a62e7a81d tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:46:34.307896 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-d8b3f0b9-cf13-4f5a-85b8-de1a62e7a81d tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:46:34.308852 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-d8b3f0b9-cf13-4f5a-85b8-de1a62e7a81d tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:46:34.338670 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-616e6c38-d6fa-4fa0-a013-26730792a29a tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b572a8f465048558fc969b85b2aec5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd85f2a57a0847debf5aaf81aab7a638', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:46:34.355404 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-616e6c38-d6fa-4fa0-a013-26730792a29a tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] 10.222.0.20 "GET /compute/v2.1/servers/5cf73c2b-28f6-49f1-a119-224c05679d2c" status: 200 len: 1366 microversion: 2.1 time: 0.345366 Jul 06 13:46:34.359117 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 126/230] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:46:34 2022] GET /compute/v2.1/servers/5cf73c2b-28f6-49f1-a119-224c05679d2c => generated 1366 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:46:34.514823 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-d8b3f0b9-cf13-4f5a-85b8-de1a62e7a81d tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c83c05bec4f456d8aa7d51732ddc8af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b2a80a004e04da7ae12db9f3f87146f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:46:34.523916 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-d8b3f0b9-cf13-4f5a-85b8-de1a62e7a81d tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] 10.222.0.20 "GET /compute/v2.1/servers/c801676d-524f-42fc-a2b8-fe4186986d95" status: 200 len: 1322 microversion: 2.1 time: 0.243333 Jul 06 13:46:34.535262 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 105/231] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:46:34 2022] GET /compute/v2.1/servers/c801676d-524f-42fc-a2b8-fe4186986d95 => generated 1322 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:46:34.628921 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-f254a54f-6094-4039-944a-96b59c702e10 tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] Calling method '>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:46:34.630733 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-f254a54f-6094-4039-944a-96b59c702e10 tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] [instance: 965c7a0f-fa3f-4f5c-92bf-94d8b646a9ae] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:46:34.638906 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-f254a54f-6094-4039-944a-96b59c702e10 tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:46:34.639749 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-f254a54f-6094-4039-944a-96b59c702e10 tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:46:34.640939 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-f254a54f-6094-4039-944a-96b59c702e10 tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:46:34.641549 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-f254a54f-6094-4039-944a-96b59c702e10 tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:46:34.805961 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-009418f6-2589-4d2b-b85f-53e35029d1bb tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:46:34.807298 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-009418f6-2589-4d2b-b85f-53e35029d1bb tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] [instance: 546a77fd-66e1-4d89-afa3-58d632b09186] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:46:34.815547 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-009418f6-2589-4d2b-b85f-53e35029d1bb tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:46:34.816904 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-009418f6-2589-4d2b-b85f-53e35029d1bb tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:46:34.818714 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-009418f6-2589-4d2b-b85f-53e35029d1bb tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:46:34.819863 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-009418f6-2589-4d2b-b85f-53e35029d1bb tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:46:35.044423 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-f254a54f-6094-4039-944a-96b59c702e10 tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad0781ce20e54c3a9b7c61e0cccf6918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd48e24dbeaa241d7a97350fb2c8187b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:46:35.056571 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-f254a54f-6094-4039-944a-96b59c702e10 tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] 10.222.0.20 "GET /compute/v2.1/servers/965c7a0f-fa3f-4f5c-92bf-94d8b646a9ae" status: 200 len: 1314 microversion: 2.1 time: 0.432701 Jul 06 13:46:35.058596 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 127/232] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:46:34 2022] GET /compute/v2.1/servers/965c7a0f-fa3f-4f5c-92bf-94d8b646a9ae => generated 1314 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:46:35.133443 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-009418f6-2589-4d2b-b85f-53e35029d1bb tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d7cacb73c8342579d9f990b0193487c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05df572327d54bd99595974b75898052', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:46:35.142614 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-009418f6-2589-4d2b-b85f-53e35029d1bb tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] 10.222.0.20 "GET /compute/v2.1/servers/546a77fd-66e1-4d89-afa3-58d632b09186" status: 200 len: 1362 microversion: 2.1 time: 0.343604 Jul 06 13:46:35.143263 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 106/233] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:46:34 2022] GET /compute/v2.1/servers/546a77fd-66e1-4d89-afa3-58d632b09186 => generated 1362 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:46:35.377146 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-299895d5-dd80-416e-9ecb-6b4c6958d535 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Calling method '>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:46:35.378041 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-299895d5-dd80-416e-9ecb-6b4c6958d535 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] [instance: 5cf73c2b-28f6-49f1-a119-224c05679d2c] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:46:35.400758 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-299895d5-dd80-416e-9ecb-6b4c6958d535 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:46:35.402067 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-299895d5-dd80-416e-9ecb-6b4c6958d535 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:46:35.403657 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-299895d5-dd80-416e-9ecb-6b4c6958d535 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:46:35.404283 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-299895d5-dd80-416e-9ecb-6b4c6958d535 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:46:35.542279 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-5afa49a5-aad9-4571-96cf-17c98c0d8743 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:46:35.543414 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-5afa49a5-aad9-4571-96cf-17c98c0d8743 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] [instance: c801676d-524f-42fc-a2b8-fe4186986d95] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:46:35.558733 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-5afa49a5-aad9-4571-96cf-17c98c0d8743 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:46:35.560450 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-5afa49a5-aad9-4571-96cf-17c98c0d8743 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:46:35.563182 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-5afa49a5-aad9-4571-96cf-17c98c0d8743 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:46:35.563801 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-5afa49a5-aad9-4571-96cf-17c98c0d8743 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:46:35.624557 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-299895d5-dd80-416e-9ecb-6b4c6958d535 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b572a8f465048558fc969b85b2aec5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd85f2a57a0847debf5aaf81aab7a638', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:46:35.637759 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-299895d5-dd80-416e-9ecb-6b4c6958d535 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] 10.222.0.20 "GET /compute/v2.1/servers/5cf73c2b-28f6-49f1-a119-224c05679d2c" status: 200 len: 1366 microversion: 2.1 time: 0.264700 Jul 06 13:46:35.638311 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 128/234] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:46:35 2022] GET /compute/v2.1/servers/5cf73c2b-28f6-49f1-a119-224c05679d2c => generated 1366 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:46:35.800861 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-5afa49a5-aad9-4571-96cf-17c98c0d8743 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c83c05bec4f456d8aa7d51732ddc8af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b2a80a004e04da7ae12db9f3f87146f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:46:35.812224 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-5afa49a5-aad9-4571-96cf-17c98c0d8743 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] 10.222.0.20 "GET /compute/v2.1/servers/c801676d-524f-42fc-a2b8-fe4186986d95" status: 200 len: 1322 microversion: 2.1 time: 0.275171 Jul 06 13:46:35.814273 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 107/235] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:46:35 2022] GET /compute/v2.1/servers/c801676d-524f-42fc-a2b8-fe4186986d95 => generated 1322 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:46:36.076581 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-5c2bea90-2e6c-479d-885e-7902af26cacb tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] Calling method '>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:46:36.077235 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-5c2bea90-2e6c-479d-885e-7902af26cacb tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] [instance: 965c7a0f-fa3f-4f5c-92bf-94d8b646a9ae] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:46:36.087253 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-5c2bea90-2e6c-479d-885e-7902af26cacb tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:46:36.087712 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-5c2bea90-2e6c-479d-885e-7902af26cacb tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:46:36.088507 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-5c2bea90-2e6c-479d-885e-7902af26cacb tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:46:36.095961 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-5c2bea90-2e6c-479d-885e-7902af26cacb tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:46:36.160034 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-aef38adc-ebb0-48bb-8a78-90b95e7d89ec tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:46:36.160636 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-aef38adc-ebb0-48bb-8a78-90b95e7d89ec tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] [instance: 546a77fd-66e1-4d89-afa3-58d632b09186] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:46:36.174635 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-aef38adc-ebb0-48bb-8a78-90b95e7d89ec tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:46:36.175293 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-aef38adc-ebb0-48bb-8a78-90b95e7d89ec tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:46:36.176381 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-aef38adc-ebb0-48bb-8a78-90b95e7d89ec tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:46:36.176888 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-aef38adc-ebb0-48bb-8a78-90b95e7d89ec tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:46:36.421399 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-aef38adc-ebb0-48bb-8a78-90b95e7d89ec tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d7cacb73c8342579d9f990b0193487c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05df572327d54bd99595974b75898052', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:46:36.436562 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-aef38adc-ebb0-48bb-8a78-90b95e7d89ec tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] 10.222.0.20 "GET /compute/v2.1/servers/546a77fd-66e1-4d89-afa3-58d632b09186" status: 200 len: 1362 microversion: 2.1 time: 0.278664 Jul 06 13:46:36.438386 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 108/236] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:46:36 2022] GET /compute/v2.1/servers/546a77fd-66e1-4d89-afa3-58d632b09186 => generated 1362 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:46:36.440247 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-5c2bea90-2e6c-479d-885e-7902af26cacb tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad0781ce20e54c3a9b7c61e0cccf6918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd48e24dbeaa241d7a97350fb2c8187b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:46:36.452555 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-5c2bea90-2e6c-479d-885e-7902af26cacb tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] 10.222.0.20 "GET /compute/v2.1/servers/965c7a0f-fa3f-4f5c-92bf-94d8b646a9ae" status: 200 len: 1314 microversion: 2.1 time: 0.380007 Jul 06 13:46:36.453178 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 129/237] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:46:36 2022] GET /compute/v2.1/servers/965c7a0f-fa3f-4f5c-92bf-94d8b646a9ae => generated 1314 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:46:36.655354 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-f590cede-e6b3-4e86-a7ae-29a9f35f8f9b tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:46:36.656786 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-f590cede-e6b3-4e86-a7ae-29a9f35f8f9b tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] [instance: 5cf73c2b-28f6-49f1-a119-224c05679d2c] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:46:36.677185 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-f590cede-e6b3-4e86-a7ae-29a9f35f8f9b tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:46:36.678755 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-f590cede-e6b3-4e86-a7ae-29a9f35f8f9b tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:46:36.679680 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-f590cede-e6b3-4e86-a7ae-29a9f35f8f9b tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:46:36.680157 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-f590cede-e6b3-4e86-a7ae-29a9f35f8f9b tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:46:36.831334 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-fe3139d2-0b55-49b3-8f97-7b762fff0181 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Calling method '>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:46:36.832206 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-fe3139d2-0b55-49b3-8f97-7b762fff0181 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] [instance: c801676d-524f-42fc-a2b8-fe4186986d95] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:46:36.850087 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-fe3139d2-0b55-49b3-8f97-7b762fff0181 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:46:36.850548 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-fe3139d2-0b55-49b3-8f97-7b762fff0181 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:46:36.851356 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-fe3139d2-0b55-49b3-8f97-7b762fff0181 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:46:36.869326 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-fe3139d2-0b55-49b3-8f97-7b762fff0181 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:46:37.101596 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-f590cede-e6b3-4e86-a7ae-29a9f35f8f9b tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b572a8f465048558fc969b85b2aec5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd85f2a57a0847debf5aaf81aab7a638', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:46:37.110962 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-f590cede-e6b3-4e86-a7ae-29a9f35f8f9b tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] 10.222.0.20 "GET /compute/v2.1/servers/5cf73c2b-28f6-49f1-a119-224c05679d2c" status: 200 len: 1366 microversion: 2.1 time: 0.459453 Jul 06 13:46:37.111641 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 109/238] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:46:36 2022] GET /compute/v2.1/servers/5cf73c2b-28f6-49f1-a119-224c05679d2c => generated 1366 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:46:37.172496 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-fe3139d2-0b55-49b3-8f97-7b762fff0181 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c83c05bec4f456d8aa7d51732ddc8af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b2a80a004e04da7ae12db9f3f87146f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:46:37.188221 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-fe3139d2-0b55-49b3-8f97-7b762fff0181 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] 10.222.0.20 "GET /compute/v2.1/servers/c801676d-524f-42fc-a2b8-fe4186986d95" status: 200 len: 1322 microversion: 2.1 time: 0.360744 Jul 06 13:46:37.189247 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 130/239] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:46:36 2022] GET /compute/v2.1/servers/c801676d-524f-42fc-a2b8-fe4186986d95 => generated 1322 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 06 13:46:37.454458 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-09e17343-dfac-4108-92e1-5f97b25d6005 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:46:37.455265 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-09e17343-dfac-4108-92e1-5f97b25d6005 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] [instance: 546a77fd-66e1-4d89-afa3-58d632b09186] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:46:37.471497 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-5a209421-12b7-461a-976c-b28b7cc9f5c3 tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] Calling method '>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:46:37.471792 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-09e17343-dfac-4108-92e1-5f97b25d6005 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:46:37.472737 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-5a209421-12b7-461a-976c-b28b7cc9f5c3 tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] [instance: 965c7a0f-fa3f-4f5c-92bf-94d8b646a9ae] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:46:37.476394 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-09e17343-dfac-4108-92e1-5f97b25d6005 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:46:37.485667 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-09e17343-dfac-4108-92e1-5f97b25d6005 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:46:37.486245 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-09e17343-dfac-4108-92e1-5f97b25d6005 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:46:37.491665 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-5a209421-12b7-461a-976c-b28b7cc9f5c3 tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:46:37.492560 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-5a209421-12b7-461a-976c-b28b7cc9f5c3 tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:46:37.499000 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-5a209421-12b7-461a-976c-b28b7cc9f5c3 tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:46:37.501898 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-5a209421-12b7-461a-976c-b28b7cc9f5c3 tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:46:38.182027 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-5a209421-12b7-461a-976c-b28b7cc9f5c3 tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad0781ce20e54c3a9b7c61e0cccf6918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd48e24dbeaa241d7a97350fb2c8187b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:46:38.211013 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-5a209421-12b7-461a-976c-b28b7cc9f5c3 tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] 10.222.0.20 "GET /compute/v2.1/servers/965c7a0f-fa3f-4f5c-92bf-94d8b646a9ae" status: 200 len: 1314 microversion: 2.1 time: 0.744529 Jul 06 13:46:38.227124 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 131/240] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:46:37 2022] GET /compute/v2.1/servers/965c7a0f-fa3f-4f5c-92bf-94d8b646a9ae => generated 1314 bytes in 753 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:46:38.233054 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [req-34dd7298-b5a9-40b8-813f-013874f9eb35 req-ed0ebb93-0c34-4ede-aca7-3cbdc5f1a533 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "12bddea9-d545-43f2-9bf7-5e723900c8c6", "name": "network-vif-plugged", "status": "completed", "tag": "0a503503-bc5a-427b-9188-0939c526e5da"}]} {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 06 13:46:38.244552 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [req-34dd7298-b5a9-40b8-813f-013874f9eb35 req-ed0ebb93-0c34-4ede-aca7-3cbdc5f1a533 service nova] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:46:38.248171 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [req-34dd7298-b5a9-40b8-813f-013874f9eb35 req-ed0ebb93-0c34-4ede-aca7-3cbdc5f1a533 service nova] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:46:38.280251 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.compute.server_external_events [req-34dd7298-b5a9-40b8-813f-013874f9eb35 req-ed0ebb93-0c34-4ede-aca7-3cbdc5f1a533 service nova] Creating event network-vif-plugged:0a503503-bc5a-427b-9188-0939c526e5da for instance 12bddea9-d545-43f2-9bf7-5e723900c8c6 on hv-cinder-81914 Jul 06 13:46:38.307137 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [req-34dd7298-b5a9-40b8-813f-013874f9eb35 req-ed0ebb93-0c34-4ede-aca7-3cbdc5f1a533 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086791 Jul 06 13:46:38.308393 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 132/241] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 6 13:46:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 06 13:46:38.314930 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-16cf4025-6795-40b9-98fd-ed52d4d038ed tempest-VolumesActionsTest-262392969 tempest-VolumesActionsTest-262392969-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-347669463", "imageRef": "b08481d9-1e39-41e8-97bd-b05a9c35b377", "flavorRef": "452", "networks": [{"uuid": "60bcc6e5-2a3e-4466-af92-959bc56def11"}]}} {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 06 13:46:38.377301 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.network.neutron [None req-16cf4025-6795-40b9-98fd-ed52d4d038ed tempest-VolumesActionsTest-262392969 tempest-VolumesActionsTest-262392969-project] validate_networks() for [('60bcc6e5-2a3e-4466-af92-959bc56def11', None, None, None, None, None)] {{(pid=124368) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 06 13:46:38.378492 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-09e17343-dfac-4108-92e1-5f97b25d6005 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d7cacb73c8342579d9f990b0193487c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05df572327d54bd99595974b75898052', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:46:38.392875 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-09e17343-dfac-4108-92e1-5f97b25d6005 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] 10.222.0.20 "GET /compute/v2.1/servers/546a77fd-66e1-4d89-afa3-58d632b09186" status: 200 len: 1362 microversion: 2.1 time: 0.941700 Jul 06 13:46:38.394132 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 110/242] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:46:37 2022] GET /compute/v2.1/servers/546a77fd-66e1-4d89-afa3-58d632b09186 => generated 1362 bytes in 944 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:46:38.400428 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-8bde05c3-68f3-4692-895d-4f2c3404771d tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:46:38.401330 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-8bde05c3-68f3-4692-895d-4f2c3404771d tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] [instance: 5cf73c2b-28f6-49f1-a119-224c05679d2c] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:46:38.409776 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-8bde05c3-68f3-4692-895d-4f2c3404771d tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:46:38.410235 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-8bde05c3-68f3-4692-895d-4f2c3404771d tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:46:38.411123 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-8bde05c3-68f3-4692-895d-4f2c3404771d tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:46:38.411612 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-8bde05c3-68f3-4692-895d-4f2c3404771d tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:46:38.448600 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG dbcounter [-] [124367] Writing DB stats nova_cell1:SELECT=100 {{(pid=124367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:46:38.713482 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-8bde05c3-68f3-4692-895d-4f2c3404771d tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b572a8f465048558fc969b85b2aec5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd85f2a57a0847debf5aaf81aab7a638', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:46:38.723017 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-8bde05c3-68f3-4692-895d-4f2c3404771d tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] 10.222.0.20 "GET /compute/v2.1/servers/5cf73c2b-28f6-49f1-a119-224c05679d2c" status: 200 len: 1366 microversion: 2.1 time: 0.327560 Jul 06 13:46:38.723602 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 111/243] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:46:38 2022] GET /compute/v2.1/servers/5cf73c2b-28f6-49f1-a119-224c05679d2c => generated 1366 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:46:38.729533 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-6d1100ab-dd35-4da4-9921-3d095c80522e tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:46:38.730412 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-6d1100ab-dd35-4da4-9921-3d095c80522e tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] [instance: c801676d-524f-42fc-a2b8-fe4186986d95] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:46:38.737815 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-6d1100ab-dd35-4da4-9921-3d095c80522e tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:46:38.738360 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-6d1100ab-dd35-4da4-9921-3d095c80522e tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:46:38.739206 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-6d1100ab-dd35-4da4-9921-3d095c80522e tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:46:38.739822 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-6d1100ab-dd35-4da4-9921-3d095c80522e tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:46:38.918509 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-6d1100ab-dd35-4da4-9921-3d095c80522e tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c83c05bec4f456d8aa7d51732ddc8af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b2a80a004e04da7ae12db9f3f87146f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:46:38.932140 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-6d1100ab-dd35-4da4-9921-3d095c80522e tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] 10.222.0.20 "GET /compute/v2.1/servers/c801676d-524f-42fc-a2b8-fe4186986d95" status: 200 len: 1322 microversion: 2.1 time: 0.206519 Jul 06 13:46:38.933570 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 112/244] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:46:38 2022] GET /compute/v2.1/servers/c801676d-524f-42fc-a2b8-fe4186986d95 => generated 1322 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:46:38.964358 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.virt.hardware [None req-16cf4025-6795-40b9-98fd-ed52d4d038ed tempest-VolumesActionsTest-262392969 tempest-VolumesActionsTest-262392969-project] Flavor limits 0:0:0 {{(pid=124368) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 06 13:46:38.965087 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.virt.hardware [None req-16cf4025-6795-40b9-98fd-ed52d4d038ed tempest-VolumesActionsTest-262392969 tempest-VolumesActionsTest-262392969-project] Image limits 0:0:0 {{(pid=124368) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 06 13:46:38.966392 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.virt.hardware [None req-16cf4025-6795-40b9-98fd-ed52d4d038ed tempest-VolumesActionsTest-262392969 tempest-VolumesActionsTest-262392969-project] Flavor pref 0:0:0 {{(pid=124368) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 06 13:46:38.967284 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.virt.hardware [None req-16cf4025-6795-40b9-98fd-ed52d4d038ed tempest-VolumesActionsTest-262392969 tempest-VolumesActionsTest-262392969-project] Image pref 0:0:0 {{(pid=124368) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 06 13:46:38.967784 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.virt.hardware [None req-16cf4025-6795-40b9-98fd-ed52d4d038ed tempest-VolumesActionsTest-262392969 tempest-VolumesActionsTest-262392969-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124368) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 06 13:46:38.979379 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-16cf4025-6795-40b9-98fd-ed52d4d038ed tempest-VolumesActionsTest-262392969 tempest-VolumesActionsTest-262392969-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:46:38.979992 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-16cf4025-6795-40b9-98fd-ed52d4d038ed tempest-VolumesActionsTest-262392969 tempest-VolumesActionsTest-262392969-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:46:38.981122 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-16cf4025-6795-40b9-98fd-ed52d4d038ed tempest-VolumesActionsTest-262392969 tempest-VolumesActionsTest-262392969-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:46:38.981762 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-16cf4025-6795-40b9-98fd-ed52d4d038ed tempest-VolumesActionsTest-262392969 tempest-VolumesActionsTest-262392969-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:46:39.012038 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.quota [None req-16cf4025-6795-40b9-98fd-ed52d4d038ed tempest-VolumesActionsTest-262392969 tempest-VolumesActionsTest-262392969-project] Getting quotas for project 2f9f86fa910c4054b31927ba26ea96b9. Resources: {'instances', 'cores', 'ram'} {{(pid=124368) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 06 13:46:39.018011 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.quota [None req-16cf4025-6795-40b9-98fd-ed52d4d038ed tempest-VolumesActionsTest-262392969 tempest-VolumesActionsTest-262392969-project] Getting quotas for user 050d5eb22b2c45ee85eb8c118b9ef21e and project 2f9f86fa910c4054b31927ba26ea96b9. Resources: {'instances', 'cores', 'ram'} {{(pid=124368) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 06 13:46:39.033104 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-16cf4025-6795-40b9-98fd-ed52d4d038ed tempest-VolumesActionsTest-262392969 tempest-VolumesActionsTest-262392969-project] Going to run 1 instances... {{(pid=124368) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 06 13:46:39.037570 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-16cf4025-6795-40b9-98fd-ed52d4d038ed tempest-VolumesActionsTest-262392969 tempest-VolumesActionsTest-262392969-project] [instance: 2523f283-429c-4368-afcb-3b90612bda32] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b08481d9-1e39-41e8-97bd-b05a9c35b377',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124368) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 06 13:46:39.104802 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-16cf4025-6795-40b9-98fd-ed52d4d038ed tempest-VolumesActionsTest-262392969 tempest-VolumesActionsTest-262392969-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.794138 Jul 06 13:46:39.110126 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 133/245] 10.222.0.20 () {60 vars in 1146 bytes} [Wed Jul 6 13:46:38 2022] POST /compute/v2.1/servers => generated 380 bytes in 797 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 06 13:46:39.116564 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-e0240b6a-6937-4604-b5bf-288728cea885 tempest-VolumesActionsTest-262392969 tempest-VolumesActionsTest-262392969-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:46:39.117273 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-e0240b6a-6937-4604-b5bf-288728cea885 tempest-VolumesActionsTest-262392969 tempest-VolumesActionsTest-262392969-project] [instance: 2523f283-429c-4368-afcb-3b90612bda32] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:46:39.199645 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-e0240b6a-6937-4604-b5bf-288728cea885 tempest-VolumesActionsTest-262392969 tempest-VolumesActionsTest-262392969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '050d5eb22b2c45ee85eb8c118b9ef21e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f9f86fa910c4054b31927ba26ea96b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:46:39.206866 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-e0240b6a-6937-4604-b5bf-288728cea885 tempest-VolumesActionsTest-262392969 tempest-VolumesActionsTest-262392969-project] 10.222.0.20 "GET /compute/v2.1/servers/2523f283-429c-4368-afcb-3b90612bda32" status: 200 len: 1213 microversion: 2.1 time: 0.095273 Jul 06 13:46:39.207437 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 113/246] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:46:39 2022] GET /compute/v2.1/servers/2523f283-429c-4368-afcb-3b90612bda32 => generated 1213 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:46:39.234923 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-176bfd8c-5fee-4a85-87f7-be19ffb0ccc7 tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] Calling method '>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:46:39.235685 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-176bfd8c-5fee-4a85-87f7-be19ffb0ccc7 tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] [instance: 965c7a0f-fa3f-4f5c-92bf-94d8b646a9ae] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:46:39.242533 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-176bfd8c-5fee-4a85-87f7-be19ffb0ccc7 tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:46:39.242986 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-176bfd8c-5fee-4a85-87f7-be19ffb0ccc7 tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:46:39.243759 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-176bfd8c-5fee-4a85-87f7-be19ffb0ccc7 tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:46:39.244224 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-176bfd8c-5fee-4a85-87f7-be19ffb0ccc7 tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:46:39.410272 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-d4a797ea-7259-4df9-a896-3240004bc390 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:46:39.411534 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-d4a797ea-7259-4df9-a896-3240004bc390 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] [instance: 546a77fd-66e1-4d89-afa3-58d632b09186] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:46:39.422488 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-d4a797ea-7259-4df9-a896-3240004bc390 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:46:39.423437 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-d4a797ea-7259-4df9-a896-3240004bc390 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:46:39.424735 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-d4a797ea-7259-4df9-a896-3240004bc390 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:46:39.425211 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-d4a797ea-7259-4df9-a896-3240004bc390 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:46:39.459782 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-176bfd8c-5fee-4a85-87f7-be19ffb0ccc7 tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad0781ce20e54c3a9b7c61e0cccf6918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd48e24dbeaa241d7a97350fb2c8187b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:46:39.478472 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-176bfd8c-5fee-4a85-87f7-be19ffb0ccc7 tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] 10.222.0.20 "GET /compute/v2.1/servers/965c7a0f-fa3f-4f5c-92bf-94d8b646a9ae" status: 200 len: 1314 microversion: 2.1 time: 0.242317 Jul 06 13:46:39.487860 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 134/247] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:46:39 2022] GET /compute/v2.1/servers/965c7a0f-fa3f-4f5c-92bf-94d8b646a9ae => generated 1314 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:46:39.628461 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-d4a797ea-7259-4df9-a896-3240004bc390 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d7cacb73c8342579d9f990b0193487c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05df572327d54bd99595974b75898052', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:46:39.639796 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-d4a797ea-7259-4df9-a896-3240004bc390 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] 10.222.0.20 "GET /compute/v2.1/servers/546a77fd-66e1-4d89-afa3-58d632b09186" status: 200 len: 1362 microversion: 2.1 time: 0.233351 Jul 06 13:46:39.641233 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 114/248] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:46:39 2022] GET /compute/v2.1/servers/546a77fd-66e1-4d89-afa3-58d632b09186 => generated 1362 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:46:39.739791 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-0960785a-935d-4d46-88fa-7a4bf73a246f tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Calling method '>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:46:39.740836 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-0960785a-935d-4d46-88fa-7a4bf73a246f tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] [instance: 5cf73c2b-28f6-49f1-a119-224c05679d2c] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:46:39.747208 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-0960785a-935d-4d46-88fa-7a4bf73a246f tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:46:39.747974 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-0960785a-935d-4d46-88fa-7a4bf73a246f tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:46:39.748960 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-0960785a-935d-4d46-88fa-7a4bf73a246f tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:46:39.749682 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-0960785a-935d-4d46-88fa-7a4bf73a246f tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:46:39.909437 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-0960785a-935d-4d46-88fa-7a4bf73a246f tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b572a8f465048558fc969b85b2aec5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd85f2a57a0847debf5aaf81aab7a638', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:46:39.917818 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-0960785a-935d-4d46-88fa-7a4bf73a246f tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] 10.222.0.20 "GET /compute/v2.1/servers/5cf73c2b-28f6-49f1-a119-224c05679d2c" status: 200 len: 1366 microversion: 2.1 time: 0.182028 Jul 06 13:46:39.919025 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 135/249] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:46:39 2022] GET /compute/v2.1/servers/5cf73c2b-28f6-49f1-a119-224c05679d2c => generated 1366 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:46:39.949684 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-0e97fb63-cfc3-4744-bfe7-57a3f6a8de16 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:46:39.950380 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-0e97fb63-cfc3-4744-bfe7-57a3f6a8de16 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] [instance: c801676d-524f-42fc-a2b8-fe4186986d95] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:46:39.956574 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-0e97fb63-cfc3-4744-bfe7-57a3f6a8de16 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:46:39.957096 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-0e97fb63-cfc3-4744-bfe7-57a3f6a8de16 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:46:39.957857 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-0e97fb63-cfc3-4744-bfe7-57a3f6a8de16 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:46:39.958280 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-0e97fb63-cfc3-4744-bfe7-57a3f6a8de16 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:46:40.102687 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-0e97fb63-cfc3-4744-bfe7-57a3f6a8de16 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c83c05bec4f456d8aa7d51732ddc8af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b2a80a004e04da7ae12db9f3f87146f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:46:40.110088 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-0e97fb63-cfc3-4744-bfe7-57a3f6a8de16 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] 10.222.0.20 "GET /compute/v2.1/servers/c801676d-524f-42fc-a2b8-fe4186986d95" status: 200 len: 1322 microversion: 2.1 time: 0.164285 Jul 06 13:46:40.110617 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 115/250] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:46:39 2022] GET /compute/v2.1/servers/c801676d-524f-42fc-a2b8-fe4186986d95 => generated 1322 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:46:40.227497 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-89bf67de-6165-4523-b7ba-e1cc02341d5a tempest-VolumesActionsTest-262392969 tempest-VolumesActionsTest-262392969-project] Calling method '>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:46:40.227605 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-89bf67de-6165-4523-b7ba-e1cc02341d5a tempest-VolumesActionsTest-262392969 tempest-VolumesActionsTest-262392969-project] [instance: 2523f283-429c-4368-afcb-3b90612bda32] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:46:40.234155 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-89bf67de-6165-4523-b7ba-e1cc02341d5a tempest-VolumesActionsTest-262392969 tempest-VolumesActionsTest-262392969-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:46:40.234605 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-89bf67de-6165-4523-b7ba-e1cc02341d5a tempest-VolumesActionsTest-262392969 tempest-VolumesActionsTest-262392969-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:46:40.235367 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-89bf67de-6165-4523-b7ba-e1cc02341d5a tempest-VolumesActionsTest-262392969 tempest-VolumesActionsTest-262392969-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:46:40.235898 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-89bf67de-6165-4523-b7ba-e1cc02341d5a tempest-VolumesActionsTest-262392969 tempest-VolumesActionsTest-262392969-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:46:40.301695 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-89bf67de-6165-4523-b7ba-e1cc02341d5a tempest-VolumesActionsTest-262392969 tempest-VolumesActionsTest-262392969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '050d5eb22b2c45ee85eb8c118b9ef21e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f9f86fa910c4054b31927ba26ea96b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:46:40.310538 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-89bf67de-6165-4523-b7ba-e1cc02341d5a tempest-VolumesActionsTest-262392969 tempest-VolumesActionsTest-262392969-project] 10.222.0.20 "GET /compute/v2.1/servers/2523f283-429c-4368-afcb-3b90612bda32" status: 200 len: 1217 microversion: 2.1 time: 0.089906 Jul 06 13:46:40.311103 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 136/251] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:46:40 2022] GET /compute/v2.1/servers/2523f283-429c-4368-afcb-3b90612bda32 => generated 1217 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:46:40.496475 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-6265313f-3e4a-4f15-8903-9936e67e0f2c tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:46:40.497044 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-6265313f-3e4a-4f15-8903-9936e67e0f2c tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] [instance: 965c7a0f-fa3f-4f5c-92bf-94d8b646a9ae] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:46:40.498854 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG dbcounter [-] [124367] Writing DB stats nova_api:SELECT=99,nova_api:INSERT=1 {{(pid=124367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:46:40.504497 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-6265313f-3e4a-4f15-8903-9936e67e0f2c tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:46:40.504942 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-6265313f-3e4a-4f15-8903-9936e67e0f2c tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:46:40.505787 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-6265313f-3e4a-4f15-8903-9936e67e0f2c tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:46:40.506318 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-6265313f-3e4a-4f15-8903-9936e67e0f2c tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:46:40.652016 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-6265313f-3e4a-4f15-8903-9936e67e0f2c tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad0781ce20e54c3a9b7c61e0cccf6918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd48e24dbeaa241d7a97350fb2c8187b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:46:40.659530 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-a37a648c-7018-43d1-8769-e78efdfbcc58 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Calling method '>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:46:40.659693 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-6265313f-3e4a-4f15-8903-9936e67e0f2c tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] 10.222.0.20 "GET /compute/v2.1/servers/965c7a0f-fa3f-4f5c-92bf-94d8b646a9ae" status: 200 len: 1314 microversion: 2.1 time: 0.167246 Jul 06 13:46:40.660211 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-a37a648c-7018-43d1-8769-e78efdfbcc58 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] [instance: 546a77fd-66e1-4d89-afa3-58d632b09186] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:46:40.667157 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-a37a648c-7018-43d1-8769-e78efdfbcc58 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:46:40.668074 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-a37a648c-7018-43d1-8769-e78efdfbcc58 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:46:40.669544 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-a37a648c-7018-43d1-8769-e78efdfbcc58 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:46:40.669651 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 116/252] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:46:40 2022] GET /compute/v2.1/servers/965c7a0f-fa3f-4f5c-92bf-94d8b646a9ae => generated 1314 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:46:40.670276 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-a37a648c-7018-43d1-8769-e78efdfbcc58 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:46:40.807658 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-a37a648c-7018-43d1-8769-e78efdfbcc58 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d7cacb73c8342579d9f990b0193487c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05df572327d54bd99595974b75898052', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:46:40.815277 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-a37a648c-7018-43d1-8769-e78efdfbcc58 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] 10.222.0.20 "GET /compute/v2.1/servers/546a77fd-66e1-4d89-afa3-58d632b09186" status: 200 len: 1362 microversion: 2.1 time: 0.160485 Jul 06 13:46:40.816121 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 137/253] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:46:40 2022] GET /compute/v2.1/servers/546a77fd-66e1-4d89-afa3-58d632b09186 => generated 1362 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 06 13:46:40.935875 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-a1fcb104-b0b8-4275-870e-3edbb8011b9b tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:46:40.936494 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-a1fcb104-b0b8-4275-870e-3edbb8011b9b tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] [instance: 5cf73c2b-28f6-49f1-a119-224c05679d2c] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:46:40.944644 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-a1fcb104-b0b8-4275-870e-3edbb8011b9b tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:46:40.945140 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-a1fcb104-b0b8-4275-870e-3edbb8011b9b tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:46:40.946055 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-a1fcb104-b0b8-4275-870e-3edbb8011b9b tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:46:40.946526 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-a1fcb104-b0b8-4275-870e-3edbb8011b9b tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:46:41.088418 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-a1fcb104-b0b8-4275-870e-3edbb8011b9b tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b572a8f465048558fc969b85b2aec5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd85f2a57a0847debf5aaf81aab7a638', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:46:41.095790 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-a1fcb104-b0b8-4275-870e-3edbb8011b9b tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] 10.222.0.20 "GET /compute/v2.1/servers/5cf73c2b-28f6-49f1-a119-224c05679d2c" status: 200 len: 1366 microversion: 2.1 time: 0.163782 Jul 06 13:46:41.096540 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 117/254] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:46:40 2022] GET /compute/v2.1/servers/5cf73c2b-28f6-49f1-a119-224c05679d2c => generated 1366 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:46:41.127530 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-b59fa698-9344-4657-9d73-3e09a80e4915 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Calling method '>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:46:41.128144 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-b59fa698-9344-4657-9d73-3e09a80e4915 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] [instance: c801676d-524f-42fc-a2b8-fe4186986d95] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:46:41.134732 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-b59fa698-9344-4657-9d73-3e09a80e4915 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:46:41.135186 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-b59fa698-9344-4657-9d73-3e09a80e4915 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:46:41.135973 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-b59fa698-9344-4657-9d73-3e09a80e4915 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:46:41.136415 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-b59fa698-9344-4657-9d73-3e09a80e4915 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:46:41.279101 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-b59fa698-9344-4657-9d73-3e09a80e4915 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c83c05bec4f456d8aa7d51732ddc8af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b2a80a004e04da7ae12db9f3f87146f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:46:41.286552 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-b59fa698-9344-4657-9d73-3e09a80e4915 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] 10.222.0.20 "GET /compute/v2.1/servers/c801676d-524f-42fc-a2b8-fe4186986d95" status: 200 len: 1322 microversion: 2.1 time: 0.162935 Jul 06 13:46:41.292112 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 138/255] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:46:41 2022] GET /compute/v2.1/servers/c801676d-524f-42fc-a2b8-fe4186986d95 => generated 1322 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:46:41.328618 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-0912dafc-9bd4-4d05-af31-5e8f90cf7ac3 tempest-VolumesActionsTest-262392969 tempest-VolumesActionsTest-262392969-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:46:41.329361 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-0912dafc-9bd4-4d05-af31-5e8f90cf7ac3 tempest-VolumesActionsTest-262392969 tempest-VolumesActionsTest-262392969-project] [instance: 2523f283-429c-4368-afcb-3b90612bda32] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:46:41.340825 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-0912dafc-9bd4-4d05-af31-5e8f90cf7ac3 tempest-VolumesActionsTest-262392969 tempest-VolumesActionsTest-262392969-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:46:41.341311 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-0912dafc-9bd4-4d05-af31-5e8f90cf7ac3 tempest-VolumesActionsTest-262392969 tempest-VolumesActionsTest-262392969-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:46:41.342083 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-0912dafc-9bd4-4d05-af31-5e8f90cf7ac3 tempest-VolumesActionsTest-262392969 tempest-VolumesActionsTest-262392969-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:46:41.342521 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-0912dafc-9bd4-4d05-af31-5e8f90cf7ac3 tempest-VolumesActionsTest-262392969 tempest-VolumesActionsTest-262392969-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:46:41.407093 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-0912dafc-9bd4-4d05-af31-5e8f90cf7ac3 tempest-VolumesActionsTest-262392969 tempest-VolumesActionsTest-262392969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '050d5eb22b2c45ee85eb8c118b9ef21e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f9f86fa910c4054b31927ba26ea96b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:46:41.415126 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-0912dafc-9bd4-4d05-af31-5e8f90cf7ac3 tempest-VolumesActionsTest-262392969 tempest-VolumesActionsTest-262392969-project] 10.222.0.20 "GET /compute/v2.1/servers/2523f283-429c-4368-afcb-3b90612bda32" status: 200 len: 1217 microversion: 2.1 time: 0.091120 Jul 06 13:46:41.415694 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 118/256] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:46:41 2022] GET /compute/v2.1/servers/2523f283-429c-4368-afcb-3b90612bda32 => generated 1217 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:46:41.678023 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-7f00b68d-5fdb-4217-8d9c-aa7146b70b1b tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] Calling method '>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:46:41.678738 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-7f00b68d-5fdb-4217-8d9c-aa7146b70b1b tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] [instance: 965c7a0f-fa3f-4f5c-92bf-94d8b646a9ae] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:46:41.684706 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-7f00b68d-5fdb-4217-8d9c-aa7146b70b1b tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:46:41.685195 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-7f00b68d-5fdb-4217-8d9c-aa7146b70b1b tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:46:41.685959 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-7f00b68d-5fdb-4217-8d9c-aa7146b70b1b tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:46:41.686396 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-7f00b68d-5fdb-4217-8d9c-aa7146b70b1b tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:46:41.827726 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-7f00b68d-5fdb-4217-8d9c-aa7146b70b1b tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad0781ce20e54c3a9b7c61e0cccf6918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd48e24dbeaa241d7a97350fb2c8187b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:46:41.831706 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-e1dd8f15-22b7-498d-a435-08bd72a76996 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:46:41.832457 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-e1dd8f15-22b7-498d-a435-08bd72a76996 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] [instance: 546a77fd-66e1-4d89-afa3-58d632b09186] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:46:41.836976 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-7f00b68d-5fdb-4217-8d9c-aa7146b70b1b tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] 10.222.0.20 "GET /compute/v2.1/servers/965c7a0f-fa3f-4f5c-92bf-94d8b646a9ae" status: 200 len: 1314 microversion: 2.1 time: 0.163475 Jul 06 13:46:41.837816 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 139/257] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:46:41 2022] GET /compute/v2.1/servers/965c7a0f-fa3f-4f5c-92bf-94d8b646a9ae => generated 1314 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:46:41.840321 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-e1dd8f15-22b7-498d-a435-08bd72a76996 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:46:41.840772 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-e1dd8f15-22b7-498d-a435-08bd72a76996 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:46:41.841574 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-e1dd8f15-22b7-498d-a435-08bd72a76996 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:46:41.842008 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-e1dd8f15-22b7-498d-a435-08bd72a76996 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:46:41.994043 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-e1dd8f15-22b7-498d-a435-08bd72a76996 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d7cacb73c8342579d9f990b0193487c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05df572327d54bd99595974b75898052', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:46:42.001900 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-e1dd8f15-22b7-498d-a435-08bd72a76996 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] 10.222.0.20 "GET /compute/v2.1/servers/546a77fd-66e1-4d89-afa3-58d632b09186" status: 200 len: 1362 microversion: 2.1 time: 0.173977 Jul 06 13:46:42.002480 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 119/258] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:46:41 2022] GET /compute/v2.1/servers/546a77fd-66e1-4d89-afa3-58d632b09186 => generated 1362 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 06 13:46:42.114276 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-501e3b56-59c4-4f8d-b82d-cdf1a84af153 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Calling method '>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:46:42.115083 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-501e3b56-59c4-4f8d-b82d-cdf1a84af153 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] [instance: 5cf73c2b-28f6-49f1-a119-224c05679d2c] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:46:42.121572 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-501e3b56-59c4-4f8d-b82d-cdf1a84af153 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:46:42.122067 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-501e3b56-59c4-4f8d-b82d-cdf1a84af153 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:46:42.123358 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-501e3b56-59c4-4f8d-b82d-cdf1a84af153 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:46:42.133228 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-501e3b56-59c4-4f8d-b82d-cdf1a84af153 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:46:42.284206 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-501e3b56-59c4-4f8d-b82d-cdf1a84af153 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b572a8f465048558fc969b85b2aec5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd85f2a57a0847debf5aaf81aab7a638', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:46:42.319871 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-aa4fe7ac-8c5f-4842-baa4-7a6ad59335e9 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:46:42.320628 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-aa4fe7ac-8c5f-4842-baa4-7a6ad59335e9 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] [instance: c801676d-524f-42fc-a2b8-fe4186986d95] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:46:42.325891 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-501e3b56-59c4-4f8d-b82d-cdf1a84af153 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] 10.222.0.20 "GET /compute/v2.1/servers/5cf73c2b-28f6-49f1-a119-224c05679d2c" status: 200 len: 1366 microversion: 2.1 time: 0.215292 Jul 06 13:46:42.326413 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 140/259] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:46:42 2022] GET /compute/v2.1/servers/5cf73c2b-28f6-49f1-a119-224c05679d2c => generated 1366 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:46:42.328653 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-aa4fe7ac-8c5f-4842-baa4-7a6ad59335e9 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:46:42.329363 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-aa4fe7ac-8c5f-4842-baa4-7a6ad59335e9 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:46:42.330231 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-aa4fe7ac-8c5f-4842-baa4-7a6ad59335e9 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:46:42.330718 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-aa4fe7ac-8c5f-4842-baa4-7a6ad59335e9 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:46:42.433734 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-d8df7465-2bab-4778-9f5e-8b6de46c0c93 tempest-VolumesActionsTest-262392969 tempest-VolumesActionsTest-262392969-project] Calling method '>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:46:42.434644 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-d8df7465-2bab-4778-9f5e-8b6de46c0c93 tempest-VolumesActionsTest-262392969 tempest-VolumesActionsTest-262392969-project] [instance: 2523f283-429c-4368-afcb-3b90612bda32] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:46:42.442213 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-d8df7465-2bab-4778-9f5e-8b6de46c0c93 tempest-VolumesActionsTest-262392969 tempest-VolumesActionsTest-262392969-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:46:42.442659 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-d8df7465-2bab-4778-9f5e-8b6de46c0c93 tempest-VolumesActionsTest-262392969 tempest-VolumesActionsTest-262392969-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:46:42.444014 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-d8df7465-2bab-4778-9f5e-8b6de46c0c93 tempest-VolumesActionsTest-262392969 tempest-VolumesActionsTest-262392969-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:46:42.444446 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-d8df7465-2bab-4778-9f5e-8b6de46c0c93 tempest-VolumesActionsTest-262392969 tempest-VolumesActionsTest-262392969-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:46:42.480187 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-aa4fe7ac-8c5f-4842-baa4-7a6ad59335e9 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c83c05bec4f456d8aa7d51732ddc8af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b2a80a004e04da7ae12db9f3f87146f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:46:42.495029 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-aa4fe7ac-8c5f-4842-baa4-7a6ad59335e9 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] 10.222.0.20 "GET /compute/v2.1/servers/c801676d-524f-42fc-a2b8-fe4186986d95" status: 200 len: 1322 microversion: 2.1 time: 0.186480 Jul 06 13:46:42.496796 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 120/260] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:46:42 2022] GET /compute/v2.1/servers/c801676d-524f-42fc-a2b8-fe4186986d95 => generated 1322 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:46:42.523032 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-d8df7465-2bab-4778-9f5e-8b6de46c0c93 tempest-VolumesActionsTest-262392969 tempest-VolumesActionsTest-262392969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '050d5eb22b2c45ee85eb8c118b9ef21e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f9f86fa910c4054b31927ba26ea96b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:46:42.533915 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-d8df7465-2bab-4778-9f5e-8b6de46c0c93 tempest-VolumesActionsTest-262392969 tempest-VolumesActionsTest-262392969-project] 10.222.0.20 "GET /compute/v2.1/servers/2523f283-429c-4368-afcb-3b90612bda32" status: 200 len: 1217 microversion: 2.1 time: 0.105327 Jul 06 13:46:42.534985 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 141/261] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:46:42 2022] GET /compute/v2.1/servers/2523f283-429c-4368-afcb-3b90612bda32 => generated 1217 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 06 13:46:42.855182 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-f5b5b842-0ea8-461e-b53a-0db920028595 tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:46:42.855817 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-f5b5b842-0ea8-461e-b53a-0db920028595 tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] [instance: 965c7a0f-fa3f-4f5c-92bf-94d8b646a9ae] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:46:42.868183 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-f5b5b842-0ea8-461e-b53a-0db920028595 tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:46:42.868640 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-f5b5b842-0ea8-461e-b53a-0db920028595 tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:46:42.869463 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-f5b5b842-0ea8-461e-b53a-0db920028595 tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:46:42.869908 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-f5b5b842-0ea8-461e-b53a-0db920028595 tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:46:43.026289 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-d24d5488-4d79-4b3b-a9f6-e081fd4109b6 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Calling method '>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:46:43.027062 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-d24d5488-4d79-4b3b-a9f6-e081fd4109b6 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] [instance: 546a77fd-66e1-4d89-afa3-58d632b09186] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:46:43.030686 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-f5b5b842-0ea8-461e-b53a-0db920028595 tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad0781ce20e54c3a9b7c61e0cccf6918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd48e24dbeaa241d7a97350fb2c8187b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:46:43.038521 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-d24d5488-4d79-4b3b-a9f6-e081fd4109b6 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:46:43.038967 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-d24d5488-4d79-4b3b-a9f6-e081fd4109b6 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:46:43.039893 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-d24d5488-4d79-4b3b-a9f6-e081fd4109b6 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:46:43.040506 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-d24d5488-4d79-4b3b-a9f6-e081fd4109b6 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:46:43.040698 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-f5b5b842-0ea8-461e-b53a-0db920028595 tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] 10.222.0.20 "GET /compute/v2.1/servers/965c7a0f-fa3f-4f5c-92bf-94d8b646a9ae" status: 200 len: 1314 microversion: 2.1 time: 0.189931 Jul 06 13:46:43.041342 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 121/262] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:46:42 2022] GET /compute/v2.1/servers/965c7a0f-fa3f-4f5c-92bf-94d8b646a9ae => generated 1314 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:46:43.184246 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-d24d5488-4d79-4b3b-a9f6-e081fd4109b6 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d7cacb73c8342579d9f990b0193487c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05df572327d54bd99595974b75898052', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:46:43.192469 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-d24d5488-4d79-4b3b-a9f6-e081fd4109b6 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] 10.222.0.20 "GET /compute/v2.1/servers/546a77fd-66e1-4d89-afa3-58d632b09186" status: 200 len: 1362 microversion: 2.1 time: 0.176740 Jul 06 13:46:43.192469 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 142/263] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:46:43 2022] GET /compute/v2.1/servers/546a77fd-66e1-4d89-afa3-58d632b09186 => generated 1362 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 06 13:46:43.343023 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-f6f68a69-6524-4f72-9182-6c563603d0e5 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:46:43.343568 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-f6f68a69-6524-4f72-9182-6c563603d0e5 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] [instance: 5cf73c2b-28f6-49f1-a119-224c05679d2c] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:46:43.350526 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-f6f68a69-6524-4f72-9182-6c563603d0e5 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:46:43.350976 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-f6f68a69-6524-4f72-9182-6c563603d0e5 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:46:43.351758 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-f6f68a69-6524-4f72-9182-6c563603d0e5 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:46:43.352161 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-f6f68a69-6524-4f72-9182-6c563603d0e5 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:46:43.488365 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-f6f68a69-6524-4f72-9182-6c563603d0e5 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b572a8f465048558fc969b85b2aec5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd85f2a57a0847debf5aaf81aab7a638', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:46:43.496586 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-f6f68a69-6524-4f72-9182-6c563603d0e5 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] 10.222.0.20 "GET /compute/v2.1/servers/5cf73c2b-28f6-49f1-a119-224c05679d2c" status: 200 len: 1366 microversion: 2.1 time: 0.157390 Jul 06 13:46:43.497198 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 122/264] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:46:43 2022] GET /compute/v2.1/servers/5cf73c2b-28f6-49f1-a119-224c05679d2c => generated 1366 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:46:43.514008 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-ae3fe1a2-afb4-401a-8038-82611059da21 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Calling method '>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:46:43.514613 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-ae3fe1a2-afb4-401a-8038-82611059da21 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] [instance: c801676d-524f-42fc-a2b8-fe4186986d95] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:46:43.520575 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-ae3fe1a2-afb4-401a-8038-82611059da21 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:46:43.521056 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-ae3fe1a2-afb4-401a-8038-82611059da21 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:46:43.522394 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-ae3fe1a2-afb4-401a-8038-82611059da21 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:46:43.522826 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-ae3fe1a2-afb4-401a-8038-82611059da21 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:46:43.550854 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-0614463d-a681-4dcb-bbac-cb4424d4405e tempest-VolumesActionsTest-262392969 tempest-VolumesActionsTest-262392969-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:46:43.551710 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-0614463d-a681-4dcb-bbac-cb4424d4405e tempest-VolumesActionsTest-262392969 tempest-VolumesActionsTest-262392969-project] [instance: 2523f283-429c-4368-afcb-3b90612bda32] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:46:43.563960 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-0614463d-a681-4dcb-bbac-cb4424d4405e tempest-VolumesActionsTest-262392969 tempest-VolumesActionsTest-262392969-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:46:43.564400 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-0614463d-a681-4dcb-bbac-cb4424d4405e tempest-VolumesActionsTest-262392969 tempest-VolumesActionsTest-262392969-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:46:43.565193 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-0614463d-a681-4dcb-bbac-cb4424d4405e tempest-VolumesActionsTest-262392969 tempest-VolumesActionsTest-262392969-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:46:43.565625 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-0614463d-a681-4dcb-bbac-cb4424d4405e tempest-VolumesActionsTest-262392969 tempest-VolumesActionsTest-262392969-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:46:43.637205 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-0614463d-a681-4dcb-bbac-cb4424d4405e tempest-VolumesActionsTest-262392969 tempest-VolumesActionsTest-262392969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '050d5eb22b2c45ee85eb8c118b9ef21e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f9f86fa910c4054b31927ba26ea96b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:46:43.646974 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-0614463d-a681-4dcb-bbac-cb4424d4405e tempest-VolumesActionsTest-262392969 tempest-VolumesActionsTest-262392969-project] 10.222.0.20 "GET /compute/v2.1/servers/2523f283-429c-4368-afcb-3b90612bda32" status: 200 len: 1217 microversion: 2.1 time: 0.099222 Jul 06 13:46:43.648104 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 123/265] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:46:43 2022] GET /compute/v2.1/servers/2523f283-429c-4368-afcb-3b90612bda32 => generated 1217 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:46:43.675710 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-ae3fe1a2-afb4-401a-8038-82611059da21 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c83c05bec4f456d8aa7d51732ddc8af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b2a80a004e04da7ae12db9f3f87146f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:46:43.684305 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-ae3fe1a2-afb4-401a-8038-82611059da21 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] 10.222.0.20 "GET /compute/v2.1/servers/c801676d-524f-42fc-a2b8-fe4186986d95" status: 200 len: 1322 microversion: 2.1 time: 0.174006 Jul 06 13:46:43.684887 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 143/266] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:46:43 2022] GET /compute/v2.1/servers/c801676d-524f-42fc-a2b8-fe4186986d95 => generated 1322 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:46:44.059203 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-40d498cf-3d0e-4ff5-b549-71913108ab95 tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:46:44.059893 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-40d498cf-3d0e-4ff5-b549-71913108ab95 tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] [instance: 965c7a0f-fa3f-4f5c-92bf-94d8b646a9ae] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:46:44.066748 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-40d498cf-3d0e-4ff5-b549-71913108ab95 tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:46:44.067199 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-40d498cf-3d0e-4ff5-b549-71913108ab95 tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:46:44.068179 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-40d498cf-3d0e-4ff5-b549-71913108ab95 tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:46:44.068614 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-40d498cf-3d0e-4ff5-b549-71913108ab95 tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:46:44.218567 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-8b8e7e1b-4bef-4ae3-b171-4d2b13881df2 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Calling method '>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:46:44.220287 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-8b8e7e1b-4bef-4ae3-b171-4d2b13881df2 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] [instance: 546a77fd-66e1-4d89-afa3-58d632b09186] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:46:44.229957 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-8b8e7e1b-4bef-4ae3-b171-4d2b13881df2 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:46:44.230671 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-8b8e7e1b-4bef-4ae3-b171-4d2b13881df2 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:46:44.231611 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-8b8e7e1b-4bef-4ae3-b171-4d2b13881df2 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:46:44.232190 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-8b8e7e1b-4bef-4ae3-b171-4d2b13881df2 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:46:44.237338 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG dbcounter [-] [124368] Writing DB stats nova_cell1:SELECT=100 {{(pid=124368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:46:44.239248 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-40d498cf-3d0e-4ff5-b549-71913108ab95 tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad0781ce20e54c3a9b7c61e0cccf6918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd48e24dbeaa241d7a97350fb2c8187b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:46:44.250277 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-40d498cf-3d0e-4ff5-b549-71913108ab95 tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] 10.222.0.20 "GET /compute/v2.1/servers/965c7a0f-fa3f-4f5c-92bf-94d8b646a9ae" status: 200 len: 1314 microversion: 2.1 time: 0.194599 Jul 06 13:46:44.261136 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 124/267] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:46:44 2022] GET /compute/v2.1/servers/965c7a0f-fa3f-4f5c-92bf-94d8b646a9ae => generated 1314 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:46:44.395834 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-8b8e7e1b-4bef-4ae3-b171-4d2b13881df2 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d7cacb73c8342579d9f990b0193487c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05df572327d54bd99595974b75898052', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:46:44.407210 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-8b8e7e1b-4bef-4ae3-b171-4d2b13881df2 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] 10.222.0.20 "GET /compute/v2.1/servers/546a77fd-66e1-4d89-afa3-58d632b09186" status: 200 len: 1362 microversion: 2.1 time: 0.202162 Jul 06 13:46:44.409043 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 144/268] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:46:44 2022] GET /compute/v2.1/servers/546a77fd-66e1-4d89-afa3-58d632b09186 => generated 1362 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:46:44.447744 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [req-91123b2c-ee83-41a2-bc02-612616f184d4 req-b0213480-b9c4-4014-8890-c1c94eb1370d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "546a77fd-66e1-4d89-afa3-58d632b09186", "name": "network-vif-plugged", "status": "completed", "tag": "3ca14d5b-272c-4543-9380-0fbec0da4da8"}]} {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 06 13:46:44.456950 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [req-91123b2c-ee83-41a2-bc02-612616f184d4 req-b0213480-b9c4-4014-8890-c1c94eb1370d service nova] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:46:44.457464 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [req-91123b2c-ee83-41a2-bc02-612616f184d4 req-b0213480-b9c4-4014-8890-c1c94eb1370d service nova] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:46:44.469678 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.compute.server_external_events [req-91123b2c-ee83-41a2-bc02-612616f184d4 req-b0213480-b9c4-4014-8890-c1c94eb1370d service nova] Creating event network-vif-plugged:3ca14d5b-272c-4543-9380-0fbec0da4da8 for instance 546a77fd-66e1-4d89-afa3-58d632b09186 on hv-cinder-81914 Jul 06 13:46:44.474914 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [req-91123b2c-ee83-41a2-bc02-612616f184d4 req-b0213480-b9c4-4014-8890-c1c94eb1370d service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032330 Jul 06 13:46:44.475502 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 125/269] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 6 13:46:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 06 13:46:44.514433 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-b99344ea-d10d-43e3-b900-f0b1477cd242 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Calling method '>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:46:44.515041 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-b99344ea-d10d-43e3-b900-f0b1477cd242 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] [instance: 5cf73c2b-28f6-49f1-a119-224c05679d2c] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:46:44.522315 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-b99344ea-d10d-43e3-b900-f0b1477cd242 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:46:44.523362 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-b99344ea-d10d-43e3-b900-f0b1477cd242 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:46:44.525274 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-b99344ea-d10d-43e3-b900-f0b1477cd242 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:46:44.525919 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-b99344ea-d10d-43e3-b900-f0b1477cd242 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:46:44.664971 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-d8ae532f-b6e5-4d47-b577-d7097940b7b3 tempest-VolumesActionsTest-262392969 tempest-VolumesActionsTest-262392969-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:46:44.665702 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-d8ae532f-b6e5-4d47-b577-d7097940b7b3 tempest-VolumesActionsTest-262392969 tempest-VolumesActionsTest-262392969-project] [instance: 2523f283-429c-4368-afcb-3b90612bda32] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:46:44.685762 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-d8ae532f-b6e5-4d47-b577-d7097940b7b3 tempest-VolumesActionsTest-262392969 tempest-VolumesActionsTest-262392969-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:46:44.686278 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-d8ae532f-b6e5-4d47-b577-d7097940b7b3 tempest-VolumesActionsTest-262392969 tempest-VolumesActionsTest-262392969-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:46:44.687074 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-d8ae532f-b6e5-4d47-b577-d7097940b7b3 tempest-VolumesActionsTest-262392969 tempest-VolumesActionsTest-262392969-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:46:44.687650 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-d8ae532f-b6e5-4d47-b577-d7097940b7b3 tempest-VolumesActionsTest-262392969 tempest-VolumesActionsTest-262392969-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:46:44.697092 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-b99344ea-d10d-43e3-b900-f0b1477cd242 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b572a8f465048558fc969b85b2aec5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd85f2a57a0847debf5aaf81aab7a638', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:46:44.706370 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-b99344ea-d10d-43e3-b900-f0b1477cd242 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] 10.222.0.20 "GET /compute/v2.1/servers/5cf73c2b-28f6-49f1-a119-224c05679d2c" status: 200 len: 1366 microversion: 2.1 time: 0.195652 Jul 06 13:46:44.707249 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 145/270] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:46:44 2022] GET /compute/v2.1/servers/5cf73c2b-28f6-49f1-a119-224c05679d2c => generated 1366 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:46:44.712583 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-58393980-523b-464f-9f79-9e7d76bb6636 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Calling method '>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:46:44.713369 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-58393980-523b-464f-9f79-9e7d76bb6636 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] [instance: c801676d-524f-42fc-a2b8-fe4186986d95] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:46:44.720602 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-58393980-523b-464f-9f79-9e7d76bb6636 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:46:44.721097 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-58393980-523b-464f-9f79-9e7d76bb6636 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:46:44.722058 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-58393980-523b-464f-9f79-9e7d76bb6636 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:46:44.722697 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-58393980-523b-464f-9f79-9e7d76bb6636 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:46:44.774832 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-d8ae532f-b6e5-4d47-b577-d7097940b7b3 tempest-VolumesActionsTest-262392969 tempest-VolumesActionsTest-262392969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '050d5eb22b2c45ee85eb8c118b9ef21e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f9f86fa910c4054b31927ba26ea96b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:46:44.782320 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-d8ae532f-b6e5-4d47-b577-d7097940b7b3 tempest-VolumesActionsTest-262392969 tempest-VolumesActionsTest-262392969-project] 10.222.0.20 "GET /compute/v2.1/servers/2523f283-429c-4368-afcb-3b90612bda32" status: 200 len: 1217 microversion: 2.1 time: 0.122220 Jul 06 13:46:44.782877 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 126/271] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:46:44 2022] GET /compute/v2.1/servers/2523f283-429c-4368-afcb-3b90612bda32 => generated 1217 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:46:44.858592 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-58393980-523b-464f-9f79-9e7d76bb6636 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c83c05bec4f456d8aa7d51732ddc8af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b2a80a004e04da7ae12db9f3f87146f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:46:44.866713 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-58393980-523b-464f-9f79-9e7d76bb6636 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] 10.222.0.20 "GET /compute/v2.1/servers/c801676d-524f-42fc-a2b8-fe4186986d95" status: 200 len: 1322 microversion: 2.1 time: 0.158265 Jul 06 13:46:44.867267 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 146/272] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:46:44 2022] GET /compute/v2.1/servers/c801676d-524f-42fc-a2b8-fe4186986d95 => generated 1322 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:46:45.267591 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-3c7ec300-e857-423b-a639-b437b8be1b0b tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:46:45.268157 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-3c7ec300-e857-423b-a639-b437b8be1b0b tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] [instance: 965c7a0f-fa3f-4f5c-92bf-94d8b646a9ae] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:46:45.274843 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-3c7ec300-e857-423b-a639-b437b8be1b0b tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:46:45.275295 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-3c7ec300-e857-423b-a639-b437b8be1b0b tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:46:45.276057 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-3c7ec300-e857-423b-a639-b437b8be1b0b tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:46:45.276497 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-3c7ec300-e857-423b-a639-b437b8be1b0b tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:46:45.406018 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-3c7ec300-e857-423b-a639-b437b8be1b0b tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad0781ce20e54c3a9b7c61e0cccf6918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd48e24dbeaa241d7a97350fb2c8187b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:46:45.413969 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-3c7ec300-e857-423b-a639-b437b8be1b0b tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] 10.222.0.20 "GET /compute/v2.1/servers/965c7a0f-fa3f-4f5c-92bf-94d8b646a9ae" status: 200 len: 1314 microversion: 2.1 time: 0.150242 Jul 06 13:46:45.414575 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 127/273] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:46:45 2022] GET /compute/v2.1/servers/965c7a0f-fa3f-4f5c-92bf-94d8b646a9ae => generated 1314 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:46:45.424525 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-c5387311-20a9-4841-bd78-b6f42d0e66ca tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Calling method '>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:46:45.425160 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-c5387311-20a9-4841-bd78-b6f42d0e66ca tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] [instance: 546a77fd-66e1-4d89-afa3-58d632b09186] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:46:45.431724 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-c5387311-20a9-4841-bd78-b6f42d0e66ca tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:46:45.432186 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-c5387311-20a9-4841-bd78-b6f42d0e66ca tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:46:45.432947 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-c5387311-20a9-4841-bd78-b6f42d0e66ca tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:46:45.433429 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-c5387311-20a9-4841-bd78-b6f42d0e66ca tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:46:45.571184 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-c5387311-20a9-4841-bd78-b6f42d0e66ca tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d7cacb73c8342579d9f990b0193487c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05df572327d54bd99595974b75898052', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:46:45.578554 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-c5387311-20a9-4841-bd78-b6f42d0e66ca tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] 10.222.0.20 "GET /compute/v2.1/servers/546a77fd-66e1-4d89-afa3-58d632b09186" status: 200 len: 1362 microversion: 2.1 time: 0.157736 Jul 06 13:46:45.579114 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 147/274] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:46:45 2022] GET /compute/v2.1/servers/546a77fd-66e1-4d89-afa3-58d632b09186 => generated 1362 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:46:45.730104 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-25e29704-7c55-4fbf-b6e5-7ca0f88db623 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:46:45.731039 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-25e29704-7c55-4fbf-b6e5-7ca0f88db623 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] [instance: 5cf73c2b-28f6-49f1-a119-224c05679d2c] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:46:45.737661 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-25e29704-7c55-4fbf-b6e5-7ca0f88db623 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:46:45.738206 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-25e29704-7c55-4fbf-b6e5-7ca0f88db623 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:46:45.739202 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-25e29704-7c55-4fbf-b6e5-7ca0f88db623 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:46:45.739706 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-25e29704-7c55-4fbf-b6e5-7ca0f88db623 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:46:45.806143 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-0db1150f-5046-4650-81cf-3efb1f6d0987 tempest-VolumesActionsTest-262392969 tempest-VolumesActionsTest-262392969-project] Calling method '>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:46:45.807123 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-0db1150f-5046-4650-81cf-3efb1f6d0987 tempest-VolumesActionsTest-262392969 tempest-VolumesActionsTest-262392969-project] [instance: 2523f283-429c-4368-afcb-3b90612bda32] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:46:45.818757 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-0db1150f-5046-4650-81cf-3efb1f6d0987 tempest-VolumesActionsTest-262392969 tempest-VolumesActionsTest-262392969-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:46:45.819667 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-0db1150f-5046-4650-81cf-3efb1f6d0987 tempest-VolumesActionsTest-262392969 tempest-VolumesActionsTest-262392969-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:46:45.820698 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-0db1150f-5046-4650-81cf-3efb1f6d0987 tempest-VolumesActionsTest-262392969 tempest-VolumesActionsTest-262392969-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:46:45.821261 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-0db1150f-5046-4650-81cf-3efb1f6d0987 tempest-VolumesActionsTest-262392969 tempest-VolumesActionsTest-262392969-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:46:45.902935 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-0db1150f-5046-4650-81cf-3efb1f6d0987 tempest-VolumesActionsTest-262392969 tempest-VolumesActionsTest-262392969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '050d5eb22b2c45ee85eb8c118b9ef21e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f9f86fa910c4054b31927ba26ea96b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:46:45.910463 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-0db1150f-5046-4650-81cf-3efb1f6d0987 tempest-VolumesActionsTest-262392969 tempest-VolumesActionsTest-262392969-project] 10.222.0.20 "GET /compute/v2.1/servers/2523f283-429c-4368-afcb-3b90612bda32" status: 200 len: 1217 microversion: 2.1 time: 0.114691 Jul 06 13:46:45.919992 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 148/275] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:46:45 2022] GET /compute/v2.1/servers/2523f283-429c-4368-afcb-3b90612bda32 => generated 1217 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 06 13:46:45.924743 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-3a46b344-d71f-43d2-9c9b-cc91c33bf3de tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Calling method '>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:46:45.925611 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-3a46b344-d71f-43d2-9c9b-cc91c33bf3de tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] [instance: c801676d-524f-42fc-a2b8-fe4186986d95] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:46:45.926434 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-25e29704-7c55-4fbf-b6e5-7ca0f88db623 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b572a8f465048558fc969b85b2aec5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd85f2a57a0847debf5aaf81aab7a638', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:46:45.934690 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-3a46b344-d71f-43d2-9c9b-cc91c33bf3de tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:46:45.935154 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-25e29704-7c55-4fbf-b6e5-7ca0f88db623 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] 10.222.0.20 "GET /compute/v2.1/servers/5cf73c2b-28f6-49f1-a119-224c05679d2c" status: 200 len: 1366 microversion: 2.1 time: 0.211490 Jul 06 13:46:45.936236 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-3a46b344-d71f-43d2-9c9b-cc91c33bf3de tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:46:45.937530 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-3a46b344-d71f-43d2-9c9b-cc91c33bf3de tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:46:45.938040 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-3a46b344-d71f-43d2-9c9b-cc91c33bf3de tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:46:45.946260 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 128/276] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:46:45 2022] GET /compute/v2.1/servers/5cf73c2b-28f6-49f1-a119-224c05679d2c => generated 1366 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:46:46.089312 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-3a46b344-d71f-43d2-9c9b-cc91c33bf3de tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c83c05bec4f456d8aa7d51732ddc8af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b2a80a004e04da7ae12db9f3f87146f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:46:46.097012 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-3a46b344-d71f-43d2-9c9b-cc91c33bf3de tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] 10.222.0.20 "GET /compute/v2.1/servers/c801676d-524f-42fc-a2b8-fe4186986d95" status: 200 len: 1322 microversion: 2.1 time: 0.175930 Jul 06 13:46:46.097566 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 149/277] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:46:45 2022] GET /compute/v2.1/servers/c801676d-524f-42fc-a2b8-fe4186986d95 => generated 1322 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:46:46.431731 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-75ad40b9-8c3e-406f-b0e3-f4a8a84b0854 tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:46:46.432471 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-75ad40b9-8c3e-406f-b0e3-f4a8a84b0854 tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] [instance: 965c7a0f-fa3f-4f5c-92bf-94d8b646a9ae] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:46:46.439223 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-75ad40b9-8c3e-406f-b0e3-f4a8a84b0854 tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:46:46.439664 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-75ad40b9-8c3e-406f-b0e3-f4a8a84b0854 tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:46:46.440423 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-75ad40b9-8c3e-406f-b0e3-f4a8a84b0854 tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:46:46.441034 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-75ad40b9-8c3e-406f-b0e3-f4a8a84b0854 tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:46:46.460533 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG dbcounter [-] [124367] Writing DB stats nova_cell1:SELECT=100 {{(pid=124367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:46:46.581631 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-75ad40b9-8c3e-406f-b0e3-f4a8a84b0854 tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad0781ce20e54c3a9b7c61e0cccf6918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd48e24dbeaa241d7a97350fb2c8187b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:46:46.589297 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-75ad40b9-8c3e-406f-b0e3-f4a8a84b0854 tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] 10.222.0.20 "GET /compute/v2.1/servers/965c7a0f-fa3f-4f5c-92bf-94d8b646a9ae" status: 200 len: 1314 microversion: 2.1 time: 0.162146 Jul 06 13:46:46.590053 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 129/278] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:46:46 2022] GET /compute/v2.1/servers/965c7a0f-fa3f-4f5c-92bf-94d8b646a9ae => generated 1314 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:46:46.595447 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-6736802e-47da-44b4-9162-a1abd7b15470 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Calling method '>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:46:46.596115 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-6736802e-47da-44b4-9162-a1abd7b15470 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] [instance: 546a77fd-66e1-4d89-afa3-58d632b09186] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:46:46.602821 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-6736802e-47da-44b4-9162-a1abd7b15470 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:46:46.603537 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-6736802e-47da-44b4-9162-a1abd7b15470 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:46:46.604662 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-6736802e-47da-44b4-9162-a1abd7b15470 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:46:46.605319 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-6736802e-47da-44b4-9162-a1abd7b15470 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:46:46.821103 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-6736802e-47da-44b4-9162-a1abd7b15470 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d7cacb73c8342579d9f990b0193487c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05df572327d54bd99595974b75898052', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:46:46.829861 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-6736802e-47da-44b4-9162-a1abd7b15470 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] 10.222.0.20 "GET /compute/v2.1/servers/546a77fd-66e1-4d89-afa3-58d632b09186" status: 200 len: 1362 microversion: 2.1 time: 0.237735 Jul 06 13:46:46.836011 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 150/279] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:46:46 2022] GET /compute/v2.1/servers/546a77fd-66e1-4d89-afa3-58d632b09186 => generated 1362 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:46:46.934764 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-e0292545-7145-404b-b2dd-c1d9b8586ad6 tempest-VolumesActionsTest-262392969 tempest-VolumesActionsTest-262392969-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:46:46.934764 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-e0292545-7145-404b-b2dd-c1d9b8586ad6 tempest-VolumesActionsTest-262392969 tempest-VolumesActionsTest-262392969-project] [instance: 2523f283-429c-4368-afcb-3b90612bda32] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:46:46.938849 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-e0292545-7145-404b-b2dd-c1d9b8586ad6 tempest-VolumesActionsTest-262392969 tempest-VolumesActionsTest-262392969-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:46:46.939493 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-e0292545-7145-404b-b2dd-c1d9b8586ad6 tempest-VolumesActionsTest-262392969 tempest-VolumesActionsTest-262392969-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:46:46.940308 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-e0292545-7145-404b-b2dd-c1d9b8586ad6 tempest-VolumesActionsTest-262392969 tempest-VolumesActionsTest-262392969-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:46:46.940742 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-e0292545-7145-404b-b2dd-c1d9b8586ad6 tempest-VolumesActionsTest-262392969 tempest-VolumesActionsTest-262392969-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:46:46.956444 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-79eea863-aa10-4fb9-9a90-ccc433f1f9bf tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Calling method '>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:46:46.957110 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-79eea863-aa10-4fb9-9a90-ccc433f1f9bf tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] [instance: 5cf73c2b-28f6-49f1-a119-224c05679d2c] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:46:46.969997 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-79eea863-aa10-4fb9-9a90-ccc433f1f9bf tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:46:46.970444 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-79eea863-aa10-4fb9-9a90-ccc433f1f9bf tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:46:46.971272 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-79eea863-aa10-4fb9-9a90-ccc433f1f9bf tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:46:46.972007 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-79eea863-aa10-4fb9-9a90-ccc433f1f9bf tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:46:47.018769 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-e0292545-7145-404b-b2dd-c1d9b8586ad6 tempest-VolumesActionsTest-262392969 tempest-VolumesActionsTest-262392969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '050d5eb22b2c45ee85eb8c118b9ef21e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f9f86fa910c4054b31927ba26ea96b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:46:47.027630 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-e0292545-7145-404b-b2dd-c1d9b8586ad6 tempest-VolumesActionsTest-262392969 tempest-VolumesActionsTest-262392969-project] 10.222.0.20 "GET /compute/v2.1/servers/2523f283-429c-4368-afcb-3b90612bda32" status: 200 len: 1209 microversion: 2.1 time: 0.104195 Jul 06 13:46:47.039150 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 130/280] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:46:46 2022] GET /compute/v2.1/servers/2523f283-429c-4368-afcb-3b90612bda32 => generated 1209 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:46:47.117920 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [req-18a90bfa-4d5b-42c3-9e64-d470f0ca34d7 req-48239dae-fd91-4ee4-bcd1-d93dee7632dd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5cf73c2b-28f6-49f1-a119-224c05679d2c", "name": "network-vif-plugged", "status": "completed", "tag": "eb26a6ef-8459-409e-986c-7f71a4f52683"}]} {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 06 13:46:47.129339 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [req-18a90bfa-4d5b-42c3-9e64-d470f0ca34d7 req-48239dae-fd91-4ee4-bcd1-d93dee7632dd service nova] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:46:47.130032 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [req-18a90bfa-4d5b-42c3-9e64-d470f0ca34d7 req-48239dae-fd91-4ee4-bcd1-d93dee7632dd service nova] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:46:47.142223 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-79eea863-aa10-4fb9-9a90-ccc433f1f9bf tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b572a8f465048558fc969b85b2aec5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd85f2a57a0847debf5aaf81aab7a638', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:46:47.156020 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-79eea863-aa10-4fb9-9a90-ccc433f1f9bf tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] 10.222.0.20 "GET /compute/v2.1/servers/5cf73c2b-28f6-49f1-a119-224c05679d2c" status: 200 len: 1366 microversion: 2.1 time: 0.206223 Jul 06 13:46:47.159236 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 151/281] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:46:46 2022] GET /compute/v2.1/servers/5cf73c2b-28f6-49f1-a119-224c05679d2c => generated 1366 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:46:47.159747 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.compute.server_external_events [req-18a90bfa-4d5b-42c3-9e64-d470f0ca34d7 req-48239dae-fd91-4ee4-bcd1-d93dee7632dd service nova] Creating event network-vif-plugged:eb26a6ef-8459-409e-986c-7f71a4f52683 for instance 5cf73c2b-28f6-49f1-a119-224c05679d2c on hv-cinder-81914 Jul 06 13:46:47.166527 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [req-18a90bfa-4d5b-42c3-9e64-d470f0ca34d7 req-48239dae-fd91-4ee4-bcd1-d93dee7632dd service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054810 Jul 06 13:46:47.167420 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 131/282] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 6 13:46:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 06 13:46:47.169518 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-7c497d24-7f5e-4d8a-93c1-4b0b4665dae1 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Calling method '>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:46:47.169518 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-7c497d24-7f5e-4d8a-93c1-4b0b4665dae1 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] [instance: c801676d-524f-42fc-a2b8-fe4186986d95] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:46:47.175799 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-7c497d24-7f5e-4d8a-93c1-4b0b4665dae1 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:46:47.176501 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-7c497d24-7f5e-4d8a-93c1-4b0b4665dae1 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:46:47.177848 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-7c497d24-7f5e-4d8a-93c1-4b0b4665dae1 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:46:47.178733 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-7c497d24-7f5e-4d8a-93c1-4b0b4665dae1 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:46:47.332958 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-7c497d24-7f5e-4d8a-93c1-4b0b4665dae1 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c83c05bec4f456d8aa7d51732ddc8af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b2a80a004e04da7ae12db9f3f87146f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:46:47.349553 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-7c497d24-7f5e-4d8a-93c1-4b0b4665dae1 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] 10.222.0.20 "GET /compute/v2.1/servers/c801676d-524f-42fc-a2b8-fe4186986d95" status: 200 len: 1322 microversion: 2.1 time: 0.188634 Jul 06 13:46:47.350604 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 152/283] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:46:47 2022] GET /compute/v2.1/servers/c801676d-524f-42fc-a2b8-fe4186986d95 => generated 1322 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:46:47.607432 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-d61c3002-b3c4-45eb-818a-7c69da7dfbec tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:46:47.608639 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-d61c3002-b3c4-45eb-818a-7c69da7dfbec tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] [instance: 965c7a0f-fa3f-4f5c-92bf-94d8b646a9ae] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:46:47.626206 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-d61c3002-b3c4-45eb-818a-7c69da7dfbec tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:46:47.627378 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-d61c3002-b3c4-45eb-818a-7c69da7dfbec tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:46:47.629295 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-d61c3002-b3c4-45eb-818a-7c69da7dfbec tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:46:47.630140 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-d61c3002-b3c4-45eb-818a-7c69da7dfbec tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:46:47.848092 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-a705321d-1127-4198-8654-7e797372fd12 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Calling method '>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:46:47.848846 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-a705321d-1127-4198-8654-7e797372fd12 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] [instance: 546a77fd-66e1-4d89-afa3-58d632b09186] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:46:47.858469 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-a705321d-1127-4198-8654-7e797372fd12 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:46:47.859270 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-a705321d-1127-4198-8654-7e797372fd12 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:46:47.860268 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-a705321d-1127-4198-8654-7e797372fd12 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:46:47.861303 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-a705321d-1127-4198-8654-7e797372fd12 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:46:47.903388 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-d61c3002-b3c4-45eb-818a-7c69da7dfbec tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad0781ce20e54c3a9b7c61e0cccf6918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd48e24dbeaa241d7a97350fb2c8187b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:46:47.911156 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-d61c3002-b3c4-45eb-818a-7c69da7dfbec tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] 10.222.0.20 "GET /compute/v2.1/servers/965c7a0f-fa3f-4f5c-92bf-94d8b646a9ae" status: 200 len: 1314 microversion: 2.1 time: 0.309421 Jul 06 13:46:47.919584 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 132/284] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:46:47 2022] GET /compute/v2.1/servers/965c7a0f-fa3f-4f5c-92bf-94d8b646a9ae => generated 1314 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:46:48.027973 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-a705321d-1127-4198-8654-7e797372fd12 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d7cacb73c8342579d9f990b0193487c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05df572327d54bd99595974b75898052', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:46:48.046235 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-a705321d-1127-4198-8654-7e797372fd12 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] 10.222.0.20 "GET /compute/v2.1/servers/546a77fd-66e1-4d89-afa3-58d632b09186" status: 200 len: 1362 microversion: 2.1 time: 0.201917 Jul 06 13:46:48.048764 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-993c57b8-c972-4a19-ba04-18c8fc16077c tempest-VolumesActionsTest-262392969 tempest-VolumesActionsTest-262392969-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:46:48.049668 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-993c57b8-c972-4a19-ba04-18c8fc16077c tempest-VolumesActionsTest-262392969 tempest-VolumesActionsTest-262392969-project] [instance: 2523f283-429c-4368-afcb-3b90612bda32] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:46:48.057926 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 153/285] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:46:47 2022] GET /compute/v2.1/servers/546a77fd-66e1-4d89-afa3-58d632b09186 => generated 1362 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:46:48.058118 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-993c57b8-c972-4a19-ba04-18c8fc16077c tempest-VolumesActionsTest-262392969 tempest-VolumesActionsTest-262392969-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:46:48.058779 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-993c57b8-c972-4a19-ba04-18c8fc16077c tempest-VolumesActionsTest-262392969 tempest-VolumesActionsTest-262392969-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:46:48.059561 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-993c57b8-c972-4a19-ba04-18c8fc16077c tempest-VolumesActionsTest-262392969 tempest-VolumesActionsTest-262392969-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:46:48.060045 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-993c57b8-c972-4a19-ba04-18c8fc16077c tempest-VolumesActionsTest-262392969 tempest-VolumesActionsTest-262392969-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:46:48.131437 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-993c57b8-c972-4a19-ba04-18c8fc16077c tempest-VolumesActionsTest-262392969 tempest-VolumesActionsTest-262392969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '050d5eb22b2c45ee85eb8c118b9ef21e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f9f86fa910c4054b31927ba26ea96b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:46:48.139336 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-993c57b8-c972-4a19-ba04-18c8fc16077c tempest-VolumesActionsTest-262392969 tempest-VolumesActionsTest-262392969-project] 10.222.0.20 "GET /compute/v2.1/servers/2523f283-429c-4368-afcb-3b90612bda32" status: 200 len: 1265 microversion: 2.1 time: 0.096207 Jul 06 13:46:48.139915 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 133/286] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:46:48 2022] GET /compute/v2.1/servers/2523f283-429c-4368-afcb-3b90612bda32 => generated 1265 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 06 13:46:48.176148 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-b1230b8f-43e4-4ea1-a3df-f13039182a70 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Calling method '>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:46:48.176788 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-b1230b8f-43e4-4ea1-a3df-f13039182a70 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] [instance: 5cf73c2b-28f6-49f1-a119-224c05679d2c] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:46:48.183122 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-b1230b8f-43e4-4ea1-a3df-f13039182a70 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:46:48.183579 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-b1230b8f-43e4-4ea1-a3df-f13039182a70 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:46:48.184334 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-b1230b8f-43e4-4ea1-a3df-f13039182a70 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:46:48.184757 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-b1230b8f-43e4-4ea1-a3df-f13039182a70 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:46:48.313217 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-b1230b8f-43e4-4ea1-a3df-f13039182a70 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b572a8f465048558fc969b85b2aec5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd85f2a57a0847debf5aaf81aab7a638', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:46:48.320830 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-b1230b8f-43e4-4ea1-a3df-f13039182a70 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] 10.222.0.20 "GET /compute/v2.1/servers/5cf73c2b-28f6-49f1-a119-224c05679d2c" status: 200 len: 1366 microversion: 2.1 time: 0.148717 Jul 06 13:46:48.321423 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 154/287] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:46:48 2022] GET /compute/v2.1/servers/5cf73c2b-28f6-49f1-a119-224c05679d2c => generated 1366 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:46:48.368416 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-35481eb3-db83-4664-ae0f-0e91e6fbde7a tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:46:48.369073 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-35481eb3-db83-4664-ae0f-0e91e6fbde7a tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] [instance: c801676d-524f-42fc-a2b8-fe4186986d95] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:46:48.375164 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-35481eb3-db83-4664-ae0f-0e91e6fbde7a tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:46:48.375636 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-35481eb3-db83-4664-ae0f-0e91e6fbde7a tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:46:48.376415 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-35481eb3-db83-4664-ae0f-0e91e6fbde7a tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:46:48.376851 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-35481eb3-db83-4664-ae0f-0e91e6fbde7a tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:46:48.506466 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-35481eb3-db83-4664-ae0f-0e91e6fbde7a tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c83c05bec4f456d8aa7d51732ddc8af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b2a80a004e04da7ae12db9f3f87146f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:46:48.513827 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-35481eb3-db83-4664-ae0f-0e91e6fbde7a tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] 10.222.0.20 "GET /compute/v2.1/servers/c801676d-524f-42fc-a2b8-fe4186986d95" status: 200 len: 1516 microversion: 2.1 time: 0.149498 Jul 06 13:46:48.514389 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 134/288] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:46:48 2022] GET /compute/v2.1/servers/c801676d-524f-42fc-a2b8-fe4186986d95 => generated 1516 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:46:48.531809 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-86cc6ba0-f1d4-4495-9912-94a134ee2fdc tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 06 13:46:48.532830 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-86cc6ba0-f1d4-4495-9912-94a134ee2fdc tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] [instance: c801676d-524f-42fc-a2b8-fe4186986d95] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:46:48.539147 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-86cc6ba0-f1d4-4495-9912-94a134ee2fdc tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:46:48.539592 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-86cc6ba0-f1d4-4495-9912-94a134ee2fdc tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:46:48.540346 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-86cc6ba0-f1d4-4495-9912-94a134ee2fdc tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:46:48.540775 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-86cc6ba0-f1d4-4495-9912-94a134ee2fdc tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:46:48.601395 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.objects.instance [None req-86cc6ba0-f1d4-4495-9912-94a134ee2fdc tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lazy-loading 'flavor' on Instance uuid c801676d-524f-42fc-a2b8-fe4186986d95 {{(pid=124368) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 06 13:46:48.720109 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-86cc6ba0-f1d4-4495-9912-94a134ee2fdc tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] 10.222.0.20 "POST /compute/v2.1/servers/c801676d-524f-42fc-a2b8-fe4186986d95/action" status: 200 len: 32 microversion: 2.1 time: 0.192076 Jul 06 13:46:48.720629 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 155/289] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Jul 6 13:46:48 2022] POST /compute/v2.1/servers/c801676d-524f-42fc-a2b8-fe4186986d95/action => generated 32 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 06 13:46:48.729947 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-07bcf962-742b-4b6b-917c-8c41b4830b91 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:46:48.730552 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-07bcf962-742b-4b6b-917c-8c41b4830b91 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] [instance: c801676d-524f-42fc-a2b8-fe4186986d95] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:46:48.736533 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-07bcf962-742b-4b6b-917c-8c41b4830b91 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:46:48.736981 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-07bcf962-742b-4b6b-917c-8c41b4830b91 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:46:48.737773 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-07bcf962-742b-4b6b-917c-8c41b4830b91 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:46:48.738203 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-07bcf962-742b-4b6b-917c-8c41b4830b91 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:46:48.871556 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-07bcf962-742b-4b6b-917c-8c41b4830b91 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c83c05bec4f456d8aa7d51732ddc8af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b2a80a004e04da7ae12db9f3f87146f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:46:48.879206 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-07bcf962-742b-4b6b-917c-8c41b4830b91 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] 10.222.0.20 "GET /compute/v2.1/servers/c801676d-524f-42fc-a2b8-fe4186986d95" status: 200 len: 1522 microversion: 2.1 time: 0.153082 Jul 06 13:46:48.879765 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 135/290] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:46:48 2022] GET /compute/v2.1/servers/c801676d-524f-42fc-a2b8-fe4186986d95 => generated 1522 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:46:48.929170 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-e782be29-3c7c-4f53-83e6-560f611c3adf tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] Calling method '>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:46:48.929999 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-e782be29-3c7c-4f53-83e6-560f611c3adf tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] [instance: 965c7a0f-fa3f-4f5c-92bf-94d8b646a9ae] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:46:48.931898 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG dbcounter [-] [124368] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=124368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:46:48.939800 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-e782be29-3c7c-4f53-83e6-560f611c3adf tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:46:48.940245 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-e782be29-3c7c-4f53-83e6-560f611c3adf tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:46:48.941026 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-e782be29-3c7c-4f53-83e6-560f611c3adf tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:46:48.941481 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-e782be29-3c7c-4f53-83e6-560f611c3adf tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:46:48.993433 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG dbcounter [-] [124368] Writing DB stats nova_cell0:SELECT=2 {{(pid=124368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:46:49.026591 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG dbcounter [-] [124368] Writing DB stats nova_cell0:SELECT=6 {{(pid=124368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:46:49.062427 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-c56b7654-bf77-40ba-83f9-06a63aaba498 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:46:49.063321 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-c56b7654-bf77-40ba-83f9-06a63aaba498 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] [instance: 546a77fd-66e1-4d89-afa3-58d632b09186] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:46:49.070033 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-c56b7654-bf77-40ba-83f9-06a63aaba498 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:46:49.070487 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-c56b7654-bf77-40ba-83f9-06a63aaba498 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:46:49.071250 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-c56b7654-bf77-40ba-83f9-06a63aaba498 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:46:49.071682 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-c56b7654-bf77-40ba-83f9-06a63aaba498 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:46:49.089576 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-e782be29-3c7c-4f53-83e6-560f611c3adf tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad0781ce20e54c3a9b7c61e0cccf6918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd48e24dbeaa241d7a97350fb2c8187b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:46:49.100612 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-e782be29-3c7c-4f53-83e6-560f611c3adf tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] 10.222.0.20 "GET /compute/v2.1/servers/965c7a0f-fa3f-4f5c-92bf-94d8b646a9ae" status: 200 len: 1502 microversion: 2.1 time: 0.176486 Jul 06 13:46:49.101346 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 156/291] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:46:48 2022] GET /compute/v2.1/servers/965c7a0f-fa3f-4f5c-92bf-94d8b646a9ae => generated 1502 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:46:49.158013 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-9a49b13d-b05f-49d8-9f6e-9e2e7557b4c9 tempest-VolumesActionsTest-262392969 tempest-VolumesActionsTest-262392969-project] Calling method '>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:46:49.158840 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-9a49b13d-b05f-49d8-9f6e-9e2e7557b4c9 tempest-VolumesActionsTest-262392969 tempest-VolumesActionsTest-262392969-project] [instance: 2523f283-429c-4368-afcb-3b90612bda32] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:46:49.178383 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-9a49b13d-b05f-49d8-9f6e-9e2e7557b4c9 tempest-VolumesActionsTest-262392969 tempest-VolumesActionsTest-262392969-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:46:49.178842 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-9a49b13d-b05f-49d8-9f6e-9e2e7557b4c9 tempest-VolumesActionsTest-262392969 tempest-VolumesActionsTest-262392969-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:46:49.179754 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-9a49b13d-b05f-49d8-9f6e-9e2e7557b4c9 tempest-VolumesActionsTest-262392969 tempest-VolumesActionsTest-262392969-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:46:49.180190 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-9a49b13d-b05f-49d8-9f6e-9e2e7557b4c9 tempest-VolumesActionsTest-262392969 tempest-VolumesActionsTest-262392969-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:46:49.203945 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG dbcounter [-] [124367] Writing DB stats nova_cell0:SELECT=6 {{(pid=124367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:46:49.232824 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-c56b7654-bf77-40ba-83f9-06a63aaba498 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d7cacb73c8342579d9f990b0193487c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05df572327d54bd99595974b75898052', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:46:49.242592 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-c56b7654-bf77-40ba-83f9-06a63aaba498 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] 10.222.0.20 "GET /compute/v2.1/servers/546a77fd-66e1-4d89-afa3-58d632b09186" status: 200 len: 1362 microversion: 2.1 time: 0.183860 Jul 06 13:46:49.243485 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 136/292] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:46:49 2022] GET /compute/v2.1/servers/546a77fd-66e1-4d89-afa3-58d632b09186 => generated 1362 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 06 13:46:49.250686 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-9a49b13d-b05f-49d8-9f6e-9e2e7557b4c9 tempest-VolumesActionsTest-262392969 tempest-VolumesActionsTest-262392969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '050d5eb22b2c45ee85eb8c118b9ef21e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f9f86fa910c4054b31927ba26ea96b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:46:49.260721 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-9a49b13d-b05f-49d8-9f6e-9e2e7557b4c9 tempest-VolumesActionsTest-262392969 tempest-VolumesActionsTest-262392969-project] 10.222.0.20 "GET /compute/v2.1/servers/2523f283-429c-4368-afcb-3b90612bda32" status: 200 len: 1265 microversion: 2.1 time: 0.108346 Jul 06 13:46:49.265150 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 157/293] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:46:49 2022] GET /compute/v2.1/servers/2523f283-429c-4368-afcb-3b90612bda32 => generated 1265 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 06 13:46:49.338668 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-51a99e30-59bc-4b04-ba5b-702442352d22 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:46:49.339270 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-51a99e30-59bc-4b04-ba5b-702442352d22 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] [instance: 5cf73c2b-28f6-49f1-a119-224c05679d2c] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:46:49.348729 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-51a99e30-59bc-4b04-ba5b-702442352d22 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:46:49.349387 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-51a99e30-59bc-4b04-ba5b-702442352d22 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:46:49.350824 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-51a99e30-59bc-4b04-ba5b-702442352d22 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:46:49.351158 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-51a99e30-59bc-4b04-ba5b-702442352d22 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:46:49.508119 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-51a99e30-59bc-4b04-ba5b-702442352d22 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b572a8f465048558fc969b85b2aec5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd85f2a57a0847debf5aaf81aab7a638', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:46:49.516254 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-51a99e30-59bc-4b04-ba5b-702442352d22 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] 10.222.0.20 "GET /compute/v2.1/servers/5cf73c2b-28f6-49f1-a119-224c05679d2c" status: 200 len: 1366 microversion: 2.1 time: 0.182650 Jul 06 13:46:49.516822 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 137/294] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:46:49 2022] GET /compute/v2.1/servers/5cf73c2b-28f6-49f1-a119-224c05679d2c => generated 1366 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:46:49.896587 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-11717319-46d4-4c55-8d0c-25254ad7a72b tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Calling method '>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:46:49.897212 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-11717319-46d4-4c55-8d0c-25254ad7a72b tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] [instance: c801676d-524f-42fc-a2b8-fe4186986d95] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:46:49.903433 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-11717319-46d4-4c55-8d0c-25254ad7a72b tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:46:49.903864 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-11717319-46d4-4c55-8d0c-25254ad7a72b tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:46:49.904651 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-11717319-46d4-4c55-8d0c-25254ad7a72b tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:46:49.905099 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-11717319-46d4-4c55-8d0c-25254ad7a72b tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:46:50.036183 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-11717319-46d4-4c55-8d0c-25254ad7a72b tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c83c05bec4f456d8aa7d51732ddc8af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b2a80a004e04da7ae12db9f3f87146f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:46:50.039527 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG dbcounter [-] [124368] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:46:50.044323 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-11717319-46d4-4c55-8d0c-25254ad7a72b tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] 10.222.0.20 "GET /compute/v2.1/servers/c801676d-524f-42fc-a2b8-fe4186986d95" status: 200 len: 1522 microversion: 2.1 time: 0.151574 Jul 06 13:46:50.044889 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 158/295] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:46:49 2022] GET /compute/v2.1/servers/c801676d-524f-42fc-a2b8-fe4186986d95 => generated 1522 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:46:50.260147 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-8418ee45-9636-47ff-b3ae-bec3ff8c284a tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:46:50.260745 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-8418ee45-9636-47ff-b3ae-bec3ff8c284a tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] [instance: 546a77fd-66e1-4d89-afa3-58d632b09186] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:46:50.266702 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-8418ee45-9636-47ff-b3ae-bec3ff8c284a tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:46:50.267142 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-8418ee45-9636-47ff-b3ae-bec3ff8c284a tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:46:50.267890 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-8418ee45-9636-47ff-b3ae-bec3ff8c284a tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:46:50.268317 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-8418ee45-9636-47ff-b3ae-bec3ff8c284a tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:46:50.277647 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-6ba708d0-1979-4bfb-ade9-58d90fc96556 tempest-VolumesActionsTest-262392969 tempest-VolumesActionsTest-262392969-project] Calling method '>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:46:50.278348 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-6ba708d0-1979-4bfb-ade9-58d90fc96556 tempest-VolumesActionsTest-262392969 tempest-VolumesActionsTest-262392969-project] [instance: 2523f283-429c-4368-afcb-3b90612bda32] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:46:50.285189 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-6ba708d0-1979-4bfb-ade9-58d90fc96556 tempest-VolumesActionsTest-262392969 tempest-VolumesActionsTest-262392969-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:46:50.285638 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-6ba708d0-1979-4bfb-ade9-58d90fc96556 tempest-VolumesActionsTest-262392969 tempest-VolumesActionsTest-262392969-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:46:50.286398 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-6ba708d0-1979-4bfb-ade9-58d90fc96556 tempest-VolumesActionsTest-262392969 tempest-VolumesActionsTest-262392969-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:46:50.286845 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-6ba708d0-1979-4bfb-ade9-58d90fc96556 tempest-VolumesActionsTest-262392969 tempest-VolumesActionsTest-262392969-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:46:50.404262 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-8418ee45-9636-47ff-b3ae-bec3ff8c284a tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d7cacb73c8342579d9f990b0193487c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05df572327d54bd99595974b75898052', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:46:50.413354 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-8418ee45-9636-47ff-b3ae-bec3ff8c284a tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] 10.222.0.20 "GET /compute/v2.1/servers/546a77fd-66e1-4d89-afa3-58d632b09186" status: 200 len: 1362 microversion: 2.1 time: 0.156114 Jul 06 13:46:50.413951 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 138/296] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:46:50 2022] GET /compute/v2.1/servers/546a77fd-66e1-4d89-afa3-58d632b09186 => generated 1362 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:46:50.516963 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-6ba708d0-1979-4bfb-ade9-58d90fc96556 tempest-VolumesActionsTest-262392969 tempest-VolumesActionsTest-262392969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '050d5eb22b2c45ee85eb8c118b9ef21e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f9f86fa910c4054b31927ba26ea96b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:46:50.524733 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-6ba708d0-1979-4bfb-ade9-58d90fc96556 tempest-VolumesActionsTest-262392969 tempest-VolumesActionsTest-262392969-project] 10.222.0.20 "GET /compute/v2.1/servers/2523f283-429c-4368-afcb-3b90612bda32" status: 200 len: 1265 microversion: 2.1 time: 0.251167 Jul 06 13:46:50.525346 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 159/297] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:46:50 2022] GET /compute/v2.1/servers/2523f283-429c-4368-afcb-3b90612bda32 => generated 1265 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 06 13:46:50.533877 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-eb03fea5-e6ae-4692-b98e-da203d164959 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:46:50.534478 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-eb03fea5-e6ae-4692-b98e-da203d164959 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] [instance: 5cf73c2b-28f6-49f1-a119-224c05679d2c] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:46:50.540890 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-eb03fea5-e6ae-4692-b98e-da203d164959 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:46:50.541360 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-eb03fea5-e6ae-4692-b98e-da203d164959 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:46:50.542107 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-eb03fea5-e6ae-4692-b98e-da203d164959 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:46:50.542534 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-eb03fea5-e6ae-4692-b98e-da203d164959 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:46:50.669539 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-eb03fea5-e6ae-4692-b98e-da203d164959 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b572a8f465048558fc969b85b2aec5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd85f2a57a0847debf5aaf81aab7a638', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:46:50.678284 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-eb03fea5-e6ae-4692-b98e-da203d164959 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] 10.222.0.20 "GET /compute/v2.1/servers/5cf73c2b-28f6-49f1-a119-224c05679d2c" status: 200 len: 1366 microversion: 2.1 time: 0.147046 Jul 06 13:46:50.678900 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 139/298] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:46:50 2022] GET /compute/v2.1/servers/5cf73c2b-28f6-49f1-a119-224c05679d2c => generated 1366 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:46:51.061613 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-4a25a3f6-2f9f-4be6-a774-ec12d8d47aee tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Calling method '>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:46:51.062222 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-4a25a3f6-2f9f-4be6-a774-ec12d8d47aee tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] [instance: c801676d-524f-42fc-a2b8-fe4186986d95] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:46:51.068958 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-4a25a3f6-2f9f-4be6-a774-ec12d8d47aee tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:46:51.069429 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-4a25a3f6-2f9f-4be6-a774-ec12d8d47aee tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:46:51.070194 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-4a25a3f6-2f9f-4be6-a774-ec12d8d47aee tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:46:51.070630 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-4a25a3f6-2f9f-4be6-a774-ec12d8d47aee tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:46:51.199782 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-4a25a3f6-2f9f-4be6-a774-ec12d8d47aee tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c83c05bec4f456d8aa7d51732ddc8af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b2a80a004e04da7ae12db9f3f87146f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:46:51.207208 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-4a25a3f6-2f9f-4be6-a774-ec12d8d47aee tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] 10.222.0.20 "GET /compute/v2.1/servers/c801676d-524f-42fc-a2b8-fe4186986d95" status: 200 len: 1522 microversion: 2.1 time: 0.149388 Jul 06 13:46:51.207763 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 160/299] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:46:51 2022] GET /compute/v2.1/servers/c801676d-524f-42fc-a2b8-fe4186986d95 => generated 1522 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:46:51.430970 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-62661ef5-4f06-4520-9028-abf0197d39e1 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:46:51.431534 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-62661ef5-4f06-4520-9028-abf0197d39e1 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] [instance: 546a77fd-66e1-4d89-afa3-58d632b09186] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:46:51.437546 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-62661ef5-4f06-4520-9028-abf0197d39e1 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:46:51.437991 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-62661ef5-4f06-4520-9028-abf0197d39e1 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:46:51.438749 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-62661ef5-4f06-4520-9028-abf0197d39e1 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:46:51.439178 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-62661ef5-4f06-4520-9028-abf0197d39e1 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:46:51.541252 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-756163ae-644a-429a-9dc3-963e54faf30d tempest-VolumesActionsTest-262392969 tempest-VolumesActionsTest-262392969-project] Calling method '>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:46:51.541860 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-756163ae-644a-429a-9dc3-963e54faf30d tempest-VolumesActionsTest-262392969 tempest-VolumesActionsTest-262392969-project] [instance: 2523f283-429c-4368-afcb-3b90612bda32] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:46:51.549403 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-756163ae-644a-429a-9dc3-963e54faf30d tempest-VolumesActionsTest-262392969 tempest-VolumesActionsTest-262392969-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:46:51.549875 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-756163ae-644a-429a-9dc3-963e54faf30d tempest-VolumesActionsTest-262392969 tempest-VolumesActionsTest-262392969-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:46:51.550644 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-756163ae-644a-429a-9dc3-963e54faf30d tempest-VolumesActionsTest-262392969 tempest-VolumesActionsTest-262392969-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:46:51.551336 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-756163ae-644a-429a-9dc3-963e54faf30d tempest-VolumesActionsTest-262392969 tempest-VolumesActionsTest-262392969-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:46:51.571949 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-62661ef5-4f06-4520-9028-abf0197d39e1 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d7cacb73c8342579d9f990b0193487c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05df572327d54bd99595974b75898052', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:46:51.579319 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-62661ef5-4f06-4520-9028-abf0197d39e1 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] 10.222.0.20 "GET /compute/v2.1/servers/546a77fd-66e1-4d89-afa3-58d632b09186" status: 200 len: 1362 microversion: 2.1 time: 0.153095 Jul 06 13:46:51.579891 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 140/300] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:46:51 2022] GET /compute/v2.1/servers/546a77fd-66e1-4d89-afa3-58d632b09186 => generated 1362 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:46:51.613922 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-756163ae-644a-429a-9dc3-963e54faf30d tempest-VolumesActionsTest-262392969 tempest-VolumesActionsTest-262392969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '050d5eb22b2c45ee85eb8c118b9ef21e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f9f86fa910c4054b31927ba26ea96b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:46:51.623557 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-756163ae-644a-429a-9dc3-963e54faf30d tempest-VolumesActionsTest-262392969 tempest-VolumesActionsTest-262392969-project] 10.222.0.20 "GET /compute/v2.1/servers/2523f283-429c-4368-afcb-3b90612bda32" status: 200 len: 1265 microversion: 2.1 time: 0.086152 Jul 06 13:46:51.624117 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 161/301] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:46:51 2022] GET /compute/v2.1/servers/2523f283-429c-4368-afcb-3b90612bda32 => generated 1265 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 06 13:46:51.696136 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-f4623853-085e-40b6-9525-f4cd9c9da6b1 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:46:51.696817 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-f4623853-085e-40b6-9525-f4cd9c9da6b1 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] [instance: 5cf73c2b-28f6-49f1-a119-224c05679d2c] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:46:51.702775 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-f4623853-085e-40b6-9525-f4cd9c9da6b1 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:46:51.703222 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-f4623853-085e-40b6-9525-f4cd9c9da6b1 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:46:51.703980 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-f4623853-085e-40b6-9525-f4cd9c9da6b1 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:46:51.704409 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-f4623853-085e-40b6-9525-f4cd9c9da6b1 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:46:51.831100 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-f4623853-085e-40b6-9525-f4cd9c9da6b1 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b572a8f465048558fc969b85b2aec5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd85f2a57a0847debf5aaf81aab7a638', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:46:51.839214 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-f4623853-085e-40b6-9525-f4cd9c9da6b1 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] 10.222.0.20 "GET /compute/v2.1/servers/5cf73c2b-28f6-49f1-a119-224c05679d2c" status: 200 len: 1366 microversion: 2.1 time: 0.148496 Jul 06 13:46:51.839778 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 141/302] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:46:51 2022] GET /compute/v2.1/servers/5cf73c2b-28f6-49f1-a119-224c05679d2c => generated 1366 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:46:52.223787 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-c8aaf9b3-7e61-4185-91ff-68eb865bb5b6 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Calling method '>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:46:52.224397 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-c8aaf9b3-7e61-4185-91ff-68eb865bb5b6 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] [instance: c801676d-524f-42fc-a2b8-fe4186986d95] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:46:52.230416 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-c8aaf9b3-7e61-4185-91ff-68eb865bb5b6 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:46:52.230872 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-c8aaf9b3-7e61-4185-91ff-68eb865bb5b6 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:46:52.231667 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-c8aaf9b3-7e61-4185-91ff-68eb865bb5b6 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:46:52.232105 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-c8aaf9b3-7e61-4185-91ff-68eb865bb5b6 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:46:52.363293 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-c8aaf9b3-7e61-4185-91ff-68eb865bb5b6 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c83c05bec4f456d8aa7d51732ddc8af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b2a80a004e04da7ae12db9f3f87146f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:46:52.371270 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-c8aaf9b3-7e61-4185-91ff-68eb865bb5b6 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] 10.222.0.20 "GET /compute/v2.1/servers/c801676d-524f-42fc-a2b8-fe4186986d95" status: 200 len: 1522 microversion: 2.1 time: 0.151319 Jul 06 13:46:52.372333 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 162/303] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:46:52 2022] GET /compute/v2.1/servers/c801676d-524f-42fc-a2b8-fe4186986d95 => generated 1522 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:46:52.596466 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-a3d7f514-1ceb-4f93-a560-afbc6519a712 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:46:52.597100 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-a3d7f514-1ceb-4f93-a560-afbc6519a712 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] [instance: 546a77fd-66e1-4d89-afa3-58d632b09186] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:46:52.603647 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-a3d7f514-1ceb-4f93-a560-afbc6519a712 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:46:52.604038 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-a3d7f514-1ceb-4f93-a560-afbc6519a712 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:46:52.604792 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-a3d7f514-1ceb-4f93-a560-afbc6519a712 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:46:52.605261 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-a3d7f514-1ceb-4f93-a560-afbc6519a712 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:46:52.640568 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-35890889-841b-4488-885a-a4eee6798b41 tempest-VolumesActionsTest-262392969 tempest-VolumesActionsTest-262392969-project] Calling method '>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:46:52.641311 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-35890889-841b-4488-885a-a4eee6798b41 tempest-VolumesActionsTest-262392969 tempest-VolumesActionsTest-262392969-project] [instance: 2523f283-429c-4368-afcb-3b90612bda32] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:46:52.647943 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-35890889-841b-4488-885a-a4eee6798b41 tempest-VolumesActionsTest-262392969 tempest-VolumesActionsTest-262392969-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:46:52.648382 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-35890889-841b-4488-885a-a4eee6798b41 tempest-VolumesActionsTest-262392969 tempest-VolumesActionsTest-262392969-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:46:52.649181 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-35890889-841b-4488-885a-a4eee6798b41 tempest-VolumesActionsTest-262392969 tempest-VolumesActionsTest-262392969-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:46:52.649616 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-35890889-841b-4488-885a-a4eee6798b41 tempest-VolumesActionsTest-262392969 tempest-VolumesActionsTest-262392969-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:46:52.712546 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-35890889-841b-4488-885a-a4eee6798b41 tempest-VolumesActionsTest-262392969 tempest-VolumesActionsTest-262392969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '050d5eb22b2c45ee85eb8c118b9ef21e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f9f86fa910c4054b31927ba26ea96b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:46:52.719829 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-35890889-841b-4488-885a-a4eee6798b41 tempest-VolumesActionsTest-262392969 tempest-VolumesActionsTest-262392969-project] 10.222.0.20 "GET /compute/v2.1/servers/2523f283-429c-4368-afcb-3b90612bda32" status: 200 len: 1265 microversion: 2.1 time: 0.083001 Jul 06 13:46:52.720389 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 163/304] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:46:52 2022] GET /compute/v2.1/servers/2523f283-429c-4368-afcb-3b90612bda32 => generated 1265 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 06 13:46:52.734509 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-a3d7f514-1ceb-4f93-a560-afbc6519a712 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d7cacb73c8342579d9f990b0193487c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05df572327d54bd99595974b75898052', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:46:52.742330 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-a3d7f514-1ceb-4f93-a560-afbc6519a712 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] 10.222.0.20 "GET /compute/v2.1/servers/546a77fd-66e1-4d89-afa3-58d632b09186" status: 200 len: 1362 microversion: 2.1 time: 0.149641 Jul 06 13:46:52.742890 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 142/305] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:46:52 2022] GET /compute/v2.1/servers/546a77fd-66e1-4d89-afa3-58d632b09186 => generated 1362 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:46:52.857039 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-ba6cafa0-0888-4bff-ae6d-5f774ddd8129 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Calling method '>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:46:52.857628 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-ba6cafa0-0888-4bff-ae6d-5f774ddd8129 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] [instance: 5cf73c2b-28f6-49f1-a119-224c05679d2c] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:46:52.863684 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-ba6cafa0-0888-4bff-ae6d-5f774ddd8129 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:46:52.864133 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-ba6cafa0-0888-4bff-ae6d-5f774ddd8129 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:46:52.865453 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-ba6cafa0-0888-4bff-ae6d-5f774ddd8129 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:46:52.865892 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-ba6cafa0-0888-4bff-ae6d-5f774ddd8129 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:46:52.996455 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-ba6cafa0-0888-4bff-ae6d-5f774ddd8129 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b572a8f465048558fc969b85b2aec5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd85f2a57a0847debf5aaf81aab7a638', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:46:53.003884 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-ba6cafa0-0888-4bff-ae6d-5f774ddd8129 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] 10.222.0.20 "GET /compute/v2.1/servers/5cf73c2b-28f6-49f1-a119-224c05679d2c" status: 200 len: 1366 microversion: 2.1 time: 0.150650 Jul 06 13:46:53.004790 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 164/306] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:46:52 2022] GET /compute/v2.1/servers/5cf73c2b-28f6-49f1-a119-224c05679d2c => generated 1366 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:46:53.388856 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-83b78860-2dfd-4ab6-8c67-297342d34e22 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:46:53.389452 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-83b78860-2dfd-4ab6-8c67-297342d34e22 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] [instance: c801676d-524f-42fc-a2b8-fe4186986d95] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:46:53.396383 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-83b78860-2dfd-4ab6-8c67-297342d34e22 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:46:53.396767 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-83b78860-2dfd-4ab6-8c67-297342d34e22 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:46:53.397555 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-83b78860-2dfd-4ab6-8c67-297342d34e22 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:46:53.397986 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-83b78860-2dfd-4ab6-8c67-297342d34e22 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:46:53.531248 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-83b78860-2dfd-4ab6-8c67-297342d34e22 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c83c05bec4f456d8aa7d51732ddc8af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b2a80a004e04da7ae12db9f3f87146f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:46:53.539575 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-83b78860-2dfd-4ab6-8c67-297342d34e22 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] 10.222.0.20 "GET /compute/v2.1/servers/c801676d-524f-42fc-a2b8-fe4186986d95" status: 200 len: 1522 microversion: 2.1 time: 0.154521 Jul 06 13:46:53.540139 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 143/307] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:46:53 2022] GET /compute/v2.1/servers/c801676d-524f-42fc-a2b8-fe4186986d95 => generated 1522 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:46:53.737313 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-fb33add9-e593-4307-88dd-19ffe7c0b1f2 tempest-VolumesActionsTest-262392969 tempest-VolumesActionsTest-262392969-project] Calling method '>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:46:53.737946 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-fb33add9-e593-4307-88dd-19ffe7c0b1f2 tempest-VolumesActionsTest-262392969 tempest-VolumesActionsTest-262392969-project] [instance: 2523f283-429c-4368-afcb-3b90612bda32] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:46:53.744339 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-fb33add9-e593-4307-88dd-19ffe7c0b1f2 tempest-VolumesActionsTest-262392969 tempest-VolumesActionsTest-262392969-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:46:53.744786 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-fb33add9-e593-4307-88dd-19ffe7c0b1f2 tempest-VolumesActionsTest-262392969 tempest-VolumesActionsTest-262392969-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:46:53.745580 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-fb33add9-e593-4307-88dd-19ffe7c0b1f2 tempest-VolumesActionsTest-262392969 tempest-VolumesActionsTest-262392969-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:46:53.746010 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-fb33add9-e593-4307-88dd-19ffe7c0b1f2 tempest-VolumesActionsTest-262392969 tempest-VolumesActionsTest-262392969-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:46:53.768727 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-5e89673f-91aa-4c56-890c-62e5a504e405 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:46:53.771432 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-5e89673f-91aa-4c56-890c-62e5a504e405 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] [instance: 546a77fd-66e1-4d89-afa3-58d632b09186] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:46:53.783066 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-5e89673f-91aa-4c56-890c-62e5a504e405 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:46:53.784064 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-5e89673f-91aa-4c56-890c-62e5a504e405 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:46:53.785641 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-5e89673f-91aa-4c56-890c-62e5a504e405 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:46:53.786651 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-5e89673f-91aa-4c56-890c-62e5a504e405 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:46:53.812632 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-fb33add9-e593-4307-88dd-19ffe7c0b1f2 tempest-VolumesActionsTest-262392969 tempest-VolumesActionsTest-262392969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '050d5eb22b2c45ee85eb8c118b9ef21e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f9f86fa910c4054b31927ba26ea96b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:46:53.821400 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-fb33add9-e593-4307-88dd-19ffe7c0b1f2 tempest-VolumesActionsTest-262392969 tempest-VolumesActionsTest-262392969-project] 10.222.0.20 "GET /compute/v2.1/servers/2523f283-429c-4368-afcb-3b90612bda32" status: 200 len: 1273 microversion: 2.1 time: 0.087879 Jul 06 13:46:53.822046 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 165/308] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:46:53 2022] GET /compute/v2.1/servers/2523f283-429c-4368-afcb-3b90612bda32 => generated 1273 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:46:53.931789 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-5e89673f-91aa-4c56-890c-62e5a504e405 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d7cacb73c8342579d9f990b0193487c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05df572327d54bd99595974b75898052', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:46:53.939275 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-5e89673f-91aa-4c56-890c-62e5a504e405 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] 10.222.0.20 "GET /compute/v2.1/servers/546a77fd-66e1-4d89-afa3-58d632b09186" status: 200 len: 1362 microversion: 2.1 time: 0.183904 Jul 06 13:46:53.939771 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 144/309] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:46:53 2022] GET /compute/v2.1/servers/546a77fd-66e1-4d89-afa3-58d632b09186 => generated 1362 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 06 13:46:54.021713 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-01537225-b21b-4c06-80ad-f09f3585cca8 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Calling method '>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:46:54.022516 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-01537225-b21b-4c06-80ad-f09f3585cca8 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] [instance: 5cf73c2b-28f6-49f1-a119-224c05679d2c] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:46:54.028423 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-01537225-b21b-4c06-80ad-f09f3585cca8 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:46:54.028865 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-01537225-b21b-4c06-80ad-f09f3585cca8 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:46:54.029649 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-01537225-b21b-4c06-80ad-f09f3585cca8 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:46:54.030080 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-01537225-b21b-4c06-80ad-f09f3585cca8 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:46:54.167667 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-01537225-b21b-4c06-80ad-f09f3585cca8 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b572a8f465048558fc969b85b2aec5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd85f2a57a0847debf5aaf81aab7a638', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:46:54.175032 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-01537225-b21b-4c06-80ad-f09f3585cca8 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] 10.222.0.20 "GET /compute/v2.1/servers/5cf73c2b-28f6-49f1-a119-224c05679d2c" status: 200 len: 1366 microversion: 2.1 time: 0.157969 Jul 06 13:46:54.175596 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 166/310] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:46:54 2022] GET /compute/v2.1/servers/5cf73c2b-28f6-49f1-a119-224c05679d2c => generated 1366 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:46:54.556387 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-82850b92-8c51-4a2d-83ff-fd0b0b6f3e70 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:46:54.557115 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-82850b92-8c51-4a2d-83ff-fd0b0b6f3e70 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] [instance: c801676d-524f-42fc-a2b8-fe4186986d95] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:46:54.562862 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-82850b92-8c51-4a2d-83ff-fd0b0b6f3e70 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:46:54.563400 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-82850b92-8c51-4a2d-83ff-fd0b0b6f3e70 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:46:54.564244 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-82850b92-8c51-4a2d-83ff-fd0b0b6f3e70 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:46:54.564687 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-82850b92-8c51-4a2d-83ff-fd0b0b6f3e70 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:46:54.689441 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-22cf27f4-909b-47e5-b178-31d8c1f6ccfe tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f7563f59-2757-4459-9af4-fc6e8027da89"}} {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 06 13:46:54.690784 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-22cf27f4-909b-47e5-b178-31d8c1f6ccfe tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] [instance: 965c7a0f-fa3f-4f5c-92bf-94d8b646a9ae] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:46:54.697258 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-22cf27f4-909b-47e5-b178-31d8c1f6ccfe tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:46:54.697713 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-22cf27f4-909b-47e5-b178-31d8c1f6ccfe tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:46:54.698530 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-22cf27f4-909b-47e5-b178-31d8c1f6ccfe tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:46:54.699814 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-22cf27f4-909b-47e5-b178-31d8c1f6ccfe tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:46:54.701817 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-82850b92-8c51-4a2d-83ff-fd0b0b6f3e70 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c83c05bec4f456d8aa7d51732ddc8af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b2a80a004e04da7ae12db9f3f87146f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:46:54.709868 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-82850b92-8c51-4a2d-83ff-fd0b0b6f3e70 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] 10.222.0.20 "GET /compute/v2.1/servers/c801676d-524f-42fc-a2b8-fe4186986d95" status: 200 len: 1522 microversion: 2.1 time: 0.157466 Jul 06 13:46:54.710576 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 145/311] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:46:54 2022] GET /compute/v2.1/servers/c801676d-524f-42fc-a2b8-fe4186986d95 => generated 1522 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:46:54.839388 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-6a2a2e26-cc50-46b5-9a35-92dfde840306 tempest-VolumesActionsTest-262392969 tempest-VolumesActionsTest-262392969-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:46:54.839987 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-6a2a2e26-cc50-46b5-9a35-92dfde840306 tempest-VolumesActionsTest-262392969 tempest-VolumesActionsTest-262392969-project] [instance: 2523f283-429c-4368-afcb-3b90612bda32] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:46:54.846780 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-6a2a2e26-cc50-46b5-9a35-92dfde840306 tempest-VolumesActionsTest-262392969 tempest-VolumesActionsTest-262392969-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:46:54.847219 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-6a2a2e26-cc50-46b5-9a35-92dfde840306 tempest-VolumesActionsTest-262392969 tempest-VolumesActionsTest-262392969-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:46:54.848153 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-6a2a2e26-cc50-46b5-9a35-92dfde840306 tempest-VolumesActionsTest-262392969 tempest-VolumesActionsTest-262392969-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:46:54.848576 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-6a2a2e26-cc50-46b5-9a35-92dfde840306 tempest-VolumesActionsTest-262392969 tempest-VolumesActionsTest-262392969-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:46:54.937303 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-6a2a2e26-cc50-46b5-9a35-92dfde840306 tempest-VolumesActionsTest-262392969 tempest-VolumesActionsTest-262392969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '050d5eb22b2c45ee85eb8c118b9ef21e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f9f86fa910c4054b31927ba26ea96b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:46:54.939463 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG dbcounter [-] [124367] Writing DB stats nova_cell1:SELECT=100 {{(pid=124367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:46:54.946906 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-6a2a2e26-cc50-46b5-9a35-92dfde840306 tempest-VolumesActionsTest-262392969 tempest-VolumesActionsTest-262392969-project] 10.222.0.20 "GET /compute/v2.1/servers/2523f283-429c-4368-afcb-3b90612bda32" status: 200 len: 1283 microversion: 2.1 time: 0.111277 Jul 06 13:46:54.947574 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 146/312] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:46:54 2022] GET /compute/v2.1/servers/2523f283-429c-4368-afcb-3b90612bda32 => generated 1283 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 06 13:46:54.964046 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-bd0f8afc-b20c-416e-9285-bebb206aabe8 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:46:54.964639 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-bd0f8afc-b20c-416e-9285-bebb206aabe8 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] [instance: 546a77fd-66e1-4d89-afa3-58d632b09186] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:46:54.970650 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-bd0f8afc-b20c-416e-9285-bebb206aabe8 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:46:54.971117 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-bd0f8afc-b20c-416e-9285-bebb206aabe8 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:46:54.971891 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-bd0f8afc-b20c-416e-9285-bebb206aabe8 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:46:54.972316 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-bd0f8afc-b20c-416e-9285-bebb206aabe8 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:46:55.103156 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-bd0f8afc-b20c-416e-9285-bebb206aabe8 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d7cacb73c8342579d9f990b0193487c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05df572327d54bd99595974b75898052', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:46:55.110486 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-bd0f8afc-b20c-416e-9285-bebb206aabe8 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] 10.222.0.20 "GET /compute/v2.1/servers/546a77fd-66e1-4d89-afa3-58d632b09186" status: 200 len: 1362 microversion: 2.1 time: 0.150780 Jul 06 13:46:55.111069 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 147/313] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:46:54 2022] GET /compute/v2.1/servers/546a77fd-66e1-4d89-afa3-58d632b09186 => generated 1362 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:46:55.192179 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-4fc0013d-ec23-4173-ada7-aa1150798ebf tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:46:55.193357 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-4fc0013d-ec23-4173-ada7-aa1150798ebf tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] [instance: 5cf73c2b-28f6-49f1-a119-224c05679d2c] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:46:55.199268 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-4fc0013d-ec23-4173-ada7-aa1150798ebf tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:46:55.199710 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-4fc0013d-ec23-4173-ada7-aa1150798ebf tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:46:55.200459 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-4fc0013d-ec23-4173-ada7-aa1150798ebf tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:46:55.200886 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-4fc0013d-ec23-4173-ada7-aa1150798ebf tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:46:55.343569 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-4fc0013d-ec23-4173-ada7-aa1150798ebf tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b572a8f465048558fc969b85b2aec5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd85f2a57a0847debf5aaf81aab7a638', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:46:55.351225 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-4fc0013d-ec23-4173-ada7-aa1150798ebf tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] 10.222.0.20 "GET /compute/v2.1/servers/5cf73c2b-28f6-49f1-a119-224c05679d2c" status: 200 len: 1366 microversion: 2.1 time: 0.162957 Jul 06 13:46:55.351772 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 148/314] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:46:55 2022] GET /compute/v2.1/servers/5cf73c2b-28f6-49f1-a119-224c05679d2c => generated 1366 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 06 13:46:55.726745 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-427136f6-5dbe-4d01-8f5b-fc1d243cd7a6 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:46:55.727354 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-427136f6-5dbe-4d01-8f5b-fc1d243cd7a6 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] [instance: c801676d-524f-42fc-a2b8-fe4186986d95] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:46:55.733896 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-427136f6-5dbe-4d01-8f5b-fc1d243cd7a6 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:46:55.734568 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-427136f6-5dbe-4d01-8f5b-fc1d243cd7a6 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:46:55.735494 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-427136f6-5dbe-4d01-8f5b-fc1d243cd7a6 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:46:55.736076 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-427136f6-5dbe-4d01-8f5b-fc1d243cd7a6 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:46:55.897931 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-427136f6-5dbe-4d01-8f5b-fc1d243cd7a6 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c83c05bec4f456d8aa7d51732ddc8af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b2a80a004e04da7ae12db9f3f87146f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:46:55.905524 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-427136f6-5dbe-4d01-8f5b-fc1d243cd7a6 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] 10.222.0.20 "GET /compute/v2.1/servers/c801676d-524f-42fc-a2b8-fe4186986d95" status: 200 len: 1522 microversion: 2.1 time: 0.183255 Jul 06 13:46:55.906348 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 149/315] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:46:55 2022] GET /compute/v2.1/servers/c801676d-524f-42fc-a2b8-fe4186986d95 => generated 1522 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 06 13:46:55.964168 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-931c3e0c-b2c8-40d9-aacc-b87065892464 tempest-VolumesActionsTest-262392969 tempest-VolumesActionsTest-262392969-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:46:55.964783 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-931c3e0c-b2c8-40d9-aacc-b87065892464 tempest-VolumesActionsTest-262392969 tempest-VolumesActionsTest-262392969-project] [instance: 2523f283-429c-4368-afcb-3b90612bda32] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:46:55.970903 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-931c3e0c-b2c8-40d9-aacc-b87065892464 tempest-VolumesActionsTest-262392969 tempest-VolumesActionsTest-262392969-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:46:55.971355 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-931c3e0c-b2c8-40d9-aacc-b87065892464 tempest-VolumesActionsTest-262392969 tempest-VolumesActionsTest-262392969-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:46:55.972154 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-931c3e0c-b2c8-40d9-aacc-b87065892464 tempest-VolumesActionsTest-262392969 tempest-VolumesActionsTest-262392969-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:46:55.972659 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-931c3e0c-b2c8-40d9-aacc-b87065892464 tempest-VolumesActionsTest-262392969 tempest-VolumesActionsTest-262392969-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:46:56.043155 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-931c3e0c-b2c8-40d9-aacc-b87065892464 tempest-VolumesActionsTest-262392969 tempest-VolumesActionsTest-262392969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '050d5eb22b2c45ee85eb8c118b9ef21e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f9f86fa910c4054b31927ba26ea96b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:46:56.051589 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-931c3e0c-b2c8-40d9-aacc-b87065892464 tempest-VolumesActionsTest-262392969 tempest-VolumesActionsTest-262392969-project] 10.222.0.20 "GET /compute/v2.1/servers/2523f283-429c-4368-afcb-3b90612bda32" status: 200 len: 1283 microversion: 2.1 time: 0.091526 Jul 06 13:46:56.052184 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 150/316] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:46:55 2022] GET /compute/v2.1/servers/2523f283-429c-4368-afcb-3b90612bda32 => generated 1283 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 06 13:46:56.127110 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-c36b3162-ad9b-405d-80a7-f95026b2a24d tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:46:56.127787 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-c36b3162-ad9b-405d-80a7-f95026b2a24d tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] [instance: 546a77fd-66e1-4d89-afa3-58d632b09186] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:46:56.133877 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-c36b3162-ad9b-405d-80a7-f95026b2a24d tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:46:56.134329 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-c36b3162-ad9b-405d-80a7-f95026b2a24d tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:46:56.135096 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-c36b3162-ad9b-405d-80a7-f95026b2a24d tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:46:56.135535 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-c36b3162-ad9b-405d-80a7-f95026b2a24d tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:46:56.278224 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-c36b3162-ad9b-405d-80a7-f95026b2a24d tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d7cacb73c8342579d9f990b0193487c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05df572327d54bd99595974b75898052', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:46:56.292118 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-c36b3162-ad9b-405d-80a7-f95026b2a24d tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] 10.222.0.20 "GET /compute/v2.1/servers/546a77fd-66e1-4d89-afa3-58d632b09186" status: 200 len: 1362 microversion: 2.1 time: 0.168443 Jul 06 13:46:56.293347 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 151/317] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:46:56 2022] GET /compute/v2.1/servers/546a77fd-66e1-4d89-afa3-58d632b09186 => generated 1362 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 06 13:46:56.370225 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-1396e2b1-186e-4f79-a4b6-e9c38b37e022 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:46:56.371194 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-1396e2b1-186e-4f79-a4b6-e9c38b37e022 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] [instance: 5cf73c2b-28f6-49f1-a119-224c05679d2c] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:46:56.378069 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-1396e2b1-186e-4f79-a4b6-e9c38b37e022 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:46:56.378594 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-1396e2b1-186e-4f79-a4b6-e9c38b37e022 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:46:56.379427 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-1396e2b1-186e-4f79-a4b6-e9c38b37e022 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:46:56.380472 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-1396e2b1-186e-4f79-a4b6-e9c38b37e022 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:46:56.591102 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-1396e2b1-186e-4f79-a4b6-e9c38b37e022 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b572a8f465048558fc969b85b2aec5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd85f2a57a0847debf5aaf81aab7a638', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:46:56.598512 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-1396e2b1-186e-4f79-a4b6-e9c38b37e022 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] 10.222.0.20 "GET /compute/v2.1/servers/5cf73c2b-28f6-49f1-a119-224c05679d2c" status: 200 len: 1366 microversion: 2.1 time: 0.233380 Jul 06 13:46:56.599336 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 152/318] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:46:56 2022] GET /compute/v2.1/servers/5cf73c2b-28f6-49f1-a119-224c05679d2c => generated 1366 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:46:56.923543 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-0b810eb4-8564-4325-a29c-4a2080e6b96e tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:46:56.924222 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-0b810eb4-8564-4325-a29c-4a2080e6b96e tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] [instance: c801676d-524f-42fc-a2b8-fe4186986d95] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:46:56.933786 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-0b810eb4-8564-4325-a29c-4a2080e6b96e tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:46:56.934242 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-0b810eb4-8564-4325-a29c-4a2080e6b96e tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:46:56.935018 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-0b810eb4-8564-4325-a29c-4a2080e6b96e tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:46:56.935451 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-0b810eb4-8564-4325-a29c-4a2080e6b96e tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:46:57.188852 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-0b810eb4-8564-4325-a29c-4a2080e6b96e tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c83c05bec4f456d8aa7d51732ddc8af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b2a80a004e04da7ae12db9f3f87146f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:46:57.198468 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-0b810eb4-8564-4325-a29c-4a2080e6b96e tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] 10.222.0.20 "GET /compute/v2.1/servers/c801676d-524f-42fc-a2b8-fe4186986d95" status: 200 len: 1522 microversion: 2.1 time: 0.278569 Jul 06 13:46:57.199112 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 153/319] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:46:56 2022] GET /compute/v2.1/servers/c801676d-524f-42fc-a2b8-fe4186986d95 => generated 1522 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 06 13:46:57.211989 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-1181d0eb-1a1c-4fc0-89e5-6be95f735db1 tempest-VolumesActionsTest-262392969 tempest-VolumesActionsTest-262392969-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:46:57.212629 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-1181d0eb-1a1c-4fc0-89e5-6be95f735db1 tempest-VolumesActionsTest-262392969 tempest-VolumesActionsTest-262392969-project] [instance: 2523f283-429c-4368-afcb-3b90612bda32] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:46:57.225278 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-1181d0eb-1a1c-4fc0-89e5-6be95f735db1 tempest-VolumesActionsTest-262392969 tempest-VolumesActionsTest-262392969-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:46:57.226999 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-1181d0eb-1a1c-4fc0-89e5-6be95f735db1 tempest-VolumesActionsTest-262392969 tempest-VolumesActionsTest-262392969-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:46:57.228173 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-1181d0eb-1a1c-4fc0-89e5-6be95f735db1 tempest-VolumesActionsTest-262392969 tempest-VolumesActionsTest-262392969-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:46:57.229078 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-1181d0eb-1a1c-4fc0-89e5-6be95f735db1 tempest-VolumesActionsTest-262392969 tempest-VolumesActionsTest-262392969-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:46:57.325552 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-1181d0eb-1a1c-4fc0-89e5-6be95f735db1 tempest-VolumesActionsTest-262392969 tempest-VolumesActionsTest-262392969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '050d5eb22b2c45ee85eb8c118b9ef21e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f9f86fa910c4054b31927ba26ea96b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:46:57.332852 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-1181d0eb-1a1c-4fc0-89e5-6be95f735db1 tempest-VolumesActionsTest-262392969 tempest-VolumesActionsTest-262392969-project] 10.222.0.20 "GET /compute/v2.1/servers/2523f283-429c-4368-afcb-3b90612bda32" status: 200 len: 1271 microversion: 2.1 time: 0.132649 Jul 06 13:46:57.333547 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 154/320] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:46:57 2022] GET /compute/v2.1/servers/2523f283-429c-4368-afcb-3b90612bda32 => generated 1271 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:46:57.346514 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-098fee05-3e06-4987-9a15-ae5b15943bee tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:46:57.347256 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-098fee05-3e06-4987-9a15-ae5b15943bee tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] [instance: 546a77fd-66e1-4d89-afa3-58d632b09186] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:46:57.357264 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-098fee05-3e06-4987-9a15-ae5b15943bee tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:46:57.357828 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-098fee05-3e06-4987-9a15-ae5b15943bee tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:46:57.358638 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-098fee05-3e06-4987-9a15-ae5b15943bee tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:46:57.359105 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-098fee05-3e06-4987-9a15-ae5b15943bee tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:46:57.574674 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-098fee05-3e06-4987-9a15-ae5b15943bee tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d7cacb73c8342579d9f990b0193487c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05df572327d54bd99595974b75898052', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:46:57.587519 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-098fee05-3e06-4987-9a15-ae5b15943bee tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] 10.222.0.20 "GET /compute/v2.1/servers/546a77fd-66e1-4d89-afa3-58d632b09186" status: 200 len: 1362 microversion: 2.1 time: 0.246686 Jul 06 13:46:57.587519 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 155/321] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:46:57 2022] GET /compute/v2.1/servers/546a77fd-66e1-4d89-afa3-58d632b09186 => generated 1362 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:46:57.615958 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-0fdff63a-72aa-4010-8a63-ad33212d69a1 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:46:57.616895 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-0fdff63a-72aa-4010-8a63-ad33212d69a1 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] [instance: 5cf73c2b-28f6-49f1-a119-224c05679d2c] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:46:57.624211 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-0fdff63a-72aa-4010-8a63-ad33212d69a1 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:46:57.624786 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-0fdff63a-72aa-4010-8a63-ad33212d69a1 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:46:57.625767 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-0fdff63a-72aa-4010-8a63-ad33212d69a1 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:46:57.626280 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-0fdff63a-72aa-4010-8a63-ad33212d69a1 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:46:57.780775 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-0fdff63a-72aa-4010-8a63-ad33212d69a1 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b572a8f465048558fc969b85b2aec5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd85f2a57a0847debf5aaf81aab7a638', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:46:57.789131 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-0fdff63a-72aa-4010-8a63-ad33212d69a1 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] 10.222.0.20 "GET /compute/v2.1/servers/5cf73c2b-28f6-49f1-a119-224c05679d2c" status: 200 len: 1366 microversion: 2.1 time: 0.177333 Jul 06 13:46:57.789841 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 156/322] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:46:57 2022] GET /compute/v2.1/servers/5cf73c2b-28f6-49f1-a119-224c05679d2c => generated 1366 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 06 13:46:58.221021 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-98c6604d-eb87-4f61-a25a-69da5bc01f48 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:46:58.221766 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-98c6604d-eb87-4f61-a25a-69da5bc01f48 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] [instance: c801676d-524f-42fc-a2b8-fe4186986d95] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:46:58.228382 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-98c6604d-eb87-4f61-a25a-69da5bc01f48 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:46:58.228903 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-98c6604d-eb87-4f61-a25a-69da5bc01f48 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:46:58.229773 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-98c6604d-eb87-4f61-a25a-69da5bc01f48 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:46:58.230382 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-98c6604d-eb87-4f61-a25a-69da5bc01f48 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:46:58.391221 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-98c6604d-eb87-4f61-a25a-69da5bc01f48 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c83c05bec4f456d8aa7d51732ddc8af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b2a80a004e04da7ae12db9f3f87146f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:46:58.399865 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-98c6604d-eb87-4f61-a25a-69da5bc01f48 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] 10.222.0.20 "GET /compute/v2.1/servers/c801676d-524f-42fc-a2b8-fe4186986d95" status: 200 len: 1522 microversion: 2.1 time: 0.187873 Jul 06 13:46:58.400967 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 157/323] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:46:58 2022] GET /compute/v2.1/servers/c801676d-524f-42fc-a2b8-fe4186986d95 => generated 1522 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 06 13:46:58.418688 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-91612670-832a-4ff5-bb66-34c99c978ba6 tempest-VolumesActionsTest-262392969 tempest-VolumesActionsTest-262392969-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:46:58.419873 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-91612670-832a-4ff5-bb66-34c99c978ba6 tempest-VolumesActionsTest-262392969 tempest-VolumesActionsTest-262392969-project] [instance: 2523f283-429c-4368-afcb-3b90612bda32] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:46:58.427568 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-91612670-832a-4ff5-bb66-34c99c978ba6 tempest-VolumesActionsTest-262392969 tempest-VolumesActionsTest-262392969-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:46:58.428270 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-91612670-832a-4ff5-bb66-34c99c978ba6 tempest-VolumesActionsTest-262392969 tempest-VolumesActionsTest-262392969-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:46:58.429307 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-91612670-832a-4ff5-bb66-34c99c978ba6 tempest-VolumesActionsTest-262392969 tempest-VolumesActionsTest-262392969-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:46:58.429929 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-91612670-832a-4ff5-bb66-34c99c978ba6 tempest-VolumesActionsTest-262392969 tempest-VolumesActionsTest-262392969-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:46:58.592027 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-91612670-832a-4ff5-bb66-34c99c978ba6 tempest-VolumesActionsTest-262392969 tempest-VolumesActionsTest-262392969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '050d5eb22b2c45ee85eb8c118b9ef21e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f9f86fa910c4054b31927ba26ea96b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:46:58.601840 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-91612670-832a-4ff5-bb66-34c99c978ba6 tempest-VolumesActionsTest-262392969 tempest-VolumesActionsTest-262392969-project] 10.222.0.20 "GET /compute/v2.1/servers/2523f283-429c-4368-afcb-3b90612bda32" status: 200 len: 1313 microversion: 2.1 time: 0.186909 Jul 06 13:46:58.602621 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 158/324] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:46:58 2022] GET /compute/v2.1/servers/2523f283-429c-4368-afcb-3b90612bda32 => generated 1313 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:46:58.607088 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-8fdf30e4-d268-417e-b861-45efeb7c054c tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:46:58.607675 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-8fdf30e4-d268-417e-b861-45efeb7c054c tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] [instance: 546a77fd-66e1-4d89-afa3-58d632b09186] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:46:58.614152 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-8fdf30e4-d268-417e-b861-45efeb7c054c tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:46:58.615138 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-8fdf30e4-d268-417e-b861-45efeb7c054c tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:46:58.615894 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-8fdf30e4-d268-417e-b861-45efeb7c054c tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:46:58.616318 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-8fdf30e4-d268-417e-b861-45efeb7c054c tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:46:58.759917 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-8fdf30e4-d268-417e-b861-45efeb7c054c tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d7cacb73c8342579d9f990b0193487c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05df572327d54bd99595974b75898052', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:46:58.767517 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-8fdf30e4-d268-417e-b861-45efeb7c054c tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] 10.222.0.20 "GET /compute/v2.1/servers/546a77fd-66e1-4d89-afa3-58d632b09186" status: 200 len: 1362 microversion: 2.1 time: 0.163846 Jul 06 13:46:58.768696 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 159/325] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:46:58 2022] GET /compute/v2.1/servers/546a77fd-66e1-4d89-afa3-58d632b09186 => generated 1362 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:46:58.806907 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-67b4ae2c-99c0-4a46-be44-2aeb57a03def tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:46:58.807648 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-67b4ae2c-99c0-4a46-be44-2aeb57a03def tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] [instance: 5cf73c2b-28f6-49f1-a119-224c05679d2c] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:46:58.813801 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-67b4ae2c-99c0-4a46-be44-2aeb57a03def tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:46:58.814254 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-67b4ae2c-99c0-4a46-be44-2aeb57a03def tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:46:58.815026 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-67b4ae2c-99c0-4a46-be44-2aeb57a03def tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:46:58.815661 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-67b4ae2c-99c0-4a46-be44-2aeb57a03def tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:46:58.985927 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-67b4ae2c-99c0-4a46-be44-2aeb57a03def tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b572a8f465048558fc969b85b2aec5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd85f2a57a0847debf5aaf81aab7a638', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:46:58.994181 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-67b4ae2c-99c0-4a46-be44-2aeb57a03def tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] 10.222.0.20 "GET /compute/v2.1/servers/5cf73c2b-28f6-49f1-a119-224c05679d2c" status: 200 len: 1366 microversion: 2.1 time: 0.191862 Jul 06 13:46:58.994757 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 160/326] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:46:58 2022] GET /compute/v2.1/servers/5cf73c2b-28f6-49f1-a119-224c05679d2c => generated 1366 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 06 13:46:59.396423 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-22cf27f4-909b-47e5-b178-31d8c1f6ccfe tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] 10.222.0.20 "POST /compute/v2.1/servers/965c7a0f-fa3f-4f5c-92bf-94d8b646a9ae/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 4.709973 Jul 06 13:46:59.397891 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 167/327] 10.222.0.20 () {60 vars in 1322 bytes} [Wed Jul 6 13:46:54 2022] POST /compute/v2.1/servers/965c7a0f-fa3f-4f5c-92bf-94d8b646a9ae/os-volume_attachments => generated 194 bytes in 4713 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 06 13:46:59.422921 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-d931836c-12bf-4785-9134-04b7d324e593 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:46:59.424553 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-d931836c-12bf-4785-9134-04b7d324e593 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] [instance: c801676d-524f-42fc-a2b8-fe4186986d95] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:46:59.432196 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-d931836c-12bf-4785-9134-04b7d324e593 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:46:59.433598 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-d931836c-12bf-4785-9134-04b7d324e593 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:46:59.435015 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-d931836c-12bf-4785-9134-04b7d324e593 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:46:59.435670 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-d931836c-12bf-4785-9134-04b7d324e593 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:46:59.621573 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-a3093b62-d939-41d4-a17d-9987ff13b171 tempest-VolumesActionsTest-262392969 tempest-VolumesActionsTest-262392969-project] Calling method '>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:46:59.622467 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-a3093b62-d939-41d4-a17d-9987ff13b171 tempest-VolumesActionsTest-262392969 tempest-VolumesActionsTest-262392969-project] [instance: 2523f283-429c-4368-afcb-3b90612bda32] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:46:59.635125 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-a3093b62-d939-41d4-a17d-9987ff13b171 tempest-VolumesActionsTest-262392969 tempest-VolumesActionsTest-262392969-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:46:59.637342 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-a3093b62-d939-41d4-a17d-9987ff13b171 tempest-VolumesActionsTest-262392969 tempest-VolumesActionsTest-262392969-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:46:59.638421 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-a3093b62-d939-41d4-a17d-9987ff13b171 tempest-VolumesActionsTest-262392969 tempest-VolumesActionsTest-262392969-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:46:59.639455 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-a3093b62-d939-41d4-a17d-9987ff13b171 tempest-VolumesActionsTest-262392969 tempest-VolumesActionsTest-262392969-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:46:59.658831 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-d931836c-12bf-4785-9134-04b7d324e593 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c83c05bec4f456d8aa7d51732ddc8af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b2a80a004e04da7ae12db9f3f87146f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:46:59.673781 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-d931836c-12bf-4785-9134-04b7d324e593 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] 10.222.0.20 "GET /compute/v2.1/servers/c801676d-524f-42fc-a2b8-fe4186986d95" status: 200 len: 1522 microversion: 2.1 time: 0.256141 Jul 06 13:46:59.685705 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 161/328] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:46:59 2022] GET /compute/v2.1/servers/c801676d-524f-42fc-a2b8-fe4186986d95 => generated 1522 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 06 13:46:59.784485 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-93071d86-02a9-445f-9d87-8a1ac0b7d952 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:46:59.785401 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-93071d86-02a9-445f-9d87-8a1ac0b7d952 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] [instance: 546a77fd-66e1-4d89-afa3-58d632b09186] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:46:59.793510 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-93071d86-02a9-445f-9d87-8a1ac0b7d952 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:46:59.794114 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-93071d86-02a9-445f-9d87-8a1ac0b7d952 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:46:59.795130 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-93071d86-02a9-445f-9d87-8a1ac0b7d952 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:46:59.795664 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-93071d86-02a9-445f-9d87-8a1ac0b7d952 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:46:59.883338 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-a3093b62-d939-41d4-a17d-9987ff13b171 tempest-VolumesActionsTest-262392969 tempest-VolumesActionsTest-262392969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '050d5eb22b2c45ee85eb8c118b9ef21e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f9f86fa910c4054b31927ba26ea96b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:46:59.893722 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-a3093b62-d939-41d4-a17d-9987ff13b171 tempest-VolumesActionsTest-262392969 tempest-VolumesActionsTest-262392969-project] 10.222.0.20 "GET /compute/v2.1/servers/2523f283-429c-4368-afcb-3b90612bda32" status: 200 len: 1313 microversion: 2.1 time: 0.278123 Jul 06 13:46:59.894858 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 168/329] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:46:59 2022] GET /compute/v2.1/servers/2523f283-429c-4368-afcb-3b90612bda32 => generated 1313 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 06 13:47:00.011874 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-551998c3-7265-4233-9f03-3e7ca1af9c3f tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Calling method '>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:47:00.012496 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-551998c3-7265-4233-9f03-3e7ca1af9c3f tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] [instance: 5cf73c2b-28f6-49f1-a119-224c05679d2c] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:47:00.018368 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-551998c3-7265-4233-9f03-3e7ca1af9c3f tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:47:00.019242 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-551998c3-7265-4233-9f03-3e7ca1af9c3f tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:47:00.020673 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-551998c3-7265-4233-9f03-3e7ca1af9c3f tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:47:00.021689 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-551998c3-7265-4233-9f03-3e7ca1af9c3f tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:47:00.115168 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-93071d86-02a9-445f-9d87-8a1ac0b7d952 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d7cacb73c8342579d9f990b0193487c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05df572327d54bd99595974b75898052', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:47:00.136768 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-93071d86-02a9-445f-9d87-8a1ac0b7d952 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] 10.222.0.20 "GET /compute/v2.1/servers/546a77fd-66e1-4d89-afa3-58d632b09186" status: 200 len: 1548 microversion: 2.1 time: 0.356893 Jul 06 13:47:00.143559 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 162/330] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:46:59 2022] GET /compute/v2.1/servers/546a77fd-66e1-4d89-afa3-58d632b09186 => generated 1548 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:47:00.162177 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-048b1f0d-cf99-467e-ac78-daa7ad5ecbea tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:47:00.164305 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-048b1f0d-cf99-467e-ac78-daa7ad5ecbea tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] [instance: 546a77fd-66e1-4d89-afa3-58d632b09186] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:47:00.186751 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-048b1f0d-cf99-467e-ac78-daa7ad5ecbea tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:47:00.188286 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-048b1f0d-cf99-467e-ac78-daa7ad5ecbea tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:47:00.190125 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-048b1f0d-cf99-467e-ac78-daa7ad5ecbea tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:47:00.193820 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-048b1f0d-cf99-467e-ac78-daa7ad5ecbea tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:47:00.264856 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG dbcounter [-] [124367] Writing DB stats nova_cell1:SELECT=100 {{(pid=124367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:47:00.346135 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-048b1f0d-cf99-467e-ac78-daa7ad5ecbea tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] 10.222.0.20 "GET /compute/v2.1/servers/546a77fd-66e1-4d89-afa3-58d632b09186/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.189121 Jul 06 13:47:00.346977 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 163/331] 10.222.0.20 () {58 vars in 1274 bytes} [Wed Jul 6 13:47:00 2022] GET /compute/v2.1/servers/546a77fd-66e1-4d89-afa3-58d632b09186/os-interface => generated 285 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 06 13:47:00.354277 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [req-887d238d-c95e-4ccb-b14e-42b6a7c23cf1 req-a7e6733e-909e-4ddd-bb50-f4f6aae60d64 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2523f283-429c-4368-afcb-3b90612bda32", "tag": "1b189fe2-44ff-40f9-b88f-0090e1f1bcdc"}]} {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 06 13:47:00.366651 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [req-887d238d-c95e-4ccb-b14e-42b6a7c23cf1 req-a7e6733e-909e-4ddd-bb50-f4f6aae60d64 service nova] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:47:00.367366 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [req-887d238d-c95e-4ccb-b14e-42b6a7c23cf1 req-a7e6733e-909e-4ddd-bb50-f4f6aae60d64 service nova] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:47:00.379277 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.compute.server_external_events [req-887d238d-c95e-4ccb-b14e-42b6a7c23cf1 req-a7e6733e-909e-4ddd-bb50-f4f6aae60d64 service nova] Creating event network-changed:1b189fe2-44ff-40f9-b88f-0090e1f1bcdc for instance 2523f283-429c-4368-afcb-3b90612bda32 on hv-cinder-81914 Jul 06 13:47:00.385382 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [req-887d238d-c95e-4ccb-b14e-42b6a7c23cf1 req-a7e6733e-909e-4ddd-bb50-f4f6aae60d64 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036447 Jul 06 13:47:00.386374 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 164/332] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 6 13:47:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 06 13:47:00.421533 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-551998c3-7265-4233-9f03-3e7ca1af9c3f tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b572a8f465048558fc969b85b2aec5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd85f2a57a0847debf5aaf81aab7a638', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:47:00.433525 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-551998c3-7265-4233-9f03-3e7ca1af9c3f tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] 10.222.0.20 "GET /compute/v2.1/servers/5cf73c2b-28f6-49f1-a119-224c05679d2c" status: 200 len: 1557 microversion: 2.1 time: 0.425131 Jul 06 13:47:00.447822 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 169/333] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:47:00 2022] GET /compute/v2.1/servers/5cf73c2b-28f6-49f1-a119-224c05679d2c => generated 1557 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:47:00.452291 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-03a2f9ef-e9e6-405f-b6b2-10579fd22ed9 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:47:00.452860 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-03a2f9ef-e9e6-405f-b6b2-10579fd22ed9 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] [instance: 5cf73c2b-28f6-49f1-a119-224c05679d2c] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:47:00.475960 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-03a2f9ef-e9e6-405f-b6b2-10579fd22ed9 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:47:00.477250 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-03a2f9ef-e9e6-405f-b6b2-10579fd22ed9 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:47:00.479854 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-03a2f9ef-e9e6-405f-b6b2-10579fd22ed9 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:47:00.481080 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-03a2f9ef-e9e6-405f-b6b2-10579fd22ed9 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:47:00.683137 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-03a2f9ef-e9e6-405f-b6b2-10579fd22ed9 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] 10.222.0.20 "GET /compute/v2.1/servers/5cf73c2b-28f6-49f1-a119-224c05679d2c/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.234968 Jul 06 13:47:00.684223 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 165/334] 10.222.0.20 () {58 vars in 1274 bytes} [Wed Jul 6 13:47:00 2022] GET /compute/v2.1/servers/5cf73c2b-28f6-49f1-a119-224c05679d2c/os-interface => generated 285 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 06 13:47:00.692338 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-cb1e1e65-6374-4445-8621-a8d6b794cb49 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Calling method '>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:47:00.693109 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-cb1e1e65-6374-4445-8621-a8d6b794cb49 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] [instance: c801676d-524f-42fc-a2b8-fe4186986d95] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:47:00.704953 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-cb1e1e65-6374-4445-8621-a8d6b794cb49 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:47:00.706395 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-cb1e1e65-6374-4445-8621-a8d6b794cb49 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:47:00.708452 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-cb1e1e65-6374-4445-8621-a8d6b794cb49 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:47:00.711517 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-cb1e1e65-6374-4445-8621-a8d6b794cb49 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:47:00.913016 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-3c4328ab-5f26-4386-952f-06da7c20b40d tempest-VolumesActionsTest-262392969 tempest-VolumesActionsTest-262392969-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:47:00.913883 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-3c4328ab-5f26-4386-952f-06da7c20b40d tempest-VolumesActionsTest-262392969 tempest-VolumesActionsTest-262392969-project] [instance: 2523f283-429c-4368-afcb-3b90612bda32] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:47:00.915938 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG dbcounter [-] [124367] Writing DB stats nova_api:SELECT=100 {{(pid=124367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:47:00.922356 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-3c4328ab-5f26-4386-952f-06da7c20b40d tempest-VolumesActionsTest-262392969 tempest-VolumesActionsTest-262392969-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:47:00.922931 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-3c4328ab-5f26-4386-952f-06da7c20b40d tempest-VolumesActionsTest-262392969 tempest-VolumesActionsTest-262392969-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:47:00.924418 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-3c4328ab-5f26-4386-952f-06da7c20b40d tempest-VolumesActionsTest-262392969 tempest-VolumesActionsTest-262392969-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:47:00.925085 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-3c4328ab-5f26-4386-952f-06da7c20b40d tempest-VolumesActionsTest-262392969 tempest-VolumesActionsTest-262392969-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:47:01.201569 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-cb1e1e65-6374-4445-8621-a8d6b794cb49 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c83c05bec4f456d8aa7d51732ddc8af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b2a80a004e04da7ae12db9f3f87146f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:47:01.211891 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-cb1e1e65-6374-4445-8621-a8d6b794cb49 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] 10.222.0.20 "GET /compute/v2.1/servers/c801676d-524f-42fc-a2b8-fe4186986d95" status: 200 len: 1522 microversion: 2.1 time: 0.523506 Jul 06 13:47:01.221668 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 170/335] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:47:00 2022] GET /compute/v2.1/servers/c801676d-524f-42fc-a2b8-fe4186986d95 => generated 1522 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:47:01.785142 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-3c4328ab-5f26-4386-952f-06da7c20b40d tempest-VolumesActionsTest-262392969 tempest-VolumesActionsTest-262392969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '050d5eb22b2c45ee85eb8c118b9ef21e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f9f86fa910c4054b31927ba26ea96b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:47:01.796420 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-3c4328ab-5f26-4386-952f-06da7c20b40d tempest-VolumesActionsTest-262392969 tempest-VolumesActionsTest-262392969-project] 10.222.0.20 "GET /compute/v2.1/servers/2523f283-429c-4368-afcb-3b90612bda32" status: 200 len: 1313 microversion: 2.1 time: 0.888420 Jul 06 13:47:01.797361 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 166/336] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:47:00 2022] GET /compute/v2.1/servers/2523f283-429c-4368-afcb-3b90612bda32 => generated 1313 bytes in 890 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:47:02.231141 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-91bc2fd8-8790-4857-aabe-4cc007b31cc8 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Calling method '>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:47:02.231776 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-91bc2fd8-8790-4857-aabe-4cc007b31cc8 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] [instance: c801676d-524f-42fc-a2b8-fe4186986d95] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:47:02.238579 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-91bc2fd8-8790-4857-aabe-4cc007b31cc8 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:47:02.239025 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-91bc2fd8-8790-4857-aabe-4cc007b31cc8 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:47:02.240779 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-91bc2fd8-8790-4857-aabe-4cc007b31cc8 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:47:02.241460 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-91bc2fd8-8790-4857-aabe-4cc007b31cc8 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:47:02.575186 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-91bc2fd8-8790-4857-aabe-4cc007b31cc8 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c83c05bec4f456d8aa7d51732ddc8af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b2a80a004e04da7ae12db9f3f87146f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:47:02.587416 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-91bc2fd8-8790-4857-aabe-4cc007b31cc8 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] 10.222.0.20 "GET /compute/v2.1/servers/c801676d-524f-42fc-a2b8-fe4186986d95" status: 200 len: 1522 microversion: 2.1 time: 0.361318 Jul 06 13:47:02.589567 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 171/337] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:47:02 2022] GET /compute/v2.1/servers/c801676d-524f-42fc-a2b8-fe4186986d95 => generated 1522 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:47:02.820553 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-fa30ca3f-6ab0-48e3-b86b-23e2eb0d0544 tempest-VolumesActionsTest-262392969 tempest-VolumesActionsTest-262392969-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:47:02.822754 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-fa30ca3f-6ab0-48e3-b86b-23e2eb0d0544 tempest-VolumesActionsTest-262392969 tempest-VolumesActionsTest-262392969-project] [instance: 2523f283-429c-4368-afcb-3b90612bda32] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:47:02.830019 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-fa30ca3f-6ab0-48e3-b86b-23e2eb0d0544 tempest-VolumesActionsTest-262392969 tempest-VolumesActionsTest-262392969-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:47:02.830696 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-fa30ca3f-6ab0-48e3-b86b-23e2eb0d0544 tempest-VolumesActionsTest-262392969 tempest-VolumesActionsTest-262392969-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:47:02.831929 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-fa30ca3f-6ab0-48e3-b86b-23e2eb0d0544 tempest-VolumesActionsTest-262392969 tempest-VolumesActionsTest-262392969-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:47:02.832954 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-fa30ca3f-6ab0-48e3-b86b-23e2eb0d0544 tempest-VolumesActionsTest-262392969 tempest-VolumesActionsTest-262392969-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:47:02.970589 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [req-1a203e08-b98c-41eb-904d-4dff964a266b req-26a50313-a87e-4dd0-a5e5-b76c43856887 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "546a77fd-66e1-4d89-afa3-58d632b09186", "tag": "3ca14d5b-272c-4543-9380-0fbec0da4da8"}]} {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 06 13:47:02.989065 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [req-1a203e08-b98c-41eb-904d-4dff964a266b req-26a50313-a87e-4dd0-a5e5-b76c43856887 service nova] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:47:02.992003 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [req-1a203e08-b98c-41eb-904d-4dff964a266b req-26a50313-a87e-4dd0-a5e5-b76c43856887 service nova] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:47:03.019990 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.compute.server_external_events [req-1a203e08-b98c-41eb-904d-4dff964a266b req-26a50313-a87e-4dd0-a5e5-b76c43856887 service nova] Creating event network-changed:3ca14d5b-272c-4543-9380-0fbec0da4da8 for instance 546a77fd-66e1-4d89-afa3-58d632b09186 on hv-cinder-81914 Jul 06 13:47:03.032808 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [req-1a203e08-b98c-41eb-904d-4dff964a266b req-26a50313-a87e-4dd0-a5e5-b76c43856887 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070902 Jul 06 13:47:03.033961 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 172/338] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 6 13:47:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 06 13:47:03.040396 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [req-7904eac2-98e0-44b8-b600-0d1158571fa8 req-66ff9b08-f5b4-4f9e-abbb-7673d76e72a0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5cf73c2b-28f6-49f1-a119-224c05679d2c", "tag": "eb26a6ef-8459-409e-986c-7f71a4f52683"}]} {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 06 13:47:03.055670 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [req-7904eac2-98e0-44b8-b600-0d1158571fa8 req-66ff9b08-f5b4-4f9e-abbb-7673d76e72a0 service nova] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:47:03.062243 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [req-7904eac2-98e0-44b8-b600-0d1158571fa8 req-66ff9b08-f5b4-4f9e-abbb-7673d76e72a0 service nova] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:47:03.081475 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.compute.server_external_events [req-7904eac2-98e0-44b8-b600-0d1158571fa8 req-66ff9b08-f5b4-4f9e-abbb-7673d76e72a0 service nova] Creating event network-changed:eb26a6ef-8459-409e-986c-7f71a4f52683 for instance 5cf73c2b-28f6-49f1-a119-224c05679d2c on hv-cinder-81914 Jul 06 13:47:03.090784 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [req-7904eac2-98e0-44b8-b600-0d1158571fa8 req-66ff9b08-f5b4-4f9e-abbb-7673d76e72a0 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054799 Jul 06 13:47:03.093036 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 173/339] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 6 13:47:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 06 13:47:03.607930 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-1454e7fe-9924-43e0-a372-57b2b991f45e tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Calling method '>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:47:03.608629 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-1454e7fe-9924-43e0-a372-57b2b991f45e tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] [instance: c801676d-524f-42fc-a2b8-fe4186986d95] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:47:03.620852 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-1454e7fe-9924-43e0-a372-57b2b991f45e tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:47:03.622871 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-1454e7fe-9924-43e0-a372-57b2b991f45e tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:47:03.627144 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-1454e7fe-9924-43e0-a372-57b2b991f45e tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:47:03.627817 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-1454e7fe-9924-43e0-a372-57b2b991f45e tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:47:03.722987 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-fa30ca3f-6ab0-48e3-b86b-23e2eb0d0544 tempest-VolumesActionsTest-262392969 tempest-VolumesActionsTest-262392969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '050d5eb22b2c45ee85eb8c118b9ef21e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f9f86fa910c4054b31927ba26ea96b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:47:03.737344 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-fa30ca3f-6ab0-48e3-b86b-23e2eb0d0544 tempest-VolumesActionsTest-262392969 tempest-VolumesActionsTest-262392969-project] 10.222.0.20 "GET /compute/v2.1/servers/2523f283-429c-4368-afcb-3b90612bda32" status: 200 len: 1313 microversion: 2.1 time: 0.927030 Jul 06 13:47:03.741798 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 167/340] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:47:02 2022] GET /compute/v2.1/servers/2523f283-429c-4368-afcb-3b90612bda32 => generated 1313 bytes in 932 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:47:03.933993 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-a42b1046-7eed-468a-b87a-628738e5325a tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1780426130", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-135657547", "security_groups": [{"name": "tempest-secgroup-smoke-953280296"}], "networks": [{"uuid": "dec9879c-fd48-42c4-9888-128aec6a9b22"}], "block_device_mapping_v2": [{"uuid": "e1bc59cf-00ea-44a3-b4bd-7d2340c8a118", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 06 13:47:04.189512 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.network.neutron [None req-a42b1046-7eed-468a-b87a-628738e5325a tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] validate_networks() for [('dec9879c-fd48-42c4-9888-128aec6a9b22', None, None, None, None, None)] {{(pid=124367) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 06 13:47:04.343710 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-1454e7fe-9924-43e0-a372-57b2b991f45e tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c83c05bec4f456d8aa7d51732ddc8af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b2a80a004e04da7ae12db9f3f87146f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:47:04.361893 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-1454e7fe-9924-43e0-a372-57b2b991f45e tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] 10.222.0.20 "GET /compute/v2.1/servers/c801676d-524f-42fc-a2b8-fe4186986d95" status: 200 len: 1522 microversion: 2.1 time: 0.759459 Jul 06 13:47:04.362686 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 174/341] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:47:03 2022] GET /compute/v2.1/servers/c801676d-524f-42fc-a2b8-fe4186986d95 => generated 1522 bytes in 761 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:47:04.756430 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-7d6b92a0-6a25-4a3b-8122-8610ca838587 tempest-VolumesActionsTest-262392969 tempest-VolumesActionsTest-262392969-project] Calling method '>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:47:04.757164 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-7d6b92a0-6a25-4a3b-8122-8610ca838587 tempest-VolumesActionsTest-262392969 tempest-VolumesActionsTest-262392969-project] [instance: 2523f283-429c-4368-afcb-3b90612bda32] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:47:04.777689 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-7d6b92a0-6a25-4a3b-8122-8610ca838587 tempest-VolumesActionsTest-262392969 tempest-VolumesActionsTest-262392969-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:47:04.779822 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-7d6b92a0-6a25-4a3b-8122-8610ca838587 tempest-VolumesActionsTest-262392969 tempest-VolumesActionsTest-262392969-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:47:04.782566 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-7d6b92a0-6a25-4a3b-8122-8610ca838587 tempest-VolumesActionsTest-262392969 tempest-VolumesActionsTest-262392969-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:47:04.783722 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-7d6b92a0-6a25-4a3b-8122-8610ca838587 tempest-VolumesActionsTest-262392969 tempest-VolumesActionsTest-262392969-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:47:04.825780 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG dbcounter [-] [124368] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:47:04.896520 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.virt.hardware [None req-a42b1046-7eed-468a-b87a-628738e5325a tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] Flavor limits 0:0:0 {{(pid=124367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 06 13:47:04.897155 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.virt.hardware [None req-a42b1046-7eed-468a-b87a-628738e5325a tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] Image limits 0:0:0 {{(pid=124367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 06 13:47:04.897852 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.virt.hardware [None req-a42b1046-7eed-468a-b87a-628738e5325a tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] Flavor pref 0:0:0 {{(pid=124367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 06 13:47:04.898478 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.virt.hardware [None req-a42b1046-7eed-468a-b87a-628738e5325a tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] Image pref 0:0:0 {{(pid=124367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 06 13:47:04.899067 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.virt.hardware [None req-a42b1046-7eed-468a-b87a-628738e5325a tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 06 13:47:04.924149 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-a42b1046-7eed-468a-b87a-628738e5325a tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:47:04.924641 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-a42b1046-7eed-468a-b87a-628738e5325a tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:47:04.925524 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-a42b1046-7eed-468a-b87a-628738e5325a tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:47:04.926257 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-a42b1046-7eed-468a-b87a-628738e5325a tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:47:05.015004 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.quota [None req-a42b1046-7eed-468a-b87a-628738e5325a tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] Getting quotas for project 1727f66e37f94cc6971b574c8635e078. Resources: {'instances', 'cores', 'ram'} {{(pid=124367) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 06 13:47:05.037329 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.quota [None req-a42b1046-7eed-468a-b87a-628738e5325a tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] Getting quotas for user 53d00e4198e240c8a5c2fbe8bd241b45 and project 1727f66e37f94cc6971b574c8635e078. Resources: {'instances', 'cores', 'ram'} {{(pid=124367) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 06 13:47:05.147765 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-7d6b92a0-6a25-4a3b-8122-8610ca838587 tempest-VolumesActionsTest-262392969 tempest-VolumesActionsTest-262392969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '050d5eb22b2c45ee85eb8c118b9ef21e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f9f86fa910c4054b31927ba26ea96b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:47:05.156193 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-7d6b92a0-6a25-4a3b-8122-8610ca838587 tempest-VolumesActionsTest-262392969 tempest-VolumesActionsTest-262392969-project] 10.222.0.20 "GET /compute/v2.1/servers/2523f283-429c-4368-afcb-3b90612bda32" status: 200 len: 1313 microversion: 2.1 time: 0.404335 Jul 06 13:47:05.157359 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 175/342] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:47:04 2022] GET /compute/v2.1/servers/2523f283-429c-4368-afcb-3b90612bda32 => generated 1313 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:47:05.184808 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-a42b1046-7eed-468a-b87a-628738e5325a tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] Going to run 1 instances... {{(pid=124367) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 06 13:47:05.185368 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-a42b1046-7eed-468a-b87a-628738e5325a tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] [instance: 0a925141-db5f-4cae-bc6c-8ca4930adf73] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='e1bc59cf-00ea-44a3-b4bd-7d2340c8a118',volume_size=None,volume_type=None)] {{(pid=124367) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 06 13:47:05.373113 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-a42b1046-7eed-468a-b87a-628738e5325a tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.443390 Jul 06 13:47:05.374028 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 168/343] 10.222.0.20 () {60 vars in 1146 bytes} [Wed Jul 6 13:47:03 2022] POST /compute/v2.1/servers => generated 405 bytes in 1445 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 06 13:47:05.380819 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-869f875a-8624-47ed-826e-5aa2dbc6be42 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Calling method '>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:47:05.381713 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-869f875a-8624-47ed-826e-5aa2dbc6be42 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] [instance: c801676d-524f-42fc-a2b8-fe4186986d95] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:47:05.391624 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-869f875a-8624-47ed-826e-5aa2dbc6be42 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:47:05.392084 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-869f875a-8624-47ed-826e-5aa2dbc6be42 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:47:05.396061 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-d9653406-94ec-4903-83d9-5213b3835b35 tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:47:05.396671 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-d9653406-94ec-4903-83d9-5213b3835b35 tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] [instance: 0a925141-db5f-4cae-bc6c-8ca4930adf73] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:47:05.397679 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-869f875a-8624-47ed-826e-5aa2dbc6be42 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:47:05.398432 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-869f875a-8624-47ed-826e-5aa2dbc6be42 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:47:05.512533 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-d9653406-94ec-4903-83d9-5213b3835b35 tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53d00e4198e240c8a5c2fbe8bd241b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1727f66e37f94cc6971b574c8635e078', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:47:05.519426 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-d9653406-94ec-4903-83d9-5213b3835b35 tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] 10.222.0.20 "GET /compute/v2.1/servers/0a925141-db5f-4cae-bc6c-8ca4930adf73" status: 200 len: 1088 microversion: 2.1 time: 0.131269 Jul 06 13:47:05.520266 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 169/344] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:47:05 2022] GET /compute/v2.1/servers/0a925141-db5f-4cae-bc6c-8ca4930adf73 => generated 1088 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:47:05.697534 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-869f875a-8624-47ed-826e-5aa2dbc6be42 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c83c05bec4f456d8aa7d51732ddc8af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b2a80a004e04da7ae12db9f3f87146f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:47:05.724658 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-869f875a-8624-47ed-826e-5aa2dbc6be42 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] 10.222.0.20 "GET /compute/v2.1/servers/c801676d-524f-42fc-a2b8-fe4186986d95" status: 200 len: 1522 microversion: 2.1 time: 0.348789 Jul 06 13:47:05.742119 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 176/345] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:47:05 2022] GET /compute/v2.1/servers/c801676d-524f-42fc-a2b8-fe4186986d95 => generated 1522 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:47:06.174828 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-4d03c946-31b6-4551-b94b-5421151f48bf tempest-VolumesActionsTest-262392969 tempest-VolumesActionsTest-262392969-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:47:06.175780 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-4d03c946-31b6-4551-b94b-5421151f48bf tempest-VolumesActionsTest-262392969 tempest-VolumesActionsTest-262392969-project] [instance: 2523f283-429c-4368-afcb-3b90612bda32] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:47:06.182739 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-4d03c946-31b6-4551-b94b-5421151f48bf tempest-VolumesActionsTest-262392969 tempest-VolumesActionsTest-262392969-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:47:06.183469 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-4d03c946-31b6-4551-b94b-5421151f48bf tempest-VolumesActionsTest-262392969 tempest-VolumesActionsTest-262392969-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:47:06.184416 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-4d03c946-31b6-4551-b94b-5421151f48bf tempest-VolumesActionsTest-262392969 tempest-VolumesActionsTest-262392969-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:47:06.184956 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-4d03c946-31b6-4551-b94b-5421151f48bf tempest-VolumesActionsTest-262392969 tempest-VolumesActionsTest-262392969-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:47:06.329157 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-4d03c946-31b6-4551-b94b-5421151f48bf tempest-VolumesActionsTest-262392969 tempest-VolumesActionsTest-262392969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '050d5eb22b2c45ee85eb8c118b9ef21e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f9f86fa910c4054b31927ba26ea96b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:47:06.359404 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-4d03c946-31b6-4551-b94b-5421151f48bf tempest-VolumesActionsTest-262392969 tempest-VolumesActionsTest-262392969-project] 10.222.0.20 "GET /compute/v2.1/servers/2523f283-429c-4368-afcb-3b90612bda32" status: 200 len: 1313 microversion: 2.1 time: 0.188321 Jul 06 13:47:06.360815 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 170/346] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:47:06 2022] GET /compute/v2.1/servers/2523f283-429c-4368-afcb-3b90612bda32 => generated 1313 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 06 13:47:06.537179 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-7613d681-f526-4e80-9668-d131f909abf3 tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] Calling method '>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:47:06.537800 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-7613d681-f526-4e80-9668-d131f909abf3 tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] [instance: 0a925141-db5f-4cae-bc6c-8ca4930adf73] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:47:06.544412 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-7613d681-f526-4e80-9668-d131f909abf3 tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:47:06.544864 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-7613d681-f526-4e80-9668-d131f909abf3 tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:47:06.545682 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-7613d681-f526-4e80-9668-d131f909abf3 tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:47:06.546113 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-7613d681-f526-4e80-9668-d131f909abf3 tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:47:06.724283 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-7613d681-f526-4e80-9668-d131f909abf3 tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53d00e4198e240c8a5c2fbe8bd241b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1727f66e37f94cc6971b574c8635e078', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:47:06.733142 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-7613d681-f526-4e80-9668-d131f909abf3 tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] 10.222.0.20 "GET /compute/v2.1/servers/0a925141-db5f-4cae-bc6c-8ca4930adf73" status: 200 len: 1130 microversion: 2.1 time: 0.200261 Jul 06 13:47:06.733828 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 177/347] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:47:06 2022] GET /compute/v2.1/servers/0a925141-db5f-4cae-bc6c-8ca4930adf73 => generated 1130 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:47:06.744789 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-d0257d9e-760f-4c1d-82c6-16a45df835b3 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:47:06.745421 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-d0257d9e-760f-4c1d-82c6-16a45df835b3 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] [instance: c801676d-524f-42fc-a2b8-fe4186986d95] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:47:06.752860 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-d0257d9e-760f-4c1d-82c6-16a45df835b3 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:47:06.760572 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-d0257d9e-760f-4c1d-82c6-16a45df835b3 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:47:06.761455 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-d0257d9e-760f-4c1d-82c6-16a45df835b3 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:47:06.761892 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-d0257d9e-760f-4c1d-82c6-16a45df835b3 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:47:06.941668 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-d0257d9e-760f-4c1d-82c6-16a45df835b3 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c83c05bec4f456d8aa7d51732ddc8af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b2a80a004e04da7ae12db9f3f87146f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:47:06.953762 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-d0257d9e-760f-4c1d-82c6-16a45df835b3 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] 10.222.0.20 "GET /compute/v2.1/servers/c801676d-524f-42fc-a2b8-fe4186986d95" status: 200 len: 1522 microversion: 2.1 time: 0.212876 Jul 06 13:47:06.955030 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 171/348] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:47:06 2022] GET /compute/v2.1/servers/c801676d-524f-42fc-a2b8-fe4186986d95 => generated 1522 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:47:07.377840 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-462e411f-01ae-4727-a781-6321501cfac3 tempest-VolumesActionsTest-262392969 tempest-VolumesActionsTest-262392969-project] Calling method '>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:47:07.378539 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-462e411f-01ae-4727-a781-6321501cfac3 tempest-VolumesActionsTest-262392969 tempest-VolumesActionsTest-262392969-project] [instance: 2523f283-429c-4368-afcb-3b90612bda32] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:47:07.389727 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-462e411f-01ae-4727-a781-6321501cfac3 tempest-VolumesActionsTest-262392969 tempest-VolumesActionsTest-262392969-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:47:07.392217 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-462e411f-01ae-4727-a781-6321501cfac3 tempest-VolumesActionsTest-262392969 tempest-VolumesActionsTest-262392969-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:47:07.393117 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-462e411f-01ae-4727-a781-6321501cfac3 tempest-VolumesActionsTest-262392969 tempest-VolumesActionsTest-262392969-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:47:07.397037 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-462e411f-01ae-4727-a781-6321501cfac3 tempest-VolumesActionsTest-262392969 tempest-VolumesActionsTest-262392969-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:47:07.629327 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-462e411f-01ae-4727-a781-6321501cfac3 tempest-VolumesActionsTest-262392969 tempest-VolumesActionsTest-262392969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '050d5eb22b2c45ee85eb8c118b9ef21e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f9f86fa910c4054b31927ba26ea96b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:47:07.637651 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-462e411f-01ae-4727-a781-6321501cfac3 tempest-VolumesActionsTest-262392969 tempest-VolumesActionsTest-262392969-project] 10.222.0.20 "GET /compute/v2.1/servers/2523f283-429c-4368-afcb-3b90612bda32" status: 200 len: 1313 microversion: 2.1 time: 0.264015 Jul 06 13:47:07.638321 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 178/349] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:47:07 2022] GET /compute/v2.1/servers/2523f283-429c-4368-afcb-3b90612bda32 => generated 1313 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:47:07.750796 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-782aa7b7-ae17-4952-bd23-947edf7a98cf tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:47:07.751445 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-782aa7b7-ae17-4952-bd23-947edf7a98cf tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] [instance: 0a925141-db5f-4cae-bc6c-8ca4930adf73] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:47:07.758636 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-782aa7b7-ae17-4952-bd23-947edf7a98cf tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:47:07.759391 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-782aa7b7-ae17-4952-bd23-947edf7a98cf tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:47:07.760185 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-782aa7b7-ae17-4952-bd23-947edf7a98cf tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:47:07.760710 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-782aa7b7-ae17-4952-bd23-947edf7a98cf tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:47:07.832618 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-782aa7b7-ae17-4952-bd23-947edf7a98cf tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53d00e4198e240c8a5c2fbe8bd241b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1727f66e37f94cc6971b574c8635e078', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:47:07.845311 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-782aa7b7-ae17-4952-bd23-947edf7a98cf tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] 10.222.0.20 "GET /compute/v2.1/servers/0a925141-db5f-4cae-bc6c-8ca4930adf73" status: 200 len: 1194 microversion: 2.1 time: 0.098201 Jul 06 13:47:07.846331 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 172/350] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:47:07 2022] GET /compute/v2.1/servers/0a925141-db5f-4cae-bc6c-8ca4930adf73 => generated 1194 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:47:07.976370 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-08c42d11-9bfb-4123-ae93-7663da98b360 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Calling method '>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:47:07.977164 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-08c42d11-9bfb-4123-ae93-7663da98b360 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] [instance: c801676d-524f-42fc-a2b8-fe4186986d95] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:47:07.983657 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-08c42d11-9bfb-4123-ae93-7663da98b360 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:47:07.984482 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-08c42d11-9bfb-4123-ae93-7663da98b360 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:47:07.985278 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-08c42d11-9bfb-4123-ae93-7663da98b360 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:47:07.985861 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-08c42d11-9bfb-4123-ae93-7663da98b360 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:47:08.137483 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-08c42d11-9bfb-4123-ae93-7663da98b360 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c83c05bec4f456d8aa7d51732ddc8af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b2a80a004e04da7ae12db9f3f87146f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:47:08.147533 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-08c42d11-9bfb-4123-ae93-7663da98b360 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] 10.222.0.20 "GET /compute/v2.1/servers/c801676d-524f-42fc-a2b8-fe4186986d95" status: 200 len: 1522 microversion: 2.1 time: 0.176478 Jul 06 13:47:08.148186 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 179/351] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:47:07 2022] GET /compute/v2.1/servers/c801676d-524f-42fc-a2b8-fe4186986d95 => generated 1522 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:47:08.654493 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-146930f8-5873-4d53-8f5e-0669518b8851 tempest-VolumesActionsTest-262392969 tempest-VolumesActionsTest-262392969-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:47:08.655132 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-146930f8-5873-4d53-8f5e-0669518b8851 tempest-VolumesActionsTest-262392969 tempest-VolumesActionsTest-262392969-project] [instance: 2523f283-429c-4368-afcb-3b90612bda32] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:47:08.661637 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-146930f8-5873-4d53-8f5e-0669518b8851 tempest-VolumesActionsTest-262392969 tempest-VolumesActionsTest-262392969-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:47:08.661895 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-146930f8-5873-4d53-8f5e-0669518b8851 tempest-VolumesActionsTest-262392969 tempest-VolumesActionsTest-262392969-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:47:08.662649 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-146930f8-5873-4d53-8f5e-0669518b8851 tempest-VolumesActionsTest-262392969 tempest-VolumesActionsTest-262392969-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:47:08.663079 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-146930f8-5873-4d53-8f5e-0669518b8851 tempest-VolumesActionsTest-262392969 tempest-VolumesActionsTest-262392969-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:47:08.798119 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-146930f8-5873-4d53-8f5e-0669518b8851 tempest-VolumesActionsTest-262392969 tempest-VolumesActionsTest-262392969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '050d5eb22b2c45ee85eb8c118b9ef21e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f9f86fa910c4054b31927ba26ea96b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:47:08.808283 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-146930f8-5873-4d53-8f5e-0669518b8851 tempest-VolumesActionsTest-262392969 tempest-VolumesActionsTest-262392969-project] 10.222.0.20 "GET /compute/v2.1/servers/2523f283-429c-4368-afcb-3b90612bda32" status: 200 len: 1313 microversion: 2.1 time: 0.157494 Jul 06 13:47:08.808869 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 173/352] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:47:08 2022] GET /compute/v2.1/servers/2523f283-429c-4368-afcb-3b90612bda32 => generated 1313 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:47:08.870826 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-9cce660d-738c-4867-8966-96af0b88dd52 tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] Calling method '>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:47:08.871575 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-9cce660d-738c-4867-8966-96af0b88dd52 tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] [instance: 0a925141-db5f-4cae-bc6c-8ca4930adf73] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:47:08.877928 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-9cce660d-738c-4867-8966-96af0b88dd52 tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:47:08.878376 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-9cce660d-738c-4867-8966-96af0b88dd52 tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:47:08.879183 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-9cce660d-738c-4867-8966-96af0b88dd52 tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:47:08.880614 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-9cce660d-738c-4867-8966-96af0b88dd52 tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:47:08.959610 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-9cce660d-738c-4867-8966-96af0b88dd52 tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53d00e4198e240c8a5c2fbe8bd241b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1727f66e37f94cc6971b574c8635e078', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:47:08.969244 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-9cce660d-738c-4867-8966-96af0b88dd52 tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] 10.222.0.20 "GET /compute/v2.1/servers/0a925141-db5f-4cae-bc6c-8ca4930adf73" status: 200 len: 1194 microversion: 2.1 time: 0.101638 Jul 06 13:47:08.969834 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 180/353] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:47:08 2022] GET /compute/v2.1/servers/0a925141-db5f-4cae-bc6c-8ca4930adf73 => generated 1194 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:47:09.164812 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-8b943aa3-7fa9-4cf2-b97b-265089d24cc9 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:47:09.165428 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-8b943aa3-7fa9-4cf2-b97b-265089d24cc9 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] [instance: c801676d-524f-42fc-a2b8-fe4186986d95] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:47:09.171624 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-8b943aa3-7fa9-4cf2-b97b-265089d24cc9 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:47:09.172067 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-8b943aa3-7fa9-4cf2-b97b-265089d24cc9 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:47:09.172832 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-8b943aa3-7fa9-4cf2-b97b-265089d24cc9 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:47:09.173289 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-8b943aa3-7fa9-4cf2-b97b-265089d24cc9 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:47:09.337240 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-8b943aa3-7fa9-4cf2-b97b-265089d24cc9 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c83c05bec4f456d8aa7d51732ddc8af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b2a80a004e04da7ae12db9f3f87146f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:47:09.346862 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-8b943aa3-7fa9-4cf2-b97b-265089d24cc9 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] 10.222.0.20 "GET /compute/v2.1/servers/c801676d-524f-42fc-a2b8-fe4186986d95" status: 200 len: 1522 microversion: 2.1 time: 0.187096 Jul 06 13:47:09.347813 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 174/354] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:47:09 2022] GET /compute/v2.1/servers/c801676d-524f-42fc-a2b8-fe4186986d95 => generated 1522 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:47:09.536937 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [req-563f3dcf-13e8-44dd-bc92-a0c6dc2e74f1 req-93d563a0-8e76-47af-bd74-c208e79ada1a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2523f283-429c-4368-afcb-3b90612bda32", "name": "network-vif-plugged", "status": "completed", "tag": "1b189fe2-44ff-40f9-b88f-0090e1f1bcdc"}]} {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 06 13:47:09.554062 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [req-563f3dcf-13e8-44dd-bc92-a0c6dc2e74f1 req-93d563a0-8e76-47af-bd74-c208e79ada1a service nova] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:47:09.555960 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [req-563f3dcf-13e8-44dd-bc92-a0c6dc2e74f1 req-93d563a0-8e76-47af-bd74-c208e79ada1a service nova] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:47:09.580795 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.compute.server_external_events [req-563f3dcf-13e8-44dd-bc92-a0c6dc2e74f1 req-93d563a0-8e76-47af-bd74-c208e79ada1a service nova] Creating event network-vif-plugged:1b189fe2-44ff-40f9-b88f-0090e1f1bcdc for instance 2523f283-429c-4368-afcb-3b90612bda32 on hv-cinder-81914 Jul 06 13:47:09.592875 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [req-563f3dcf-13e8-44dd-bc92-a0c6dc2e74f1 req-93d563a0-8e76-47af-bd74-c208e79ada1a service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061375 Jul 06 13:47:09.593594 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 181/355] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 6 13:47:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 06 13:47:09.825338 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-df362180-0fcc-495b-a536-26a16f53c96b tempest-VolumesActionsTest-262392969 tempest-VolumesActionsTest-262392969-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:47:09.825860 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-df362180-0fcc-495b-a536-26a16f53c96b tempest-VolumesActionsTest-262392969 tempest-VolumesActionsTest-262392969-project] [instance: 2523f283-429c-4368-afcb-3b90612bda32] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:47:09.831890 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-df362180-0fcc-495b-a536-26a16f53c96b tempest-VolumesActionsTest-262392969 tempest-VolumesActionsTest-262392969-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:47:09.832342 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-df362180-0fcc-495b-a536-26a16f53c96b tempest-VolumesActionsTest-262392969 tempest-VolumesActionsTest-262392969-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:47:09.833978 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-df362180-0fcc-495b-a536-26a16f53c96b tempest-VolumesActionsTest-262392969 tempest-VolumesActionsTest-262392969-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:47:09.834436 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-df362180-0fcc-495b-a536-26a16f53c96b tempest-VolumesActionsTest-262392969 tempest-VolumesActionsTest-262392969-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:47:09.970822 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-df362180-0fcc-495b-a536-26a16f53c96b tempest-VolumesActionsTest-262392969 tempest-VolumesActionsTest-262392969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '050d5eb22b2c45ee85eb8c118b9ef21e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f9f86fa910c4054b31927ba26ea96b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:47:09.978550 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-df362180-0fcc-495b-a536-26a16f53c96b tempest-VolumesActionsTest-262392969 tempest-VolumesActionsTest-262392969-project] 10.222.0.20 "GET /compute/v2.1/servers/2523f283-429c-4368-afcb-3b90612bda32" status: 200 len: 1313 microversion: 2.1 time: 0.157102 Jul 06 13:47:09.984675 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 175/356] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:47:09 2022] GET /compute/v2.1/servers/2523f283-429c-4368-afcb-3b90612bda32 => generated 1313 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 06 13:47:09.992054 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-53801027-cb9c-4e87-a8d8-e94a868a6ffe tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] Calling method '>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:47:09.992755 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-53801027-cb9c-4e87-a8d8-e94a868a6ffe tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] [instance: 0a925141-db5f-4cae-bc6c-8ca4930adf73] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:47:09.999306 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-53801027-cb9c-4e87-a8d8-e94a868a6ffe tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:47:09.999759 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-53801027-cb9c-4e87-a8d8-e94a868a6ffe tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:47:10.000542 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-53801027-cb9c-4e87-a8d8-e94a868a6ffe tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:47:10.000975 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-53801027-cb9c-4e87-a8d8-e94a868a6ffe tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:47:10.072345 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-53801027-cb9c-4e87-a8d8-e94a868a6ffe tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53d00e4198e240c8a5c2fbe8bd241b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1727f66e37f94cc6971b574c8635e078', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:47:10.080108 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-53801027-cb9c-4e87-a8d8-e94a868a6ffe tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] 10.222.0.20 "GET /compute/v2.1/servers/0a925141-db5f-4cae-bc6c-8ca4930adf73" status: 200 len: 1204 microversion: 2.1 time: 0.093032 Jul 06 13:47:10.080583 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 182/357] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:47:09 2022] GET /compute/v2.1/servers/0a925141-db5f-4cae-bc6c-8ca4930adf73 => generated 1204 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:47:10.367536 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-4fdfebcf-adeb-4176-9413-0c1e10c36f9c tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:47:10.368181 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-4fdfebcf-adeb-4176-9413-0c1e10c36f9c tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] [instance: c801676d-524f-42fc-a2b8-fe4186986d95] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:47:10.377137 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-4fdfebcf-adeb-4176-9413-0c1e10c36f9c tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:47:10.377965 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-4fdfebcf-adeb-4176-9413-0c1e10c36f9c tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:47:10.379184 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-4fdfebcf-adeb-4176-9413-0c1e10c36f9c tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:47:10.380927 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-4fdfebcf-adeb-4176-9413-0c1e10c36f9c tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:47:10.562892 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-4fdfebcf-adeb-4176-9413-0c1e10c36f9c tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c83c05bec4f456d8aa7d51732ddc8af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b2a80a004e04da7ae12db9f3f87146f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:47:10.577100 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-4fdfebcf-adeb-4176-9413-0c1e10c36f9c tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] 10.222.0.20 "GET /compute/v2.1/servers/c801676d-524f-42fc-a2b8-fe4186986d95" status: 200 len: 1522 microversion: 2.1 time: 0.214713 Jul 06 13:47:10.591025 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 176/358] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:47:10 2022] GET /compute/v2.1/servers/c801676d-524f-42fc-a2b8-fe4186986d95 => generated 1522 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:47:10.998239 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-739bfd97-d8f9-40f1-a15a-78119245a5ae tempest-VolumesActionsTest-262392969 tempest-VolumesActionsTest-262392969-project] Calling method '>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:47:10.999073 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-739bfd97-d8f9-40f1-a15a-78119245a5ae tempest-VolumesActionsTest-262392969 tempest-VolumesActionsTest-262392969-project] [instance: 2523f283-429c-4368-afcb-3b90612bda32] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:47:11.008718 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-739bfd97-d8f9-40f1-a15a-78119245a5ae tempest-VolumesActionsTest-262392969 tempest-VolumesActionsTest-262392969-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:47:11.010158 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-739bfd97-d8f9-40f1-a15a-78119245a5ae tempest-VolumesActionsTest-262392969 tempest-VolumesActionsTest-262392969-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:47:11.012280 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-739bfd97-d8f9-40f1-a15a-78119245a5ae tempest-VolumesActionsTest-262392969 tempest-VolumesActionsTest-262392969-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:47:11.012958 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-739bfd97-d8f9-40f1-a15a-78119245a5ae tempest-VolumesActionsTest-262392969 tempest-VolumesActionsTest-262392969-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:47:11.097792 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-bf7fec4f-f71b-40b9-972c-b559f6bcebe4 tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:47:11.100116 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-bf7fec4f-f71b-40b9-972c-b559f6bcebe4 tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] [instance: 0a925141-db5f-4cae-bc6c-8ca4930adf73] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:47:11.107972 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-bf7fec4f-f71b-40b9-972c-b559f6bcebe4 tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:47:11.111211 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-bf7fec4f-f71b-40b9-972c-b559f6bcebe4 tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:47:11.112354 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-bf7fec4f-f71b-40b9-972c-b559f6bcebe4 tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:47:11.113032 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-bf7fec4f-f71b-40b9-972c-b559f6bcebe4 tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:47:11.341964 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-bf7fec4f-f71b-40b9-972c-b559f6bcebe4 tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53d00e4198e240c8a5c2fbe8bd241b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1727f66e37f94cc6971b574c8635e078', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:47:11.353889 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-bf7fec4f-f71b-40b9-972c-b559f6bcebe4 tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] 10.222.0.20 "GET /compute/v2.1/servers/0a925141-db5f-4cae-bc6c-8ca4930adf73" status: 200 len: 1271 microversion: 2.1 time: 0.259604 Jul 06 13:47:11.355289 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 177/359] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:47:11 2022] GET /compute/v2.1/servers/0a925141-db5f-4cae-bc6c-8ca4930adf73 => generated 1271 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 06 13:47:11.386513 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-739bfd97-d8f9-40f1-a15a-78119245a5ae tempest-VolumesActionsTest-262392969 tempest-VolumesActionsTest-262392969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '050d5eb22b2c45ee85eb8c118b9ef21e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f9f86fa910c4054b31927ba26ea96b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:47:11.397238 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-739bfd97-d8f9-40f1-a15a-78119245a5ae tempest-VolumesActionsTest-262392969 tempest-VolumesActionsTest-262392969-project] 10.222.0.20 "GET /compute/v2.1/servers/2523f283-429c-4368-afcb-3b90612bda32" status: 200 len: 1313 microversion: 2.1 time: 0.404283 Jul 06 13:47:11.398009 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 183/360] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:47:10 2022] GET /compute/v2.1/servers/2523f283-429c-4368-afcb-3b90612bda32 => generated 1313 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:47:11.587020 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-cfec016c-f20f-4137-b8ff-8e56165abf12 tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:47:11.587965 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-cfec016c-f20f-4137-b8ff-8e56165abf12 tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] [instance: 965c7a0f-fa3f-4f5c-92bf-94d8b646a9ae] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:47:11.595579 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-cfec016c-f20f-4137-b8ff-8e56165abf12 tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:47:11.596401 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-cfec016c-f20f-4137-b8ff-8e56165abf12 tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:47:11.597664 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-cfec016c-f20f-4137-b8ff-8e56165abf12 tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:47:11.598312 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-cfec016c-f20f-4137-b8ff-8e56165abf12 tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:47:11.600180 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-bd33d1a8-456c-4424-99a5-0002f2c14655 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Calling method '>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:47:11.602525 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-bd33d1a8-456c-4424-99a5-0002f2c14655 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] [instance: c801676d-524f-42fc-a2b8-fe4186986d95] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:47:11.616832 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-bd33d1a8-456c-4424-99a5-0002f2c14655 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:47:11.617653 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-bd33d1a8-456c-4424-99a5-0002f2c14655 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:47:11.619882 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-bd33d1a8-456c-4424-99a5-0002f2c14655 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:47:11.620006 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-bd33d1a8-456c-4424-99a5-0002f2c14655 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:47:11.626870 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-cfec016c-f20f-4137-b8ff-8e56165abf12 tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] [instance: 965c7a0f-fa3f-4f5c-92bf-94d8b646a9ae] Going to try to terminate instance {{(pid=124367) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 06 13:47:11.785807 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-cfec016c-f20f-4137-b8ff-8e56165abf12 tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] 10.222.0.20 "DELETE /compute/v2.1/servers/965c7a0f-fa3f-4f5c-92bf-94d8b646a9ae" status: 204 len: 0 microversion: 2.1 time: 0.199158 Jul 06 13:47:11.786854 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 178/361] 10.222.0.20 () {58 vars in 1238 bytes} [Wed Jul 6 13:47:11 2022] DELETE /compute/v2.1/servers/965c7a0f-fa3f-4f5c-92bf-94d8b646a9ae => generated 0 bytes in 208 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 06 13:47:11.800354 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-87709031-d5e2-42d7-9110-86fe53aaa74a tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:47:11.803293 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-87709031-d5e2-42d7-9110-86fe53aaa74a tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] [instance: 965c7a0f-fa3f-4f5c-92bf-94d8b646a9ae] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:47:11.820455 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-87709031-d5e2-42d7-9110-86fe53aaa74a tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:47:11.823486 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-87709031-d5e2-42d7-9110-86fe53aaa74a tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:47:11.825818 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-87709031-d5e2-42d7-9110-86fe53aaa74a tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:47:11.828001 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-87709031-d5e2-42d7-9110-86fe53aaa74a tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:47:12.012852 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-bd33d1a8-456c-4424-99a5-0002f2c14655 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c83c05bec4f456d8aa7d51732ddc8af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b2a80a004e04da7ae12db9f3f87146f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:47:12.029231 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-bd33d1a8-456c-4424-99a5-0002f2c14655 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] 10.222.0.20 "GET /compute/v2.1/servers/c801676d-524f-42fc-a2b8-fe4186986d95" status: 200 len: 1522 microversion: 2.1 time: 0.433538 Jul 06 13:47:12.031538 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 184/362] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:47:11 2022] GET /compute/v2.1/servers/c801676d-524f-42fc-a2b8-fe4186986d95 => generated 1522 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 06 13:47:12.041253 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-87709031-d5e2-42d7-9110-86fe53aaa74a tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad0781ce20e54c3a9b7c61e0cccf6918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd48e24dbeaa241d7a97350fb2c8187b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:47:12.044674 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-87709031-d5e2-42d7-9110-86fe53aaa74a tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] 10.222.0.20 "GET /compute/v2.1/servers/965c7a0f-fa3f-4f5c-92bf-94d8b646a9ae" status: 200 len: 1554 microversion: 2.1 time: 0.252753 Jul 06 13:47:12.045290 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 179/363] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:47:11 2022] GET /compute/v2.1/servers/965c7a0f-fa3f-4f5c-92bf-94d8b646a9ae => generated 1554 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:47:12.091676 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [req-60cab858-a2d2-425d-931e-09f4ce6bdb6d req-fc2f0995-27f6-4a24-a440-04f2bdf08459 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0a925141-db5f-4cae-bc6c-8ca4930adf73", "tag": "e0490198-5029-4543-9a66-8d41adcd3783"}]} {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 06 13:47:12.103279 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [req-60cab858-a2d2-425d-931e-09f4ce6bdb6d req-fc2f0995-27f6-4a24-a440-04f2bdf08459 service nova] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:47:12.103998 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [req-60cab858-a2d2-425d-931e-09f4ce6bdb6d req-fc2f0995-27f6-4a24-a440-04f2bdf08459 service nova] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:47:12.123904 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.compute.server_external_events [req-60cab858-a2d2-425d-931e-09f4ce6bdb6d req-fc2f0995-27f6-4a24-a440-04f2bdf08459 service nova] Creating event network-changed:e0490198-5029-4543-9a66-8d41adcd3783 for instance 0a925141-db5f-4cae-bc6c-8ca4930adf73 on hv-cinder-81914 Jul 06 13:47:12.130264 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [req-60cab858-a2d2-425d-931e-09f4ce6bdb6d req-fc2f0995-27f6-4a24-a440-04f2bdf08459 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042916 Jul 06 13:47:12.131503 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 185/364] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 6 13:47:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 06 13:47:12.371271 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-53e33f97-8e82-4269-b469-6718943d59e7 tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:47:12.371871 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-53e33f97-8e82-4269-b469-6718943d59e7 tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] [instance: 0a925141-db5f-4cae-bc6c-8ca4930adf73] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:47:12.377893 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-53e33f97-8e82-4269-b469-6718943d59e7 tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:47:12.378276 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-53e33f97-8e82-4269-b469-6718943d59e7 tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:47:12.379027 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-53e33f97-8e82-4269-b469-6718943d59e7 tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:47:12.379495 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-53e33f97-8e82-4269-b469-6718943d59e7 tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:47:12.416840 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-e76aaf7f-91f4-471b-9113-007d9e126572 tempest-VolumesActionsTest-262392969 tempest-VolumesActionsTest-262392969-project] Calling method '>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:47:12.417709 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-e76aaf7f-91f4-471b-9113-007d9e126572 tempest-VolumesActionsTest-262392969 tempest-VolumesActionsTest-262392969-project] [instance: 2523f283-429c-4368-afcb-3b90612bda32] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:47:12.426172 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-e76aaf7f-91f4-471b-9113-007d9e126572 tempest-VolumesActionsTest-262392969 tempest-VolumesActionsTest-262392969-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:47:12.427352 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-e76aaf7f-91f4-471b-9113-007d9e126572 tempest-VolumesActionsTest-262392969 tempest-VolumesActionsTest-262392969-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:47:12.428335 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-e76aaf7f-91f4-471b-9113-007d9e126572 tempest-VolumesActionsTest-262392969 tempest-VolumesActionsTest-262392969-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:47:12.428857 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-e76aaf7f-91f4-471b-9113-007d9e126572 tempest-VolumesActionsTest-262392969 tempest-VolumesActionsTest-262392969-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:47:12.517337 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-53e33f97-8e82-4269-b469-6718943d59e7 tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53d00e4198e240c8a5c2fbe8bd241b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1727f66e37f94cc6971b574c8635e078', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:47:12.526018 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-53e33f97-8e82-4269-b469-6718943d59e7 tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] 10.222.0.20 "GET /compute/v2.1/servers/0a925141-db5f-4cae-bc6c-8ca4930adf73" status: 200 len: 1271 microversion: 2.1 time: 0.158555 Jul 06 13:47:12.526674 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 180/365] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:47:12 2022] GET /compute/v2.1/servers/0a925141-db5f-4cae-bc6c-8ca4930adf73 => generated 1271 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:47:12.606842 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-e76aaf7f-91f4-471b-9113-007d9e126572 tempest-VolumesActionsTest-262392969 tempest-VolumesActionsTest-262392969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '050d5eb22b2c45ee85eb8c118b9ef21e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f9f86fa910c4054b31927ba26ea96b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:47:12.615008 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-e76aaf7f-91f4-471b-9113-007d9e126572 tempest-VolumesActionsTest-262392969 tempest-VolumesActionsTest-262392969-project] 10.222.0.20 "GET /compute/v2.1/servers/2523f283-429c-4368-afcb-3b90612bda32" status: 200 len: 1313 microversion: 2.1 time: 0.204956 Jul 06 13:47:12.615641 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 186/366] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:47:12 2022] GET /compute/v2.1/servers/2523f283-429c-4368-afcb-3b90612bda32 => generated 1313 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:47:13.047504 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-270ac93a-8ab1-4871-b91b-6ce5cc720c3d tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:47:13.048105 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-270ac93a-8ab1-4871-b91b-6ce5cc720c3d tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] [instance: c801676d-524f-42fc-a2b8-fe4186986d95] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:47:13.054561 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-270ac93a-8ab1-4871-b91b-6ce5cc720c3d tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:47:13.055016 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-270ac93a-8ab1-4871-b91b-6ce5cc720c3d tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:47:13.055785 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-270ac93a-8ab1-4871-b91b-6ce5cc720c3d tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:47:13.056221 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-270ac93a-8ab1-4871-b91b-6ce5cc720c3d tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:47:13.062347 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-aaf3137b-5dd2-4318-90a6-ce4b3fe122eb tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] Calling method '>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:47:13.063141 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-aaf3137b-5dd2-4318-90a6-ce4b3fe122eb tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] [instance: 965c7a0f-fa3f-4f5c-92bf-94d8b646a9ae] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:47:13.070773 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-aaf3137b-5dd2-4318-90a6-ce4b3fe122eb tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:47:13.071534 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-aaf3137b-5dd2-4318-90a6-ce4b3fe122eb tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:47:13.072307 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG dbcounter [-] [124367] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:47:13.072456 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-aaf3137b-5dd2-4318-90a6-ce4b3fe122eb tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:47:13.072938 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-aaf3137b-5dd2-4318-90a6-ce4b3fe122eb tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:47:13.202191 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-270ac93a-8ab1-4871-b91b-6ce5cc720c3d tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c83c05bec4f456d8aa7d51732ddc8af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b2a80a004e04da7ae12db9f3f87146f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:47:13.213277 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-270ac93a-8ab1-4871-b91b-6ce5cc720c3d tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] 10.222.0.20 "GET /compute/v2.1/servers/c801676d-524f-42fc-a2b8-fe4186986d95" status: 200 len: 1522 microversion: 2.1 time: 0.169286 Jul 06 13:47:13.214180 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 181/367] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:47:13 2022] GET /compute/v2.1/servers/c801676d-524f-42fc-a2b8-fe4186986d95 => generated 1522 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:47:13.248552 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-aaf3137b-5dd2-4318-90a6-ce4b3fe122eb tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad0781ce20e54c3a9b7c61e0cccf6918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd48e24dbeaa241d7a97350fb2c8187b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:47:13.257648 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-aaf3137b-5dd2-4318-90a6-ce4b3fe122eb tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] 10.222.0.20 "GET /compute/v2.1/servers/965c7a0f-fa3f-4f5c-92bf-94d8b646a9ae" status: 200 len: 1554 microversion: 2.1 time: 0.199270 Jul 06 13:47:13.258397 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 187/368] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:47:13 2022] GET /compute/v2.1/servers/965c7a0f-fa3f-4f5c-92bf-94d8b646a9ae => generated 1554 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 06 13:47:13.544968 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-1aff0de7-eb38-46f7-98dd-797140e2505b tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:47:13.545828 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-1aff0de7-eb38-46f7-98dd-797140e2505b tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] [instance: 0a925141-db5f-4cae-bc6c-8ca4930adf73] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:47:13.552544 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-1aff0de7-eb38-46f7-98dd-797140e2505b tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:47:13.553094 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-1aff0de7-eb38-46f7-98dd-797140e2505b tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:47:13.553908 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-1aff0de7-eb38-46f7-98dd-797140e2505b tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:47:13.554328 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-1aff0de7-eb38-46f7-98dd-797140e2505b tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:47:13.633379 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-a2ad82e2-2718-4512-b262-20ca5d230722 tempest-VolumesActionsTest-262392969 tempest-VolumesActionsTest-262392969-project] Calling method '>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:47:13.634139 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-a2ad82e2-2718-4512-b262-20ca5d230722 tempest-VolumesActionsTest-262392969 tempest-VolumesActionsTest-262392969-project] [instance: 2523f283-429c-4368-afcb-3b90612bda32] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:47:13.643589 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-a2ad82e2-2718-4512-b262-20ca5d230722 tempest-VolumesActionsTest-262392969 tempest-VolumesActionsTest-262392969-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:47:13.644345 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-a2ad82e2-2718-4512-b262-20ca5d230722 tempest-VolumesActionsTest-262392969 tempest-VolumesActionsTest-262392969-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:47:13.645344 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-a2ad82e2-2718-4512-b262-20ca5d230722 tempest-VolumesActionsTest-262392969 tempest-VolumesActionsTest-262392969-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:47:13.646602 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-a2ad82e2-2718-4512-b262-20ca5d230722 tempest-VolumesActionsTest-262392969 tempest-VolumesActionsTest-262392969-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:47:13.720302 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-1aff0de7-eb38-46f7-98dd-797140e2505b tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53d00e4198e240c8a5c2fbe8bd241b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1727f66e37f94cc6971b574c8635e078', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:47:13.730482 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-1aff0de7-eb38-46f7-98dd-797140e2505b tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] 10.222.0.20 "GET /compute/v2.1/servers/0a925141-db5f-4cae-bc6c-8ca4930adf73" status: 200 len: 1271 microversion: 2.1 time: 0.190607 Jul 06 13:47:13.731180 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 182/369] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:47:13 2022] GET /compute/v2.1/servers/0a925141-db5f-4cae-bc6c-8ca4930adf73 => generated 1271 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:47:13.810168 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-a2ad82e2-2718-4512-b262-20ca5d230722 tempest-VolumesActionsTest-262392969 tempest-VolumesActionsTest-262392969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '050d5eb22b2c45ee85eb8c118b9ef21e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f9f86fa910c4054b31927ba26ea96b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:47:13.820108 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-a2ad82e2-2718-4512-b262-20ca5d230722 tempest-VolumesActionsTest-262392969 tempest-VolumesActionsTest-262392969-project] 10.222.0.20 "GET /compute/v2.1/servers/2523f283-429c-4368-afcb-3b90612bda32" status: 200 len: 1313 microversion: 2.1 time: 0.192471 Jul 06 13:47:13.823133 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 188/370] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:47:13 2022] GET /compute/v2.1/servers/2523f283-429c-4368-afcb-3b90612bda32 => generated 1313 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 06 13:47:14.229808 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-fd7f796c-1581-4065-ad93-76c80ebc3a38 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:47:14.230407 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-fd7f796c-1581-4065-ad93-76c80ebc3a38 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] [instance: c801676d-524f-42fc-a2b8-fe4186986d95] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:47:14.236693 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-fd7f796c-1581-4065-ad93-76c80ebc3a38 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:47:14.237363 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-fd7f796c-1581-4065-ad93-76c80ebc3a38 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:47:14.239249 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-fd7f796c-1581-4065-ad93-76c80ebc3a38 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:47:14.239903 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-fd7f796c-1581-4065-ad93-76c80ebc3a38 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:47:14.277134 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-ce40a746-97a4-4ccb-8588-643c4744b020 tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] Calling method '>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:47:14.278627 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-ce40a746-97a4-4ccb-8588-643c4744b020 tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] [instance: 965c7a0f-fa3f-4f5c-92bf-94d8b646a9ae] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:47:14.287826 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-ce40a746-97a4-4ccb-8588-643c4744b020 tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:47:14.288553 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-ce40a746-97a4-4ccb-8588-643c4744b020 tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:47:14.295878 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-ce40a746-97a4-4ccb-8588-643c4744b020 tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:47:14.297668 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-ce40a746-97a4-4ccb-8588-643c4744b020 tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:47:14.459162 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-fd7f796c-1581-4065-ad93-76c80ebc3a38 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c83c05bec4f456d8aa7d51732ddc8af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b2a80a004e04da7ae12db9f3f87146f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:47:14.466955 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-fd7f796c-1581-4065-ad93-76c80ebc3a38 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] 10.222.0.20 "GET /compute/v2.1/servers/c801676d-524f-42fc-a2b8-fe4186986d95" status: 200 len: 1522 microversion: 2.1 time: 0.240903 Jul 06 13:47:14.467531 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 183/371] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:47:14 2022] GET /compute/v2.1/servers/c801676d-524f-42fc-a2b8-fe4186986d95 => generated 1522 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:47:14.565547 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-ce40a746-97a4-4ccb-8588-643c4744b020 tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad0781ce20e54c3a9b7c61e0cccf6918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd48e24dbeaa241d7a97350fb2c8187b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:47:14.577225 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-ce40a746-97a4-4ccb-8588-643c4744b020 tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] 10.222.0.20 "GET /compute/v2.1/servers/965c7a0f-fa3f-4f5c-92bf-94d8b646a9ae" status: 200 len: 1554 microversion: 2.1 time: 0.305486 Jul 06 13:47:14.577802 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 189/372] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:47:14 2022] GET /compute/v2.1/servers/965c7a0f-fa3f-4f5c-92bf-94d8b646a9ae => generated 1554 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 06 13:47:14.747327 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-972580da-1e83-426b-8c80-00aa7f488a6b tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:47:14.748486 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-972580da-1e83-426b-8c80-00aa7f488a6b tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] [instance: 0a925141-db5f-4cae-bc6c-8ca4930adf73] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:47:14.754801 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-972580da-1e83-426b-8c80-00aa7f488a6b tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:47:14.755475 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-972580da-1e83-426b-8c80-00aa7f488a6b tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:47:14.756244 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-972580da-1e83-426b-8c80-00aa7f488a6b tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:47:14.756678 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-972580da-1e83-426b-8c80-00aa7f488a6b tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:47:14.840332 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-6b7c3cde-0aab-44a8-b2d0-6b59569bba25 tempest-VolumesActionsTest-262392969 tempest-VolumesActionsTest-262392969-project] Calling method '>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:47:14.840989 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-6b7c3cde-0aab-44a8-b2d0-6b59569bba25 tempest-VolumesActionsTest-262392969 tempest-VolumesActionsTest-262392969-project] [instance: 2523f283-429c-4368-afcb-3b90612bda32] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:47:14.848074 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-6b7c3cde-0aab-44a8-b2d0-6b59569bba25 tempest-VolumesActionsTest-262392969 tempest-VolumesActionsTest-262392969-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:47:14.849035 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-6b7c3cde-0aab-44a8-b2d0-6b59569bba25 tempest-VolumesActionsTest-262392969 tempest-VolumesActionsTest-262392969-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:47:14.850211 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-6b7c3cde-0aab-44a8-b2d0-6b59569bba25 tempest-VolumesActionsTest-262392969 tempest-VolumesActionsTest-262392969-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:47:14.851133 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-6b7c3cde-0aab-44a8-b2d0-6b59569bba25 tempest-VolumesActionsTest-262392969 tempest-VolumesActionsTest-262392969-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:47:14.906763 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-972580da-1e83-426b-8c80-00aa7f488a6b tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53d00e4198e240c8a5c2fbe8bd241b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1727f66e37f94cc6971b574c8635e078', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:47:14.915288 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-972580da-1e83-426b-8c80-00aa7f488a6b tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] 10.222.0.20 "GET /compute/v2.1/servers/0a925141-db5f-4cae-bc6c-8ca4930adf73" status: 200 len: 1271 microversion: 2.1 time: 0.171791 Jul 06 13:47:14.916173 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 184/373] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:47:14 2022] GET /compute/v2.1/servers/0a925141-db5f-4cae-bc6c-8ca4930adf73 => generated 1271 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:47:15.000239 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-6b7c3cde-0aab-44a8-b2d0-6b59569bba25 tempest-VolumesActionsTest-262392969 tempest-VolumesActionsTest-262392969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '050d5eb22b2c45ee85eb8c118b9ef21e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f9f86fa910c4054b31927ba26ea96b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:47:15.008006 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-6b7c3cde-0aab-44a8-b2d0-6b59569bba25 tempest-VolumesActionsTest-262392969 tempest-VolumesActionsTest-262392969-project] 10.222.0.20 "GET /compute/v2.1/servers/2523f283-429c-4368-afcb-3b90612bda32" status: 200 len: 1497 microversion: 2.1 time: 0.171780 Jul 06 13:47:15.008576 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 190/374] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:47:14 2022] GET /compute/v2.1/servers/2523f283-429c-4368-afcb-3b90612bda32 => generated 1497 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:47:15.489949 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-f4dad85b-a987-4136-9a0a-b47c26437e3e tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:47:15.490893 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-f4dad85b-a987-4136-9a0a-b47c26437e3e tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] [instance: c801676d-524f-42fc-a2b8-fe4186986d95] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:47:15.492721 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG dbcounter [-] [124367] Writing DB stats nova_cell0:SELECT=2 {{(pid=124367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:47:15.498700 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-f4dad85b-a987-4136-9a0a-b47c26437e3e tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:47:15.499201 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-f4dad85b-a987-4136-9a0a-b47c26437e3e tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:47:15.500129 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-f4dad85b-a987-4136-9a0a-b47c26437e3e tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:47:15.500730 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-f4dad85b-a987-4136-9a0a-b47c26437e3e tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:47:15.518054 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG dbcounter [-] [124367] Writing DB stats nova_cell0:SELECT=8 {{(pid=124367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:47:15.598022 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-27c174ac-a264-47ba-a335-290b93bd8b0d tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] Calling method '>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:47:15.600818 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-27c174ac-a264-47ba-a335-290b93bd8b0d tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] [instance: 965c7a0f-fa3f-4f5c-92bf-94d8b646a9ae] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:47:15.614058 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-27c174ac-a264-47ba-a335-290b93bd8b0d tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:47:15.614981 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-27c174ac-a264-47ba-a335-290b93bd8b0d tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:47:15.616058 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-27c174ac-a264-47ba-a335-290b93bd8b0d tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:47:15.616882 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-27c174ac-a264-47ba-a335-290b93bd8b0d tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:47:15.715406 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-f4dad85b-a987-4136-9a0a-b47c26437e3e tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c83c05bec4f456d8aa7d51732ddc8af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b2a80a004e04da7ae12db9f3f87146f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:47:15.732182 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-f4dad85b-a987-4136-9a0a-b47c26437e3e tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] 10.222.0.20 "GET /compute/v2.1/servers/c801676d-524f-42fc-a2b8-fe4186986d95" status: 200 len: 1522 microversion: 2.1 time: 0.246876 Jul 06 13:47:15.733253 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 185/375] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:47:15 2022] GET /compute/v2.1/servers/c801676d-524f-42fc-a2b8-fe4186986d95 => generated 1522 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:47:15.783798 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-6b4a236e-9ef4-41fd-bc5f-1f2893ba8460 tempest-VolumesActionsTest-262392969 tempest-VolumesActionsTest-262392969-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:47:15.785090 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-6b4a236e-9ef4-41fd-bc5f-1f2893ba8460 tempest-VolumesActionsTest-262392969 tempest-VolumesActionsTest-262392969-project] [instance: 2523f283-429c-4368-afcb-3b90612bda32] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:47:15.792837 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-6b4a236e-9ef4-41fd-bc5f-1f2893ba8460 tempest-VolumesActionsTest-262392969 tempest-VolumesActionsTest-262392969-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:47:15.793992 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-6b4a236e-9ef4-41fd-bc5f-1f2893ba8460 tempest-VolumesActionsTest-262392969 tempest-VolumesActionsTest-262392969-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:47:15.795165 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-6b4a236e-9ef4-41fd-bc5f-1f2893ba8460 tempest-VolumesActionsTest-262392969 tempest-VolumesActionsTest-262392969-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:47:15.796199 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-6b4a236e-9ef4-41fd-bc5f-1f2893ba8460 tempest-VolumesActionsTest-262392969 tempest-VolumesActionsTest-262392969-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:47:15.829744 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-6b4a236e-9ef4-41fd-bc5f-1f2893ba8460 tempest-VolumesActionsTest-262392969 tempest-VolumesActionsTest-262392969-project] [instance: 2523f283-429c-4368-afcb-3b90612bda32] Going to try to terminate instance {{(pid=124367) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 06 13:47:15.969337 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-6b4a236e-9ef4-41fd-bc5f-1f2893ba8460 tempest-VolumesActionsTest-262392969 tempest-VolumesActionsTest-262392969-project] 10.222.0.20 "DELETE /compute/v2.1/servers/2523f283-429c-4368-afcb-3b90612bda32" status: 204 len: 0 microversion: 2.1 time: 0.191785 Jul 06 13:47:15.970378 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 186/376] 10.222.0.20 () {58 vars in 1238 bytes} [Wed Jul 6 13:47:15 2022] DELETE /compute/v2.1/servers/2523f283-429c-4368-afcb-3b90612bda32 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 06 13:47:15.977925 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-07bee8b8-af87-4704-a316-b835e176c9d3 tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:47:15.978707 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-07bee8b8-af87-4704-a316-b835e176c9d3 tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] [instance: 0a925141-db5f-4cae-bc6c-8ca4930adf73] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:47:15.984817 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-07bee8b8-af87-4704-a316-b835e176c9d3 tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:47:15.985303 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-07bee8b8-af87-4704-a316-b835e176c9d3 tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:47:15.986079 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-07bee8b8-af87-4704-a316-b835e176c9d3 tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:47:15.986533 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-07bee8b8-af87-4704-a316-b835e176c9d3 tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:47:16.161897 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-27c174ac-a264-47ba-a335-290b93bd8b0d tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad0781ce20e54c3a9b7c61e0cccf6918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd48e24dbeaa241d7a97350fb2c8187b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:47:16.168222 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-07bee8b8-af87-4704-a316-b835e176c9d3 tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53d00e4198e240c8a5c2fbe8bd241b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1727f66e37f94cc6971b574c8635e078', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:47:16.169987 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-27c174ac-a264-47ba-a335-290b93bd8b0d tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] 10.222.0.20 "GET /compute/v2.1/servers/965c7a0f-fa3f-4f5c-92bf-94d8b646a9ae" status: 200 len: 1554 microversion: 2.1 time: 0.578843 Jul 06 13:47:16.170563 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 191/377] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:47:15 2022] GET /compute/v2.1/servers/965c7a0f-fa3f-4f5c-92bf-94d8b646a9ae => generated 1554 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:47:16.185072 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-57e2664e-b326-4f16-a551-67df8f022904 tempest-VolumesActionsTest-262392969 tempest-VolumesActionsTest-262392969-project] Calling method '>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:47:16.186208 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-57e2664e-b326-4f16-a551-67df8f022904 tempest-VolumesActionsTest-262392969 tempest-VolumesActionsTest-262392969-project] [instance: 2523f283-429c-4368-afcb-3b90612bda32] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:47:16.193649 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-57e2664e-b326-4f16-a551-67df8f022904 tempest-VolumesActionsTest-262392969 tempest-VolumesActionsTest-262392969-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:47:16.194389 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-57e2664e-b326-4f16-a551-67df8f022904 tempest-VolumesActionsTest-262392969 tempest-VolumesActionsTest-262392969-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:47:16.195315 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-57e2664e-b326-4f16-a551-67df8f022904 tempest-VolumesActionsTest-262392969 tempest-VolumesActionsTest-262392969-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:47:16.195930 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-57e2664e-b326-4f16-a551-67df8f022904 tempest-VolumesActionsTest-262392969 tempest-VolumesActionsTest-262392969-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:47:16.211353 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-07bee8b8-af87-4704-a316-b835e176c9d3 tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] 10.222.0.20 "GET /compute/v2.1/servers/0a925141-db5f-4cae-bc6c-8ca4930adf73" status: 200 len: 1259 microversion: 2.1 time: 0.239687 Jul 06 13:47:16.212189 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 187/378] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:47:15 2022] GET /compute/v2.1/servers/0a925141-db5f-4cae-bc6c-8ca4930adf73 => generated 1259 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:47:16.416385 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-57e2664e-b326-4f16-a551-67df8f022904 tempest-VolumesActionsTest-262392969 tempest-VolumesActionsTest-262392969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '050d5eb22b2c45ee85eb8c118b9ef21e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f9f86fa910c4054b31927ba26ea96b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:47:16.424142 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-57e2664e-b326-4f16-a551-67df8f022904 tempest-VolumesActionsTest-262392969 tempest-VolumesActionsTest-262392969-project] 10.222.0.20 "GET /compute/v2.1/servers/2523f283-429c-4368-afcb-3b90612bda32" status: 200 len: 1503 microversion: 2.1 time: 0.252634 Jul 06 13:47:16.424711 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 192/379] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:47:16 2022] GET /compute/v2.1/servers/2523f283-429c-4368-afcb-3b90612bda32 => generated 1503 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:47:16.677660 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [req-42d2cb9e-2ed7-4c4f-a138-89b757f20f43 req-f90fbc4c-cd8b-42ae-8469-430435400208 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "965c7a0f-fa3f-4f5c-92bf-94d8b646a9ae", "name": "network-vif-deleted", "tag": "8a192dda-4324-4e22-921f-fbd7d7236d23"}]} {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 06 13:47:16.688697 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [req-42d2cb9e-2ed7-4c4f-a138-89b757f20f43 req-f90fbc4c-cd8b-42ae-8469-430435400208 service nova] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:47:16.689178 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [req-42d2cb9e-2ed7-4c4f-a138-89b757f20f43 req-f90fbc4c-cd8b-42ae-8469-430435400208 service nova] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:47:16.700613 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.compute.server_external_events [req-42d2cb9e-2ed7-4c4f-a138-89b757f20f43 req-f90fbc4c-cd8b-42ae-8469-430435400208 service nova] Creating event network-vif-deleted:8a192dda-4324-4e22-921f-fbd7d7236d23 for instance 965c7a0f-fa3f-4f5c-92bf-94d8b646a9ae on hv-cinder-81914 Jul 06 13:47:16.710764 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [req-42d2cb9e-2ed7-4c4f-a138-89b757f20f43 req-f90fbc4c-cd8b-42ae-8469-430435400208 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037545 Jul 06 13:47:16.713356 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 188/380] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 6 13:47:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 06 13:47:16.749930 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-40170196-5c35-43db-a362-892e1984ba61 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Calling method '>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:47:16.750545 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-40170196-5c35-43db-a362-892e1984ba61 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] [instance: c801676d-524f-42fc-a2b8-fe4186986d95] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:47:16.758670 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-40170196-5c35-43db-a362-892e1984ba61 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:47:16.759123 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-40170196-5c35-43db-a362-892e1984ba61 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:47:16.760012 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-40170196-5c35-43db-a362-892e1984ba61 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:47:16.760609 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-40170196-5c35-43db-a362-892e1984ba61 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:47:16.784340 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG dbcounter [-] [124368] Writing DB stats nova_cell1:SELECT=100 {{(pid=124368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:47:16.906289 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-40170196-5c35-43db-a362-892e1984ba61 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c83c05bec4f456d8aa7d51732ddc8af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b2a80a004e04da7ae12db9f3f87146f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:47:16.914367 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-40170196-5c35-43db-a362-892e1984ba61 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] 10.222.0.20 "GET /compute/v2.1/servers/c801676d-524f-42fc-a2b8-fe4186986d95" status: 200 len: 1522 microversion: 2.1 time: 0.168237 Jul 06 13:47:16.914935 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 193/381] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:47:16 2022] GET /compute/v2.1/servers/c801676d-524f-42fc-a2b8-fe4186986d95 => generated 1522 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:47:17.188779 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-30597c24-491e-4bfa-8ca1-743d639db169 tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:47:17.189706 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-30597c24-491e-4bfa-8ca1-743d639db169 tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] [instance: 965c7a0f-fa3f-4f5c-92bf-94d8b646a9ae] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:47:17.197342 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-30597c24-491e-4bfa-8ca1-743d639db169 tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:47:17.197893 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-30597c24-491e-4bfa-8ca1-743d639db169 tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:47:17.201956 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-30597c24-491e-4bfa-8ca1-743d639db169 tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:47:17.202623 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-30597c24-491e-4bfa-8ca1-743d639db169 tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:47:17.230742 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-4ab9f855-03d2-41da-a351-4acf45d6e3cb tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] Calling method '>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:47:17.231515 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-4ab9f855-03d2-41da-a351-4acf45d6e3cb tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] [instance: 0a925141-db5f-4cae-bc6c-8ca4930adf73] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:47:17.239908 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-4ab9f855-03d2-41da-a351-4acf45d6e3cb tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:47:17.240362 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-4ab9f855-03d2-41da-a351-4acf45d6e3cb tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:47:17.241179 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-4ab9f855-03d2-41da-a351-4acf45d6e3cb tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:47:17.241846 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-4ab9f855-03d2-41da-a351-4acf45d6e3cb tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:47:17.337104 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-30597c24-491e-4bfa-8ca1-743d639db169 tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad0781ce20e54c3a9b7c61e0cccf6918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd48e24dbeaa241d7a97350fb2c8187b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:47:17.346867 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-30597c24-491e-4bfa-8ca1-743d639db169 tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] 10.222.0.20 "GET /compute/v2.1/servers/965c7a0f-fa3f-4f5c-92bf-94d8b646a9ae" status: 200 len: 1512 microversion: 2.1 time: 0.163074 Jul 06 13:47:17.347439 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 189/382] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:47:17 2022] GET /compute/v2.1/servers/965c7a0f-fa3f-4f5c-92bf-94d8b646a9ae => generated 1512 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:47:17.419096 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-4ab9f855-03d2-41da-a351-4acf45d6e3cb tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53d00e4198e240c8a5c2fbe8bd241b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1727f66e37f94cc6971b574c8635e078', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:47:17.427774 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-4ab9f855-03d2-41da-a351-4acf45d6e3cb tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] 10.222.0.20 "GET /compute/v2.1/servers/0a925141-db5f-4cae-bc6c-8ca4930adf73" status: 200 len: 1259 microversion: 2.1 time: 0.201732 Jul 06 13:47:17.428438 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 194/383] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:47:17 2022] GET /compute/v2.1/servers/0a925141-db5f-4cae-bc6c-8ca4930adf73 => generated 1259 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 06 13:47:17.443756 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-a8dd658e-1198-4ffb-b6e6-efe54bc64de8 tempest-VolumesActionsTest-262392969 tempest-VolumesActionsTest-262392969-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:47:17.444974 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-a8dd658e-1198-4ffb-b6e6-efe54bc64de8 tempest-VolumesActionsTest-262392969 tempest-VolumesActionsTest-262392969-project] [instance: 2523f283-429c-4368-afcb-3b90612bda32] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:47:17.453086 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-a8dd658e-1198-4ffb-b6e6-efe54bc64de8 tempest-VolumesActionsTest-262392969 tempest-VolumesActionsTest-262392969-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:47:17.453792 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-a8dd658e-1198-4ffb-b6e6-efe54bc64de8 tempest-VolumesActionsTest-262392969 tempest-VolumesActionsTest-262392969-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:47:17.455083 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-a8dd658e-1198-4ffb-b6e6-efe54bc64de8 tempest-VolumesActionsTest-262392969 tempest-VolumesActionsTest-262392969-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:47:17.456012 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-a8dd658e-1198-4ffb-b6e6-efe54bc64de8 tempest-VolumesActionsTest-262392969 tempest-VolumesActionsTest-262392969-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:47:17.619948 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-a8dd658e-1198-4ffb-b6e6-efe54bc64de8 tempest-VolumesActionsTest-262392969 tempest-VolumesActionsTest-262392969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '050d5eb22b2c45ee85eb8c118b9ef21e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f9f86fa910c4054b31927ba26ea96b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:47:17.630474 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-a8dd658e-1198-4ffb-b6e6-efe54bc64de8 tempest-VolumesActionsTest-262392969 tempest-VolumesActionsTest-262392969-project] 10.222.0.20 "GET /compute/v2.1/servers/2523f283-429c-4368-afcb-3b90612bda32" status: 200 len: 1503 microversion: 2.1 time: 0.192182 Jul 06 13:47:17.631048 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 190/384] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:47:17 2022] GET /compute/v2.1/servers/2523f283-429c-4368-afcb-3b90612bda32 => generated 1503 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:47:17.931189 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-98d06385-d136-4ce1-943e-ba5f4f5c612c tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Calling method '>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:47:17.932617 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-98d06385-d136-4ce1-943e-ba5f4f5c612c tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] [instance: c801676d-524f-42fc-a2b8-fe4186986d95] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:47:17.944686 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-98d06385-d136-4ce1-943e-ba5f4f5c612c tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:47:17.945410 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-98d06385-d136-4ce1-943e-ba5f4f5c612c tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:47:17.946390 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-98d06385-d136-4ce1-943e-ba5f4f5c612c tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:47:17.946836 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-98d06385-d136-4ce1-943e-ba5f4f5c612c tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:47:18.316310 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-98d06385-d136-4ce1-943e-ba5f4f5c612c tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c83c05bec4f456d8aa7d51732ddc8af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b2a80a004e04da7ae12db9f3f87146f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:47:18.327423 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-98d06385-d136-4ce1-943e-ba5f4f5c612c tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] 10.222.0.20 "GET /compute/v2.1/servers/c801676d-524f-42fc-a2b8-fe4186986d95" status: 200 len: 1522 microversion: 2.1 time: 0.400240 Jul 06 13:47:18.328848 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 195/385] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:47:17 2022] GET /compute/v2.1/servers/c801676d-524f-42fc-a2b8-fe4186986d95 => generated 1522 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:47:18.365238 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-00c5e35d-aaf1-4b94-9b94-4c71debd5808 tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:47:18.365864 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-00c5e35d-aaf1-4b94-9b94-4c71debd5808 tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] [instance: 965c7a0f-fa3f-4f5c-92bf-94d8b646a9ae] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:47:18.380387 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-00c5e35d-aaf1-4b94-9b94-4c71debd5808 tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:47:18.380847 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-00c5e35d-aaf1-4b94-9b94-4c71debd5808 tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:47:18.381642 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-00c5e35d-aaf1-4b94-9b94-4c71debd5808 tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:47:18.382079 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-00c5e35d-aaf1-4b94-9b94-4c71debd5808 tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:47:18.426904 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-00c5e35d-aaf1-4b94-9b94-4c71debd5808 tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:47:18.427419 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-00c5e35d-aaf1-4b94-9b94-4c71debd5808 tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:47:18.427954 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.objects.instance [None req-00c5e35d-aaf1-4b94-9b94-4c71debd5808 tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] Lazy-loading 'fault' on Instance uuid 965c7a0f-fa3f-4f5c-92bf-94d8b646a9ae {{(pid=124367) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 06 13:47:18.445958 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-1c10df9f-3a19-425b-b272-9d9de6007c16 tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] Calling method '>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:47:18.446679 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-1c10df9f-3a19-425b-b272-9d9de6007c16 tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] [instance: 0a925141-db5f-4cae-bc6c-8ca4930adf73] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:47:18.461418 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-1c10df9f-3a19-425b-b272-9d9de6007c16 tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:47:18.463114 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-1c10df9f-3a19-425b-b272-9d9de6007c16 tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:47:18.464142 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-1c10df9f-3a19-425b-b272-9d9de6007c16 tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:47:18.468599 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-1c10df9f-3a19-425b-b272-9d9de6007c16 tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:47:18.483479 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-00c5e35d-aaf1-4b94-9b94-4c71debd5808 tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad0781ce20e54c3a9b7c61e0cccf6918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd48e24dbeaa241d7a97350fb2c8187b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:47:18.494594 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-00c5e35d-aaf1-4b94-9b94-4c71debd5808 tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] 10.222.0.20 "GET /compute/v2.1/servers/965c7a0f-fa3f-4f5c-92bf-94d8b646a9ae" status: 200 len: 1350 microversion: 2.1 time: 0.133824 Jul 06 13:47:18.495522 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 191/386] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:47:18 2022] GET /compute/v2.1/servers/965c7a0f-fa3f-4f5c-92bf-94d8b646a9ae => generated 1350 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:47:18.647766 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-971c233c-6574-4672-b20b-d5ef89f1e5e5 tempest-VolumesActionsTest-262392969 tempest-VolumesActionsTest-262392969-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:47:18.648563 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-971c233c-6574-4672-b20b-d5ef89f1e5e5 tempest-VolumesActionsTest-262392969 tempest-VolumesActionsTest-262392969-project] [instance: 2523f283-429c-4368-afcb-3b90612bda32] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:47:18.661507 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-971c233c-6574-4672-b20b-d5ef89f1e5e5 tempest-VolumesActionsTest-262392969 tempest-VolumesActionsTest-262392969-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:47:18.662803 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-971c233c-6574-4672-b20b-d5ef89f1e5e5 tempest-VolumesActionsTest-262392969 tempest-VolumesActionsTest-262392969-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:47:18.663644 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-971c233c-6574-4672-b20b-d5ef89f1e5e5 tempest-VolumesActionsTest-262392969 tempest-VolumesActionsTest-262392969-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:47:18.664683 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-971c233c-6574-4672-b20b-d5ef89f1e5e5 tempest-VolumesActionsTest-262392969 tempest-VolumesActionsTest-262392969-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:47:18.771431 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-1c10df9f-3a19-425b-b272-9d9de6007c16 tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53d00e4198e240c8a5c2fbe8bd241b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1727f66e37f94cc6971b574c8635e078', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:47:18.779484 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-1c10df9f-3a19-425b-b272-9d9de6007c16 tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] 10.222.0.20 "GET /compute/v2.1/servers/0a925141-db5f-4cae-bc6c-8ca4930adf73" status: 200 len: 1259 microversion: 2.1 time: 0.339473 Jul 06 13:47:18.780412 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 196/387] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:47:18 2022] GET /compute/v2.1/servers/0a925141-db5f-4cae-bc6c-8ca4930adf73 => generated 1259 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:47:18.914872 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-971c233c-6574-4672-b20b-d5ef89f1e5e5 tempest-VolumesActionsTest-262392969 tempest-VolumesActionsTest-262392969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '050d5eb22b2c45ee85eb8c118b9ef21e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f9f86fa910c4054b31927ba26ea96b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:47:18.926408 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-971c233c-6574-4672-b20b-d5ef89f1e5e5 tempest-VolumesActionsTest-262392969 tempest-VolumesActionsTest-262392969-project] 10.222.0.20 "GET /compute/v2.1/servers/2523f283-429c-4368-afcb-3b90612bda32" status: 200 len: 1503 microversion: 2.1 time: 0.282948 Jul 06 13:47:18.928010 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 192/388] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:47:18 2022] GET /compute/v2.1/servers/2523f283-429c-4368-afcb-3b90612bda32 => generated 1503 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:47:19.048930 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [req-978c64c8-bede-4db8-9e15-c5e35bd44c8b req-f95920dc-3377-49ec-82da-39b5342e7fd7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2523f283-429c-4368-afcb-3b90612bda32", "name": "network-vif-deleted", "tag": "1b189fe2-44ff-40f9-b88f-0090e1f1bcdc"}]} {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 06 13:47:19.060550 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG dbcounter [-] [124368] Writing DB stats nova_api:SELECT=82 {{(pid=124368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:47:19.067006 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [req-978c64c8-bede-4db8-9e15-c5e35bd44c8b req-f95920dc-3377-49ec-82da-39b5342e7fd7 service nova] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:47:19.067774 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [req-978c64c8-bede-4db8-9e15-c5e35bd44c8b req-f95920dc-3377-49ec-82da-39b5342e7fd7 service nova] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:47:19.082076 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.compute.server_external_events [req-978c64c8-bede-4db8-9e15-c5e35bd44c8b req-f95920dc-3377-49ec-82da-39b5342e7fd7 service nova] Creating event network-vif-deleted:1b189fe2-44ff-40f9-b88f-0090e1f1bcdc for instance 2523f283-429c-4368-afcb-3b90612bda32 on hv-cinder-81914 Jul 06 13:47:19.088739 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [req-978c64c8-bede-4db8-9e15-c5e35bd44c8b req-f95920dc-3377-49ec-82da-39b5342e7fd7 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043550 Jul 06 13:47:19.089774 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 197/389] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 6 13:47:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 06 13:47:19.351395 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-a4a05f11-baf3-47dd-bce7-c3c61747a299 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:47:19.352271 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-a4a05f11-baf3-47dd-bce7-c3c61747a299 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] [instance: c801676d-524f-42fc-a2b8-fe4186986d95] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:47:19.358664 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-a4a05f11-baf3-47dd-bce7-c3c61747a299 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:47:19.359498 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-a4a05f11-baf3-47dd-bce7-c3c61747a299 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:47:19.360894 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-a4a05f11-baf3-47dd-bce7-c3c61747a299 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:47:19.361453 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-a4a05f11-baf3-47dd-bce7-c3c61747a299 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:47:19.515181 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-a664da7b-6564-44a3-b5ed-9dc518454f94 tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] Calling method '>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:47:19.516644 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-a664da7b-6564-44a3-b5ed-9dc518454f94 tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] [instance: 965c7a0f-fa3f-4f5c-92bf-94d8b646a9ae] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:47:19.527514 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-a664da7b-6564-44a3-b5ed-9dc518454f94 tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:47:19.528351 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-a664da7b-6564-44a3-b5ed-9dc518454f94 tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:47:19.529680 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-a664da7b-6564-44a3-b5ed-9dc518454f94 tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:47:19.530287 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-a664da7b-6564-44a3-b5ed-9dc518454f94 tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:47:19.555410 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.wsgi [None req-a664da7b-6564-44a3-b5ed-9dc518454f94 tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] HTTP exception thrown: Instance 965c7a0f-fa3f-4f5c-92bf-94d8b646a9ae could not be found. Jul 06 13:47:19.569333 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-a664da7b-6564-44a3-b5ed-9dc518454f94 tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] Request method failure captured: Jul 06 13:47:19.569333 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: request: GET /compute/v2.1/servers/965c7a0f-fa3f-4f5c-92bf-94d8b646a9ae HTTP/1.1 Jul 06 13:47:19.569333 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: Accept: application/json Jul 06 13:47:19.569333 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: Accept-Encoding: identity Jul 06 13:47:19.569333 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: Connection: close Jul 06 13:47:19.569333 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: Content-Length: 0 Jul 06 13:47:19.569333 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: Content-Type: application/json Jul 06 13:47:19.569333 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: Host: 10.222.0.20 Jul 06 13:47:19.569333 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: Openstack-System-Scope: None Jul 06 13:47:19.569333 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: User-Agent: python-urllib3/1.26.9 Jul 06 13:47:19.569333 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Auth-Token: gAAAAABixZH0WI9rjekSh7MCB1udKPSPIoB1OuQgzwz9AGRt8Q70NNIo-Dck0nunFMThz8_mavFcbA7gYjfpoQlNicdQ__YHYcQh_6UVWUBmHcsQa9qOy4yXY9vOhz7HdXt4cDdy6e8Q9-Uk6eEeaRrtT2RfrwTmdP_OYv-YNNjc7Z8P_9_oEiI Jul 06 13:47:19.569333 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Domain-Id: None Jul 06 13:47:19.569333 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Domain-Name: None Jul 06 13:47:19.569333 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Identity-Status: Confirmed Jul 06 13:47:19.569333 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Is-Admin-Project: True Jul 06 13:47:19.569333 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Project-Domain-Id: default Jul 06 13:47:19.569333 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Project-Domain-Name: Default Jul 06 13:47:19.569333 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Project-Id: d48e24dbeaa241d7a97350fb2c8187b9 Jul 06 13:47:19.569333 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Project-Name: tempest-DeleteServersTestJSON-1274250159 Jul 06 13:47:19.569333 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Role: reader,member Jul 06 13:47:19.569333 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Roles: reader,member Jul 06 13:47:19.570652 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_d48e24dbeaa241d7a97350fb2c8187b9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d48e24dbeaa241d7a97350fb2c8187b9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d48e24dbeaa241d7a97350fb2c8187b9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/d48e24dbeaa241d7a97350fb2c8187b9"}]}] Jul 06 13:47:19.570652 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Tenant: tempest-DeleteServersTestJSON-1274250159 Jul 06 13:47:19.570652 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Tenant-Id: d48e24dbeaa241d7a97350fb2c8187b9 Jul 06 13:47:19.570652 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Tenant-Name: tempest-DeleteServersTestJSON-1274250159 Jul 06 13:47:19.570652 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-User: tempest-DeleteServersTestJSON-1274250159-project Jul 06 13:47:19.570652 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-User-Domain-Id: default Jul 06 13:47:19.570652 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-User-Domain-Name: Default Jul 06 13:47:19.570652 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-User-Id: ad0781ce20e54c3a9b7c61e0cccf6918 Jul 06 13:47:19.570652 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-User-Name: tempest-DeleteServersTestJSON-1274250159-project Jul 06 13:47:19.570652 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: method: > Jul 06 13:47:19.570652 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: exception: Instance 965c7a0f-fa3f-4f5c-92bf-94d8b646a9ae could not be found. Jul 06 13:47:19.570652 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: action_args: {'id': '965c7a0f-fa3f-4f5c-92bf-94d8b646a9ae'} Jul 06 13:47:19.571344 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 06 13:47:19.571344 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 06 13:47:19.571344 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 06 13:47:19.571344 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 06 13:47:19.571344 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 06 13:47:19.571344 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 06 13:47:19.571344 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 06 13:47:19.571344 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 06 13:47:19.571344 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 06 13:47:19.571344 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 06 13:47:19.571344 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 965c7a0f-fa3f-4f5c-92bf-94d8b646a9ae could not be found. Jul 06 13:47:19.571344 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi Jul 06 13:47:19.571344 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 06 13:47:19.571344 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi Jul 06 13:47:19.571344 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 06 13:47:19.571344 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 06 13:47:19.571344 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 06 13:47:19.571344 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 06 13:47:19.571344 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 06 13:47:19.571344 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 06 13:47:19.572554 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 06 13:47:19.572554 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 06 13:47:19.572554 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 06 13:47:19.572554 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 06 13:47:19.572554 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 06 13:47:19.572554 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 06 13:47:19.572554 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 06 13:47:19.572554 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 965c7a0f-fa3f-4f5c-92bf-94d8b646a9ae could not be found. Jul 06 13:47:19.572554 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi Jul 06 13:47:19.572554 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 06 13:47:19.572554 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi Jul 06 13:47:19.572554 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 06 13:47:19.572554 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 06 13:47:19.572554 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 06 13:47:19.572554 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 06 13:47:19.572554 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 06 13:47:19.572554 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 965c7a0f-fa3f-4f5c-92bf-94d8b646a9ae could not be found. Jul 06 13:47:19.572554 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi Jul 06 13:47:19.573599 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-a664da7b-6564-44a3-b5ed-9dc518454f94 tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] Returning 404 to user: Instance 965c7a0f-fa3f-4f5c-92bf-94d8b646a9ae could not be found. {{(pid=124368) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 06 13:47:19.573599 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-a664da7b-6564-44a3-b5ed-9dc518454f94 tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] 10.222.0.20 "GET /compute/v2.1/servers/965c7a0f-fa3f-4f5c-92bf-94d8b646a9ae" status: 404 len: 111 microversion: 2.1 time: 0.061768 Jul 06 13:47:19.575614 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 198/390] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:47:19 2022] GET /compute/v2.1/servers/965c7a0f-fa3f-4f5c-92bf-94d8b646a9ae => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 06 13:47:19.713968 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-a4a05f11-baf3-47dd-bce7-c3c61747a299 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c83c05bec4f456d8aa7d51732ddc8af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b2a80a004e04da7ae12db9f3f87146f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:47:19.716864 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-e75f2551-cd38-4a07-bb6f-3bf3e7483e01 tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] Calling method '>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:47:19.717987 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-e75f2551-cd38-4a07-bb6f-3bf3e7483e01 tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] [instance: 965c7a0f-fa3f-4f5c-92bf-94d8b646a9ae] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:47:19.722012 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-a4a05f11-baf3-47dd-bce7-c3c61747a299 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] 10.222.0.20 "GET /compute/v2.1/servers/c801676d-524f-42fc-a2b8-fe4186986d95" status: 200 len: 1522 microversion: 2.1 time: 0.377326 Jul 06 13:47:19.726747 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-e75f2551-cd38-4a07-bb6f-3bf3e7483e01 tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:47:19.727388 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-e75f2551-cd38-4a07-bb6f-3bf3e7483e01 tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:47:19.728258 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-e75f2551-cd38-4a07-bb6f-3bf3e7483e01 tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:47:19.728697 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-e75f2551-cd38-4a07-bb6f-3bf3e7483e01 tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:47:19.733071 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 193/391] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:47:19 2022] GET /compute/v2.1/servers/c801676d-524f-42fc-a2b8-fe4186986d95 => generated 1522 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:47:19.744967 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.wsgi [None req-e75f2551-cd38-4a07-bb6f-3bf3e7483e01 tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] HTTP exception thrown: Instance 965c7a0f-fa3f-4f5c-92bf-94d8b646a9ae could not be found. Jul 06 13:47:19.746841 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-e75f2551-cd38-4a07-bb6f-3bf3e7483e01 tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] Request method failure captured: Jul 06 13:47:19.746841 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: request: GET /compute/v2.1/servers/965c7a0f-fa3f-4f5c-92bf-94d8b646a9ae/os-volume_attachments HTTP/1.1 Jul 06 13:47:19.746841 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: Accept: application/json Jul 06 13:47:19.746841 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: Accept-Encoding: identity Jul 06 13:47:19.746841 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: Connection: close Jul 06 13:47:19.746841 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: Content-Length: 0 Jul 06 13:47:19.746841 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: Content-Type: application/json Jul 06 13:47:19.746841 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: Host: 10.222.0.20 Jul 06 13:47:19.746841 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: Openstack-System-Scope: None Jul 06 13:47:19.746841 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: User-Agent: python-urllib3/1.26.9 Jul 06 13:47:19.746841 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Auth-Token: gAAAAABixZH0WI9rjekSh7MCB1udKPSPIoB1OuQgzwz9AGRt8Q70NNIo-Dck0nunFMThz8_mavFcbA7gYjfpoQlNicdQ__YHYcQh_6UVWUBmHcsQa9qOy4yXY9vOhz7HdXt4cDdy6e8Q9-Uk6eEeaRrtT2RfrwTmdP_OYv-YNNjc7Z8P_9_oEiI Jul 06 13:47:19.746841 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Domain-Id: None Jul 06 13:47:19.746841 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Domain-Name: None Jul 06 13:47:19.746841 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Identity-Status: Confirmed Jul 06 13:47:19.746841 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Is-Admin-Project: True Jul 06 13:47:19.746841 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Project-Domain-Id: default Jul 06 13:47:19.746841 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Project-Domain-Name: Default Jul 06 13:47:19.746841 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Project-Id: d48e24dbeaa241d7a97350fb2c8187b9 Jul 06 13:47:19.746841 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Project-Name: tempest-DeleteServersTestJSON-1274250159 Jul 06 13:47:19.746841 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Role: reader,member Jul 06 13:47:19.746841 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Roles: reader,member Jul 06 13:47:19.748298 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_d48e24dbeaa241d7a97350fb2c8187b9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d48e24dbeaa241d7a97350fb2c8187b9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d48e24dbeaa241d7a97350fb2c8187b9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/d48e24dbeaa241d7a97350fb2c8187b9"}]}] Jul 06 13:47:19.748298 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Tenant: tempest-DeleteServersTestJSON-1274250159 Jul 06 13:47:19.748298 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Tenant-Id: d48e24dbeaa241d7a97350fb2c8187b9 Jul 06 13:47:19.748298 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Tenant-Name: tempest-DeleteServersTestJSON-1274250159 Jul 06 13:47:19.748298 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-User: tempest-DeleteServersTestJSON-1274250159-project Jul 06 13:47:19.748298 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-User-Domain-Id: default Jul 06 13:47:19.748298 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-User-Domain-Name: Default Jul 06 13:47:19.748298 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-User-Id: ad0781ce20e54c3a9b7c61e0cccf6918 Jul 06 13:47:19.748298 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-User-Name: tempest-DeleteServersTestJSON-1274250159-project Jul 06 13:47:19.748298 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: method: > Jul 06 13:47:19.748298 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: exception: Instance 965c7a0f-fa3f-4f5c-92bf-94d8b646a9ae could not be found. Jul 06 13:47:19.748298 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: action_args: {'server_id': '965c7a0f-fa3f-4f5c-92bf-94d8b646a9ae'} Jul 06 13:47:19.749168 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 06 13:47:19.749168 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 06 13:47:19.749168 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 06 13:47:19.749168 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 06 13:47:19.749168 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 06 13:47:19.749168 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 06 13:47:19.749168 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 06 13:47:19.749168 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 06 13:47:19.749168 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 06 13:47:19.749168 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 06 13:47:19.749168 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 965c7a0f-fa3f-4f5c-92bf-94d8b646a9ae could not be found. Jul 06 13:47:19.749168 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi Jul 06 13:47:19.749168 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 06 13:47:19.749168 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi Jul 06 13:47:19.749168 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 06 13:47:19.749168 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 06 13:47:19.749168 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 06 13:47:19.749168 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 06 13:47:19.749168 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 06 13:47:19.749168 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 06 13:47:19.750432 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 06 13:47:19.750432 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 06 13:47:19.750432 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 06 13:47:19.750432 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 06 13:47:19.750432 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 06 13:47:19.750432 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Jul 06 13:47:19.750432 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Jul 06 13:47:19.750432 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 06 13:47:19.750432 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 06 13:47:19.750432 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 965c7a0f-fa3f-4f5c-92bf-94d8b646a9ae could not be found. Jul 06 13:47:19.750432 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi Jul 06 13:47:19.750432 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 06 13:47:19.750432 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi Jul 06 13:47:19.750432 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 06 13:47:19.750432 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 06 13:47:19.750432 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 06 13:47:19.750432 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 06 13:47:19.750432 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 06 13:47:19.750432 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 965c7a0f-fa3f-4f5c-92bf-94d8b646a9ae could not be found. Jul 06 13:47:19.750432 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi Jul 06 13:47:19.751736 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-e75f2551-cd38-4a07-bb6f-3bf3e7483e01 tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] Returning 404 to user: Instance 965c7a0f-fa3f-4f5c-92bf-94d8b646a9ae could not be found. {{(pid=124368) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 06 13:47:19.751736 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-e75f2551-cd38-4a07-bb6f-3bf3e7483e01 tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] 10.222.0.20 "GET /compute/v2.1/servers/965c7a0f-fa3f-4f5c-92bf-94d8b646a9ae/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.037626 Jul 06 13:47:19.755683 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 199/392] 10.222.0.20 () {58 vars in 1301 bytes} [Wed Jul 6 13:47:19 2022] GET /compute/v2.1/servers/965c7a0f-fa3f-4f5c-92bf-94d8b646a9ae/os-volume_attachments => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 06 13:47:19.800608 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-dfa9351e-8766-4b60-a973-3fc38b36fe7d tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:47:19.802352 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-dfa9351e-8766-4b60-a973-3fc38b36fe7d tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] [instance: 0a925141-db5f-4cae-bc6c-8ca4930adf73] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:47:19.815201 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-dfa9351e-8766-4b60-a973-3fc38b36fe7d tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:47:19.816646 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-dfa9351e-8766-4b60-a973-3fc38b36fe7d tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:47:19.818095 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-dfa9351e-8766-4b60-a973-3fc38b36fe7d tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:47:19.818772 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-dfa9351e-8766-4b60-a973-3fc38b36fe7d tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:47:19.945045 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-f18afaa7-eee6-407a-b660-6c62ed680423 tempest-VolumesActionsTest-262392969 tempest-VolumesActionsTest-262392969-project] Calling method '>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:47:19.946278 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-f18afaa7-eee6-407a-b660-6c62ed680423 tempest-VolumesActionsTest-262392969 tempest-VolumesActionsTest-262392969-project] [instance: 2523f283-429c-4368-afcb-3b90612bda32] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:47:19.955174 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-f18afaa7-eee6-407a-b660-6c62ed680423 tempest-VolumesActionsTest-262392969 tempest-VolumesActionsTest-262392969-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:47:19.956374 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-f18afaa7-eee6-407a-b660-6c62ed680423 tempest-VolumesActionsTest-262392969 tempest-VolumesActionsTest-262392969-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:47:19.958865 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-f18afaa7-eee6-407a-b660-6c62ed680423 tempest-VolumesActionsTest-262392969 tempest-VolumesActionsTest-262392969-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:47:19.960153 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-f18afaa7-eee6-407a-b660-6c62ed680423 tempest-VolumesActionsTest-262392969 tempest-VolumesActionsTest-262392969-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:47:19.996553 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-dfa9351e-8766-4b60-a973-3fc38b36fe7d tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53d00e4198e240c8a5c2fbe8bd241b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1727f66e37f94cc6971b574c8635e078', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:47:20.011271 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-dfa9351e-8766-4b60-a973-3fc38b36fe7d tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] 10.222.0.20 "GET /compute/v2.1/servers/0a925141-db5f-4cae-bc6c-8ca4930adf73" status: 200 len: 1259 microversion: 2.1 time: 0.217354 Jul 06 13:47:20.013934 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 194/393] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:47:19 2022] GET /compute/v2.1/servers/0a925141-db5f-4cae-bc6c-8ca4930adf73 => generated 1259 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:47:20.032544 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-f18afaa7-eee6-407a-b660-6c62ed680423 tempest-VolumesActionsTest-262392969 tempest-VolumesActionsTest-262392969-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:47:20.033537 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-f18afaa7-eee6-407a-b660-6c62ed680423 tempest-VolumesActionsTest-262392969 tempest-VolumesActionsTest-262392969-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:47:20.034179 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.objects.instance [None req-f18afaa7-eee6-407a-b660-6c62ed680423 tempest-VolumesActionsTest-262392969 tempest-VolumesActionsTest-262392969-project] Lazy-loading 'fault' on Instance uuid 2523f283-429c-4368-afcb-3b90612bda32 {{(pid=124368) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 06 13:47:20.276745 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-f18afaa7-eee6-407a-b660-6c62ed680423 tempest-VolumesActionsTest-262392969 tempest-VolumesActionsTest-262392969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '050d5eb22b2c45ee85eb8c118b9ef21e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f9f86fa910c4054b31927ba26ea96b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:47:20.285163 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-f18afaa7-eee6-407a-b660-6c62ed680423 tempest-VolumesActionsTest-262392969 tempest-VolumesActionsTest-262392969-project] 10.222.0.20 "GET /compute/v2.1/servers/2523f283-429c-4368-afcb-3b90612bda32" status: 200 len: 1303 microversion: 2.1 time: 0.345363 Jul 06 13:47:20.286789 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 200/394] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:47:19 2022] GET /compute/v2.1/servers/2523f283-429c-4368-afcb-3b90612bda32 => generated 1303 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 06 13:47:20.740384 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-974e5011-0e56-46f7-b086-5966503f0249 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:47:20.740994 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-974e5011-0e56-46f7-b086-5966503f0249 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] [instance: c801676d-524f-42fc-a2b8-fe4186986d95] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:47:20.755678 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-974e5011-0e56-46f7-b086-5966503f0249 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:47:20.756388 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-974e5011-0e56-46f7-b086-5966503f0249 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:47:20.760614 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-974e5011-0e56-46f7-b086-5966503f0249 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:47:20.761387 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-974e5011-0e56-46f7-b086-5966503f0249 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:47:20.926873 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-974e5011-0e56-46f7-b086-5966503f0249 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c83c05bec4f456d8aa7d51732ddc8af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b2a80a004e04da7ae12db9f3f87146f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:47:20.935180 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-974e5011-0e56-46f7-b086-5966503f0249 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] 10.222.0.20 "GET /compute/v2.1/servers/c801676d-524f-42fc-a2b8-fe4186986d95" status: 200 len: 1522 microversion: 2.1 time: 0.199171 Jul 06 13:47:20.946956 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 195/395] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:47:20 2022] GET /compute/v2.1/servers/c801676d-524f-42fc-a2b8-fe4186986d95 => generated 1522 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:47:21.036078 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-e4890439-5b27-427f-bd82-7216a3633ae2 tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] Calling method '>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:47:21.036875 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-e4890439-5b27-427f-bd82-7216a3633ae2 tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] [instance: 0a925141-db5f-4cae-bc6c-8ca4930adf73] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:47:21.051733 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-81906666-608d-4c21-945f-480c245051b2 tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:47:21.052709 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-81906666-608d-4c21-945f-480c245051b2 tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] [instance: 965c7a0f-fa3f-4f5c-92bf-94d8b646a9ae] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:47:21.060333 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-81906666-608d-4c21-945f-480c245051b2 tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:47:21.060859 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-81906666-608d-4c21-945f-480c245051b2 tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:47:21.061830 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-81906666-608d-4c21-945f-480c245051b2 tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:47:21.062730 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-81906666-608d-4c21-945f-480c245051b2 tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:47:21.083544 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-e4890439-5b27-427f-bd82-7216a3633ae2 tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:47:21.084392 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-e4890439-5b27-427f-bd82-7216a3633ae2 tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.023s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:47:21.084895 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.wsgi [None req-81906666-608d-4c21-945f-480c245051b2 tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] HTTP exception thrown: Instance 965c7a0f-fa3f-4f5c-92bf-94d8b646a9ae could not be found. Jul 06 13:47:21.085421 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-e4890439-5b27-427f-bd82-7216a3633ae2 tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:47:21.085854 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-e4890439-5b27-427f-bd82-7216a3633ae2 tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:47:21.090238 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-81906666-608d-4c21-945f-480c245051b2 tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] Request method failure captured: Jul 06 13:47:21.090238 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: request: DELETE /compute/v2.1/servers/965c7a0f-fa3f-4f5c-92bf-94d8b646a9ae HTTP/1.1 Jul 06 13:47:21.090238 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: Accept: application/json Jul 06 13:47:21.090238 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: Accept-Encoding: identity Jul 06 13:47:21.090238 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: Connection: close Jul 06 13:47:21.090238 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: Content-Length: 0 Jul 06 13:47:21.090238 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: Content-Type: application/json Jul 06 13:47:21.090238 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: Host: 10.222.0.20 Jul 06 13:47:21.090238 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: Openstack-System-Scope: None Jul 06 13:47:21.090238 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: User-Agent: python-urllib3/1.26.9 Jul 06 13:47:21.090238 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: X-Auth-Token: gAAAAABixZH0WI9rjekSh7MCB1udKPSPIoB1OuQgzwz9AGRt8Q70NNIo-Dck0nunFMThz8_mavFcbA7gYjfpoQlNicdQ__YHYcQh_6UVWUBmHcsQa9qOy4yXY9vOhz7HdXt4cDdy6e8Q9-Uk6eEeaRrtT2RfrwTmdP_OYv-YNNjc7Z8P_9_oEiI Jul 06 13:47:21.090238 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: X-Domain-Id: None Jul 06 13:47:21.090238 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: X-Domain-Name: None Jul 06 13:47:21.090238 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: X-Identity-Status: Confirmed Jul 06 13:47:21.090238 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: X-Is-Admin-Project: True Jul 06 13:47:21.090238 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: X-Project-Domain-Id: default Jul 06 13:47:21.090238 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: X-Project-Domain-Name: Default Jul 06 13:47:21.090238 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: X-Project-Id: d48e24dbeaa241d7a97350fb2c8187b9 Jul 06 13:47:21.090238 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: X-Project-Name: tempest-DeleteServersTestJSON-1274250159 Jul 06 13:47:21.090238 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: X-Role: reader,member Jul 06 13:47:21.090238 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: X-Roles: reader,member Jul 06 13:47:21.091678 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_d48e24dbeaa241d7a97350fb2c8187b9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d48e24dbeaa241d7a97350fb2c8187b9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d48e24dbeaa241d7a97350fb2c8187b9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/d48e24dbeaa241d7a97350fb2c8187b9"}]}] Jul 06 13:47:21.091678 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: X-Tenant: tempest-DeleteServersTestJSON-1274250159 Jul 06 13:47:21.091678 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: X-Tenant-Id: d48e24dbeaa241d7a97350fb2c8187b9 Jul 06 13:47:21.091678 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: X-Tenant-Name: tempest-DeleteServersTestJSON-1274250159 Jul 06 13:47:21.091678 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: X-User: tempest-DeleteServersTestJSON-1274250159-project Jul 06 13:47:21.091678 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: X-User-Domain-Id: default Jul 06 13:47:21.091678 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: X-User-Domain-Name: Default Jul 06 13:47:21.091678 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: X-User-Id: ad0781ce20e54c3a9b7c61e0cccf6918 Jul 06 13:47:21.091678 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: X-User-Name: tempest-DeleteServersTestJSON-1274250159-project Jul 06 13:47:21.091678 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: method: > Jul 06 13:47:21.091678 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: exception: Instance 965c7a0f-fa3f-4f5c-92bf-94d8b646a9ae could not be found. Jul 06 13:47:21.091678 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: action_args: {'id': '965c7a0f-fa3f-4f5c-92bf-94d8b646a9ae'} Jul 06 13:47:21.092479 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 06 13:47:21.092479 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 06 13:47:21.092479 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 06 13:47:21.092479 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 06 13:47:21.092479 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 06 13:47:21.092479 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 06 13:47:21.092479 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 06 13:47:21.092479 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 06 13:47:21.092479 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 06 13:47:21.092479 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 06 13:47:21.092479 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 965c7a0f-fa3f-4f5c-92bf-94d8b646a9ae could not be found. Jul 06 13:47:21.092479 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi Jul 06 13:47:21.092479 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 06 13:47:21.092479 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi Jul 06 13:47:21.092479 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 06 13:47:21.092479 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 06 13:47:21.092479 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 06 13:47:21.092479 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 06 13:47:21.092479 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 06 13:47:21.092479 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 06 13:47:21.094168 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 06 13:47:21.094168 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 06 13:47:21.094168 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 06 13:47:21.094168 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 06 13:47:21.094168 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 06 13:47:21.094168 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 06 13:47:21.094168 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 06 13:47:21.094168 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 06 13:47:21.094168 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 06 13:47:21.094168 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 965c7a0f-fa3f-4f5c-92bf-94d8b646a9ae could not be found. Jul 06 13:47:21.094168 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi Jul 06 13:47:21.094168 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 06 13:47:21.094168 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi Jul 06 13:47:21.094168 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 06 13:47:21.094168 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 06 13:47:21.094168 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 06 13:47:21.094168 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 06 13:47:21.094168 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 06 13:47:21.094168 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 965c7a0f-fa3f-4f5c-92bf-94d8b646a9ae could not be found. Jul 06 13:47:21.094168 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi Jul 06 13:47:21.097277 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-81906666-608d-4c21-945f-480c245051b2 tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] Returning 404 to user: Instance 965c7a0f-fa3f-4f5c-92bf-94d8b646a9ae could not be found. {{(pid=124367) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 06 13:47:21.099483 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-81906666-608d-4c21-945f-480c245051b2 tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] 10.222.0.20 "DELETE /compute/v2.1/servers/965c7a0f-fa3f-4f5c-92bf-94d8b646a9ae" status: 404 len: 111 microversion: 2.1 time: 0.053751 Jul 06 13:47:21.100798 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 196/396] 10.222.0.20 () {58 vars in 1238 bytes} [Wed Jul 6 13:47:21 2022] DELETE /compute/v2.1/servers/965c7a0f-fa3f-4f5c-92bf-94d8b646a9ae => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 06 13:47:21.112336 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-355c8678-f4d1-498c-b09d-4c0a3541f218 tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:47:21.114438 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-355c8678-f4d1-498c-b09d-4c0a3541f218 tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] [instance: 965c7a0f-fa3f-4f5c-92bf-94d8b646a9ae] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:47:21.123355 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-355c8678-f4d1-498c-b09d-4c0a3541f218 tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:47:21.124084 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-355c8678-f4d1-498c-b09d-4c0a3541f218 tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:47:21.125172 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-355c8678-f4d1-498c-b09d-4c0a3541f218 tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:47:21.125762 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-355c8678-f4d1-498c-b09d-4c0a3541f218 tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:47:21.150179 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.wsgi [None req-355c8678-f4d1-498c-b09d-4c0a3541f218 tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] HTTP exception thrown: Instance 965c7a0f-fa3f-4f5c-92bf-94d8b646a9ae could not be found. Jul 06 13:47:21.153149 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-355c8678-f4d1-498c-b09d-4c0a3541f218 tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] Request method failure captured: Jul 06 13:47:21.153149 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: request: GET /compute/v2.1/servers/965c7a0f-fa3f-4f5c-92bf-94d8b646a9ae HTTP/1.1 Jul 06 13:47:21.153149 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: Accept: application/json Jul 06 13:47:21.153149 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: Accept-Encoding: identity Jul 06 13:47:21.153149 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: Connection: close Jul 06 13:47:21.153149 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: Content-Length: 0 Jul 06 13:47:21.153149 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: Content-Type: application/json Jul 06 13:47:21.153149 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: Host: 10.222.0.20 Jul 06 13:47:21.153149 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: Openstack-System-Scope: None Jul 06 13:47:21.153149 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: User-Agent: python-urllib3/1.26.9 Jul 06 13:47:21.153149 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: X-Auth-Token: gAAAAABixZH0WI9rjekSh7MCB1udKPSPIoB1OuQgzwz9AGRt8Q70NNIo-Dck0nunFMThz8_mavFcbA7gYjfpoQlNicdQ__YHYcQh_6UVWUBmHcsQa9qOy4yXY9vOhz7HdXt4cDdy6e8Q9-Uk6eEeaRrtT2RfrwTmdP_OYv-YNNjc7Z8P_9_oEiI Jul 06 13:47:21.153149 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: X-Domain-Id: None Jul 06 13:47:21.153149 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: X-Domain-Name: None Jul 06 13:47:21.153149 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: X-Identity-Status: Confirmed Jul 06 13:47:21.153149 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: X-Is-Admin-Project: True Jul 06 13:47:21.153149 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: X-Project-Domain-Id: default Jul 06 13:47:21.153149 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: X-Project-Domain-Name: Default Jul 06 13:47:21.153149 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: X-Project-Id: d48e24dbeaa241d7a97350fb2c8187b9 Jul 06 13:47:21.153149 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: X-Project-Name: tempest-DeleteServersTestJSON-1274250159 Jul 06 13:47:21.153149 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: X-Role: reader,member Jul 06 13:47:21.153149 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: X-Roles: reader,member Jul 06 13:47:21.155543 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_d48e24dbeaa241d7a97350fb2c8187b9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d48e24dbeaa241d7a97350fb2c8187b9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d48e24dbeaa241d7a97350fb2c8187b9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/d48e24dbeaa241d7a97350fb2c8187b9"}]}] Jul 06 13:47:21.155543 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: X-Tenant: tempest-DeleteServersTestJSON-1274250159 Jul 06 13:47:21.155543 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: X-Tenant-Id: d48e24dbeaa241d7a97350fb2c8187b9 Jul 06 13:47:21.155543 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: X-Tenant-Name: tempest-DeleteServersTestJSON-1274250159 Jul 06 13:47:21.155543 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: X-User: tempest-DeleteServersTestJSON-1274250159-project Jul 06 13:47:21.155543 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: X-User-Domain-Id: default Jul 06 13:47:21.155543 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: X-User-Domain-Name: Default Jul 06 13:47:21.155543 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: X-User-Id: ad0781ce20e54c3a9b7c61e0cccf6918 Jul 06 13:47:21.155543 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: X-User-Name: tempest-DeleteServersTestJSON-1274250159-project Jul 06 13:47:21.155543 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: method: > Jul 06 13:47:21.155543 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: exception: Instance 965c7a0f-fa3f-4f5c-92bf-94d8b646a9ae could not be found. Jul 06 13:47:21.155543 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: action_args: {'id': '965c7a0f-fa3f-4f5c-92bf-94d8b646a9ae'} Jul 06 13:47:21.156842 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 06 13:47:21.156842 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 06 13:47:21.156842 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 06 13:47:21.156842 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 06 13:47:21.156842 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 06 13:47:21.156842 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 06 13:47:21.156842 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 06 13:47:21.156842 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 06 13:47:21.156842 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 06 13:47:21.156842 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 06 13:47:21.156842 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 965c7a0f-fa3f-4f5c-92bf-94d8b646a9ae could not be found. Jul 06 13:47:21.156842 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi Jul 06 13:47:21.156842 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 06 13:47:21.156842 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi Jul 06 13:47:21.156842 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 06 13:47:21.156842 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 06 13:47:21.156842 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 06 13:47:21.156842 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 06 13:47:21.156842 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 06 13:47:21.156842 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 06 13:47:21.158781 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 06 13:47:21.158781 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 06 13:47:21.158781 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 06 13:47:21.158781 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 06 13:47:21.158781 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 06 13:47:21.158781 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 06 13:47:21.158781 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 06 13:47:21.158781 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 965c7a0f-fa3f-4f5c-92bf-94d8b646a9ae could not be found. Jul 06 13:47:21.158781 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi Jul 06 13:47:21.158781 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 06 13:47:21.158781 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi Jul 06 13:47:21.158781 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 06 13:47:21.158781 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 06 13:47:21.158781 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 06 13:47:21.158781 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 06 13:47:21.158781 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 06 13:47:21.158781 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 965c7a0f-fa3f-4f5c-92bf-94d8b646a9ae could not be found. Jul 06 13:47:21.158781 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi Jul 06 13:47:21.165412 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-355c8678-f4d1-498c-b09d-4c0a3541f218 tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] Returning 404 to user: Instance 965c7a0f-fa3f-4f5c-92bf-94d8b646a9ae could not be found. {{(pid=124367) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 06 13:47:21.165412 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-355c8678-f4d1-498c-b09d-4c0a3541f218 tempest-DeleteServersTestJSON-1274250159 tempest-DeleteServersTestJSON-1274250159-project] 10.222.0.20 "GET /compute/v2.1/servers/965c7a0f-fa3f-4f5c-92bf-94d8b646a9ae" status: 404 len: 111 microversion: 2.1 time: 0.056847 Jul 06 13:47:21.165412 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 197/397] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:47:21 2022] GET /compute/v2.1/servers/965c7a0f-fa3f-4f5c-92bf-94d8b646a9ae => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 06 13:47:21.305064 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-5a49ed98-1c7a-4d8e-b289-0a1f9d4c8ef6 tempest-VolumesActionsTest-262392969 tempest-VolumesActionsTest-262392969-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:47:21.305680 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-5a49ed98-1c7a-4d8e-b289-0a1f9d4c8ef6 tempest-VolumesActionsTest-262392969 tempest-VolumesActionsTest-262392969-project] [instance: 2523f283-429c-4368-afcb-3b90612bda32] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:47:21.322030 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-5a49ed98-1c7a-4d8e-b289-0a1f9d4c8ef6 tempest-VolumesActionsTest-262392969 tempest-VolumesActionsTest-262392969-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:47:21.322332 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-5a49ed98-1c7a-4d8e-b289-0a1f9d4c8ef6 tempest-VolumesActionsTest-262392969 tempest-VolumesActionsTest-262392969-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:47:21.323464 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-5a49ed98-1c7a-4d8e-b289-0a1f9d4c8ef6 tempest-VolumesActionsTest-262392969 tempest-VolumesActionsTest-262392969-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:47:21.323902 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-5a49ed98-1c7a-4d8e-b289-0a1f9d4c8ef6 tempest-VolumesActionsTest-262392969 tempest-VolumesActionsTest-262392969-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:47:21.336511 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG dbcounter [-] [124367] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:47:21.412781 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-e4890439-5b27-427f-bd82-7216a3633ae2 tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53d00e4198e240c8a5c2fbe8bd241b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1727f66e37f94cc6971b574c8635e078', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:47:21.417483 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-5a49ed98-1c7a-4d8e-b289-0a1f9d4c8ef6 tempest-VolumesActionsTest-262392969 tempest-VolumesActionsTest-262392969-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:47:21.421287 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-5a49ed98-1c7a-4d8e-b289-0a1f9d4c8ef6 tempest-VolumesActionsTest-262392969 tempest-VolumesActionsTest-262392969-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:47:21.425754 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.objects.instance [None req-5a49ed98-1c7a-4d8e-b289-0a1f9d4c8ef6 tempest-VolumesActionsTest-262392969 tempest-VolumesActionsTest-262392969-project] Lazy-loading 'fault' on Instance uuid 2523f283-429c-4368-afcb-3b90612bda32 {{(pid=124367) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 06 13:47:21.429354 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-e4890439-5b27-427f-bd82-7216a3633ae2 tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] 10.222.0.20 "GET /compute/v2.1/servers/0a925141-db5f-4cae-bc6c-8ca4930adf73" status: 200 len: 1259 microversion: 2.1 time: 0.403131 Jul 06 13:47:21.430660 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 201/398] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:47:21 2022] GET /compute/v2.1/servers/0a925141-db5f-4cae-bc6c-8ca4930adf73 => generated 1259 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:47:21.514050 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-5a49ed98-1c7a-4d8e-b289-0a1f9d4c8ef6 tempest-VolumesActionsTest-262392969 tempest-VolumesActionsTest-262392969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '050d5eb22b2c45ee85eb8c118b9ef21e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f9f86fa910c4054b31927ba26ea96b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:47:21.528909 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-5a49ed98-1c7a-4d8e-b289-0a1f9d4c8ef6 tempest-VolumesActionsTest-262392969 tempest-VolumesActionsTest-262392969-project] 10.222.0.20 "GET /compute/v2.1/servers/2523f283-429c-4368-afcb-3b90612bda32" status: 200 len: 1303 microversion: 2.1 time: 0.225891 Jul 06 13:47:21.540404 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 198/399] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:47:21 2022] GET /compute/v2.1/servers/2523f283-429c-4368-afcb-3b90612bda32 => generated 1303 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 06 13:47:21.952819 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-09ab41db-c3cf-4527-b04f-4fa0f936578d tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Calling method '>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:47:21.953916 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-09ab41db-c3cf-4527-b04f-4fa0f936578d tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] [instance: c801676d-524f-42fc-a2b8-fe4186986d95] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:47:21.961691 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-09ab41db-c3cf-4527-b04f-4fa0f936578d tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:47:21.962420 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-09ab41db-c3cf-4527-b04f-4fa0f936578d tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:47:21.963426 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-09ab41db-c3cf-4527-b04f-4fa0f936578d tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:47:21.964009 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-09ab41db-c3cf-4527-b04f-4fa0f936578d tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:47:22.395107 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-09ab41db-c3cf-4527-b04f-4fa0f936578d tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c83c05bec4f456d8aa7d51732ddc8af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b2a80a004e04da7ae12db9f3f87146f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:47:22.403967 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-09ab41db-c3cf-4527-b04f-4fa0f936578d tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] 10.222.0.20 "GET /compute/v2.1/servers/c801676d-524f-42fc-a2b8-fe4186986d95" status: 200 len: 1522 microversion: 2.1 time: 0.455614 Jul 06 13:47:22.404669 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 202/400] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:47:21 2022] GET /compute/v2.1/servers/c801676d-524f-42fc-a2b8-fe4186986d95 => generated 1522 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:47:22.446691 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-27ef8092-5062-412b-86ce-c0b28d60fa93 tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:47:22.447898 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-27ef8092-5062-412b-86ce-c0b28d60fa93 tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] [instance: 0a925141-db5f-4cae-bc6c-8ca4930adf73] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:47:22.451180 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG dbcounter [-] [124367] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=124367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:47:22.455323 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-27ef8092-5062-412b-86ce-c0b28d60fa93 tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:47:22.455999 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-27ef8092-5062-412b-86ce-c0b28d60fa93 tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:47:22.456943 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-27ef8092-5062-412b-86ce-c0b28d60fa93 tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:47:22.457444 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-27ef8092-5062-412b-86ce-c0b28d60fa93 tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:47:22.556372 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-9fa9fca2-940f-4804-8851-467aac641793 tempest-VolumesActionsTest-262392969 tempest-VolumesActionsTest-262392969-project] Calling method '>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:47:22.557817 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-9fa9fca2-940f-4804-8851-467aac641793 tempest-VolumesActionsTest-262392969 tempest-VolumesActionsTest-262392969-project] [instance: 2523f283-429c-4368-afcb-3b90612bda32] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:47:22.564321 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-9fa9fca2-940f-4804-8851-467aac641793 tempest-VolumesActionsTest-262392969 tempest-VolumesActionsTest-262392969-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:47:22.565012 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-9fa9fca2-940f-4804-8851-467aac641793 tempest-VolumesActionsTest-262392969 tempest-VolumesActionsTest-262392969-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:47:22.565985 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-9fa9fca2-940f-4804-8851-467aac641793 tempest-VolumesActionsTest-262392969 tempest-VolumesActionsTest-262392969-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:47:22.567788 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-9fa9fca2-940f-4804-8851-467aac641793 tempest-VolumesActionsTest-262392969 tempest-VolumesActionsTest-262392969-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:47:22.583686 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.wsgi [None req-9fa9fca2-940f-4804-8851-467aac641793 tempest-VolumesActionsTest-262392969 tempest-VolumesActionsTest-262392969-project] HTTP exception thrown: Instance 2523f283-429c-4368-afcb-3b90612bda32 could not be found. Jul 06 13:47:22.585707 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-9fa9fca2-940f-4804-8851-467aac641793 tempest-VolumesActionsTest-262392969 tempest-VolumesActionsTest-262392969-project] Request method failure captured: Jul 06 13:47:22.585707 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: request: GET /compute/v2.1/servers/2523f283-429c-4368-afcb-3b90612bda32 HTTP/1.1 Jul 06 13:47:22.585707 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: Accept: application/json Jul 06 13:47:22.585707 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: Accept-Encoding: identity Jul 06 13:47:22.585707 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: Connection: close Jul 06 13:47:22.585707 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: Content-Length: 0 Jul 06 13:47:22.585707 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: Content-Type: application/json Jul 06 13:47:22.585707 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: Host: 10.222.0.20 Jul 06 13:47:22.585707 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: Openstack-System-Scope: None Jul 06 13:47:22.585707 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: User-Agent: python-urllib3/1.26.9 Jul 06 13:47:22.585707 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Auth-Token: gAAAAABixZI7S08CZ_Z2xPPc_vtcRYeEHxjf6c7ve3y6I7RiE4vYMm-NF7QXt-XS4AQ1AKRVtU7YrHK93nn3z76tZ7D7VRvtLmRCEYQLTT8P9_RH3u1EVlWyRG-4JNZ-431yP5iPGLoLxQ4yruXwTLyOc66m2Jh4gM5K-_OMNNm3ffI-9Shoytw Jul 06 13:47:22.585707 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Domain-Id: None Jul 06 13:47:22.585707 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Domain-Name: None Jul 06 13:47:22.585707 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Identity-Status: Confirmed Jul 06 13:47:22.585707 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Is-Admin-Project: True Jul 06 13:47:22.585707 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Project-Domain-Id: default Jul 06 13:47:22.585707 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Project-Domain-Name: Default Jul 06 13:47:22.585707 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Project-Id: 2f9f86fa910c4054b31927ba26ea96b9 Jul 06 13:47:22.585707 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Project-Name: tempest-VolumesActionsTest-262392969 Jul 06 13:47:22.585707 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Role: reader,member Jul 06 13:47:22.585707 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Roles: reader,member Jul 06 13:47:22.587293 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_2f9f86fa910c4054b31927ba26ea96b9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2f9f86fa910c4054b31927ba26ea96b9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2f9f86fa910c4054b31927ba26ea96b9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/2f9f86fa910c4054b31927ba26ea96b9"}]}] Jul 06 13:47:22.587293 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Tenant: tempest-VolumesActionsTest-262392969 Jul 06 13:47:22.587293 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Tenant-Id: 2f9f86fa910c4054b31927ba26ea96b9 Jul 06 13:47:22.587293 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Tenant-Name: tempest-VolumesActionsTest-262392969 Jul 06 13:47:22.587293 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-User: tempest-VolumesActionsTest-262392969-project Jul 06 13:47:22.587293 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-User-Domain-Id: default Jul 06 13:47:22.587293 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-User-Domain-Name: Default Jul 06 13:47:22.587293 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-User-Id: 050d5eb22b2c45ee85eb8c118b9ef21e Jul 06 13:47:22.587293 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-User-Name: tempest-VolumesActionsTest-262392969-project Jul 06 13:47:22.587293 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: method: > Jul 06 13:47:22.587293 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: exception: Instance 2523f283-429c-4368-afcb-3b90612bda32 could not be found. Jul 06 13:47:22.587293 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: action_args: {'id': '2523f283-429c-4368-afcb-3b90612bda32'} Jul 06 13:47:22.588122 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 06 13:47:22.588122 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 06 13:47:22.588122 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 06 13:47:22.588122 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 06 13:47:22.588122 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 06 13:47:22.588122 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 06 13:47:22.588122 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 06 13:47:22.588122 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 06 13:47:22.588122 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 06 13:47:22.588122 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 06 13:47:22.588122 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2523f283-429c-4368-afcb-3b90612bda32 could not be found. Jul 06 13:47:22.588122 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi Jul 06 13:47:22.588122 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 06 13:47:22.588122 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi Jul 06 13:47:22.588122 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 06 13:47:22.588122 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 06 13:47:22.588122 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 06 13:47:22.588122 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 06 13:47:22.588122 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 06 13:47:22.588122 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 06 13:47:22.589537 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 06 13:47:22.589537 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 06 13:47:22.589537 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 06 13:47:22.589537 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 06 13:47:22.589537 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 06 13:47:22.589537 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 06 13:47:22.589537 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 06 13:47:22.589537 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2523f283-429c-4368-afcb-3b90612bda32 could not be found. Jul 06 13:47:22.589537 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi Jul 06 13:47:22.589537 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 06 13:47:22.589537 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi Jul 06 13:47:22.589537 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 06 13:47:22.589537 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 06 13:47:22.589537 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 06 13:47:22.589537 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 06 13:47:22.589537 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 06 13:47:22.589537 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2523f283-429c-4368-afcb-3b90612bda32 could not be found. Jul 06 13:47:22.589537 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi Jul 06 13:47:22.590729 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-9fa9fca2-940f-4804-8851-467aac641793 tempest-VolumesActionsTest-262392969 tempest-VolumesActionsTest-262392969-project] Returning 404 to user: Instance 2523f283-429c-4368-afcb-3b90612bda32 could not be found. {{(pid=124368) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 06 13:47:22.590729 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-9fa9fca2-940f-4804-8851-467aac641793 tempest-VolumesActionsTest-262392969 tempest-VolumesActionsTest-262392969-project] 10.222.0.20 "GET /compute/v2.1/servers/2523f283-429c-4368-afcb-3b90612bda32" status: 404 len: 111 microversion: 2.1 time: 0.038043 Jul 06 13:47:22.594977 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 203/401] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:47:22 2022] GET /compute/v2.1/servers/2523f283-429c-4368-afcb-3b90612bda32 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 06 13:47:22.708847 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-72492494-ce57-4b75-ace0-36f457b25968 tempest-VolumesActionsTest-262392969 tempest-VolumesActionsTest-262392969-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-731700420", "imageRef": "b08481d9-1e39-41e8-97bd-b05a9c35b377", "flavorRef": "452", "networks": [{"uuid": "60bcc6e5-2a3e-4466-af92-959bc56def11"}]}} {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 06 13:47:22.724434 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-27ef8092-5062-412b-86ce-c0b28d60fa93 tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53d00e4198e240c8a5c2fbe8bd241b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1727f66e37f94cc6971b574c8635e078', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:47:22.732590 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-27ef8092-5062-412b-86ce-c0b28d60fa93 tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] 10.222.0.20 "GET /compute/v2.1/servers/0a925141-db5f-4cae-bc6c-8ca4930adf73" status: 200 len: 1259 microversion: 2.1 time: 0.289701 Jul 06 13:47:22.733198 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 199/402] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:47:22 2022] GET /compute/v2.1/servers/0a925141-db5f-4cae-bc6c-8ca4930adf73 => generated 1259 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:47:22.795244 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.network.neutron [None req-72492494-ce57-4b75-ace0-36f457b25968 tempest-VolumesActionsTest-262392969 tempest-VolumesActionsTest-262392969-project] validate_networks() for [('60bcc6e5-2a3e-4466-af92-959bc56def11', None, None, None, None, None)] {{(pid=124368) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 06 13:47:23.425157 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-0f993e41-b1d8-42cb-aa02-c36b39c732cc tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:47:23.426657 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-0f993e41-b1d8-42cb-aa02-c36b39c732cc tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] [instance: c801676d-524f-42fc-a2b8-fe4186986d95] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:47:23.451611 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-0f993e41-b1d8-42cb-aa02-c36b39c732cc tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:47:23.452328 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-0f993e41-b1d8-42cb-aa02-c36b39c732cc tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:47:23.452459 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-0f993e41-b1d8-42cb-aa02-c36b39c732cc tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:47:23.453111 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-0f993e41-b1d8-42cb-aa02-c36b39c732cc tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:47:23.825548 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-0f993e41-b1d8-42cb-aa02-c36b39c732cc tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c83c05bec4f456d8aa7d51732ddc8af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b2a80a004e04da7ae12db9f3f87146f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:47:23.835640 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-0f993e41-b1d8-42cb-aa02-c36b39c732cc tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] 10.222.0.20 "GET /compute/v2.1/servers/c801676d-524f-42fc-a2b8-fe4186986d95" status: 200 len: 1522 microversion: 2.1 time: 0.416014 Jul 06 13:47:23.836435 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 200/403] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:47:23 2022] GET /compute/v2.1/servers/c801676d-524f-42fc-a2b8-fe4186986d95 => generated 1522 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 06 13:47:23.850730 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-c6ee37db-dc03-4d05-a85d-9b6e37a2acc3 tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:47:23.851593 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-c6ee37db-dc03-4d05-a85d-9b6e37a2acc3 tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] [instance: 0a925141-db5f-4cae-bc6c-8ca4930adf73] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:47:23.866781 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-c6ee37db-dc03-4d05-a85d-9b6e37a2acc3 tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:47:23.867521 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-c6ee37db-dc03-4d05-a85d-9b6e37a2acc3 tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:47:23.868509 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-c6ee37db-dc03-4d05-a85d-9b6e37a2acc3 tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:47:23.869130 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-c6ee37db-dc03-4d05-a85d-9b6e37a2acc3 tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:47:24.188348 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.virt.hardware [None req-72492494-ce57-4b75-ace0-36f457b25968 tempest-VolumesActionsTest-262392969 tempest-VolumesActionsTest-262392969-project] Flavor limits 0:0:0 {{(pid=124368) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 06 13:47:24.188882 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.virt.hardware [None req-72492494-ce57-4b75-ace0-36f457b25968 tempest-VolumesActionsTest-262392969 tempest-VolumesActionsTest-262392969-project] Image limits 0:0:0 {{(pid=124368) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 06 13:47:24.192037 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.virt.hardware [None req-72492494-ce57-4b75-ace0-36f457b25968 tempest-VolumesActionsTest-262392969 tempest-VolumesActionsTest-262392969-project] Flavor pref 0:0:0 {{(pid=124368) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 06 13:47:24.192481 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.virt.hardware [None req-72492494-ce57-4b75-ace0-36f457b25968 tempest-VolumesActionsTest-262392969 tempest-VolumesActionsTest-262392969-project] Image pref 0:0:0 {{(pid=124368) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 06 13:47:24.192904 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.virt.hardware [None req-72492494-ce57-4b75-ace0-36f457b25968 tempest-VolumesActionsTest-262392969 tempest-VolumesActionsTest-262392969-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124368) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 06 13:47:24.209118 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-72492494-ce57-4b75-ace0-36f457b25968 tempest-VolumesActionsTest-262392969 tempest-VolumesActionsTest-262392969-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:47:24.209935 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-72492494-ce57-4b75-ace0-36f457b25968 tempest-VolumesActionsTest-262392969 tempest-VolumesActionsTest-262392969-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:47:24.210929 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-72492494-ce57-4b75-ace0-36f457b25968 tempest-VolumesActionsTest-262392969 tempest-VolumesActionsTest-262392969-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:47:24.211520 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-72492494-ce57-4b75-ace0-36f457b25968 tempest-VolumesActionsTest-262392969 tempest-VolumesActionsTest-262392969-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:47:24.236413 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.quota [None req-72492494-ce57-4b75-ace0-36f457b25968 tempest-VolumesActionsTest-262392969 tempest-VolumesActionsTest-262392969-project] Getting quotas for project 2f9f86fa910c4054b31927ba26ea96b9. Resources: {'instances', 'cores', 'ram'} {{(pid=124368) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 06 13:47:24.242276 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.quota [None req-72492494-ce57-4b75-ace0-36f457b25968 tempest-VolumesActionsTest-262392969 tempest-VolumesActionsTest-262392969-project] Getting quotas for user 050d5eb22b2c45ee85eb8c118b9ef21e and project 2f9f86fa910c4054b31927ba26ea96b9. Resources: {'instances', 'cores', 'ram'} {{(pid=124368) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 06 13:47:24.260149 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-72492494-ce57-4b75-ace0-36f457b25968 tempest-VolumesActionsTest-262392969 tempest-VolumesActionsTest-262392969-project] Going to run 1 instances... {{(pid=124368) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 06 13:47:24.263048 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-72492494-ce57-4b75-ace0-36f457b25968 tempest-VolumesActionsTest-262392969 tempest-VolumesActionsTest-262392969-project] [instance: b3afe313-9d49-40e7-afac-343f7950053e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b08481d9-1e39-41e8-97bd-b05a9c35b377',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124368) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 06 13:47:24.323685 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-72492494-ce57-4b75-ace0-36f457b25968 tempest-VolumesActionsTest-262392969 tempest-VolumesActionsTest-262392969-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.618916 Jul 06 13:47:24.329179 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 204/404] 10.222.0.20 () {60 vars in 1146 bytes} [Wed Jul 6 13:47:22 2022] POST /compute/v2.1/servers => generated 380 bytes in 1621 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 06 13:47:24.341185 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-52f805d9-10b6-47d9-b171-5026c4665b97 tempest-VolumesActionsTest-262392969 tempest-VolumesActionsTest-262392969-project] Calling method '>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:47:24.342737 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-52f805d9-10b6-47d9-b171-5026c4665b97 tempest-VolumesActionsTest-262392969 tempest-VolumesActionsTest-262392969-project] [instance: b3afe313-9d49-40e7-afac-343f7950053e] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:47:24.406560 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-c6ee37db-dc03-4d05-a85d-9b6e37a2acc3 tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53d00e4198e240c8a5c2fbe8bd241b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1727f66e37f94cc6971b574c8635e078', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:47:24.421699 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-c6ee37db-dc03-4d05-a85d-9b6e37a2acc3 tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] 10.222.0.20 "GET /compute/v2.1/servers/0a925141-db5f-4cae-bc6c-8ca4930adf73" status: 200 len: 1259 microversion: 2.1 time: 0.577914 Jul 06 13:47:24.422216 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 201/405] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:47:23 2022] GET /compute/v2.1/servers/0a925141-db5f-4cae-bc6c-8ca4930adf73 => generated 1259 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:47:24.657308 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-52f805d9-10b6-47d9-b171-5026c4665b97 tempest-VolumesActionsTest-262392969 tempest-VolumesActionsTest-262392969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '050d5eb22b2c45ee85eb8c118b9ef21e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f9f86fa910c4054b31927ba26ea96b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:47:24.666263 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-52f805d9-10b6-47d9-b171-5026c4665b97 tempest-VolumesActionsTest-262392969 tempest-VolumesActionsTest-262392969-project] 10.222.0.20 "GET /compute/v2.1/servers/b3afe313-9d49-40e7-afac-343f7950053e" status: 200 len: 1213 microversion: 2.1 time: 0.335692 Jul 06 13:47:24.670246 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 205/406] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:47:24 2022] GET /compute/v2.1/servers/b3afe313-9d49-40e7-afac-343f7950053e => generated 1213 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:47:24.855633 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-a283e97e-81e9-49ed-9903-ecbc18d99f4c tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:47:24.856270 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-a283e97e-81e9-49ed-9903-ecbc18d99f4c tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] [instance: c801676d-524f-42fc-a2b8-fe4186986d95] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:47:24.872745 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-a283e97e-81e9-49ed-9903-ecbc18d99f4c tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:47:24.873240 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-a283e97e-81e9-49ed-9903-ecbc18d99f4c tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:47:24.874038 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-a283e97e-81e9-49ed-9903-ecbc18d99f4c tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:47:24.874481 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-a283e97e-81e9-49ed-9903-ecbc18d99f4c tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:47:25.317856 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-a283e97e-81e9-49ed-9903-ecbc18d99f4c tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c83c05bec4f456d8aa7d51732ddc8af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b2a80a004e04da7ae12db9f3f87146f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:47:25.327722 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-a283e97e-81e9-49ed-9903-ecbc18d99f4c tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] 10.222.0.20 "GET /compute/v2.1/servers/c801676d-524f-42fc-a2b8-fe4186986d95" status: 200 len: 1522 microversion: 2.1 time: 0.476724 Jul 06 13:47:25.328303 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 202/407] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:47:24 2022] GET /compute/v2.1/servers/c801676d-524f-42fc-a2b8-fe4186986d95 => generated 1522 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:47:25.439266 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-3b38ba9a-6f81-4b16-8d1e-54f51bcce867 tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] Calling method '>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:47:25.439923 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-3b38ba9a-6f81-4b16-8d1e-54f51bcce867 tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] [instance: 0a925141-db5f-4cae-bc6c-8ca4930adf73] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:47:25.455542 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-3b38ba9a-6f81-4b16-8d1e-54f51bcce867 tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:47:25.456000 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-3b38ba9a-6f81-4b16-8d1e-54f51bcce867 tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:47:25.460916 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-3b38ba9a-6f81-4b16-8d1e-54f51bcce867 tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:47:25.464162 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-3b38ba9a-6f81-4b16-8d1e-54f51bcce867 tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:47:25.686797 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-a2e95f52-c30f-4090-8f10-28c889f99ebc tempest-VolumesActionsTest-262392969 tempest-VolumesActionsTest-262392969-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:47:25.689680 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-a2e95f52-c30f-4090-8f10-28c889f99ebc tempest-VolumesActionsTest-262392969 tempest-VolumesActionsTest-262392969-project] [instance: b3afe313-9d49-40e7-afac-343f7950053e] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:47:25.702950 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-a2e95f52-c30f-4090-8f10-28c889f99ebc tempest-VolumesActionsTest-262392969 tempest-VolumesActionsTest-262392969-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:47:25.709442 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-a2e95f52-c30f-4090-8f10-28c889f99ebc tempest-VolumesActionsTest-262392969 tempest-VolumesActionsTest-262392969-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:47:25.710373 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-a2e95f52-c30f-4090-8f10-28c889f99ebc tempest-VolumesActionsTest-262392969 tempest-VolumesActionsTest-262392969-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:47:25.710829 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-a2e95f52-c30f-4090-8f10-28c889f99ebc tempest-VolumesActionsTest-262392969 tempest-VolumesActionsTest-262392969-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:47:25.797873 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-3b38ba9a-6f81-4b16-8d1e-54f51bcce867 tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53d00e4198e240c8a5c2fbe8bd241b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1727f66e37f94cc6971b574c8635e078', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:47:25.807393 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-3b38ba9a-6f81-4b16-8d1e-54f51bcce867 tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] 10.222.0.20 "GET /compute/v2.1/servers/0a925141-db5f-4cae-bc6c-8ca4930adf73" status: 200 len: 1259 microversion: 2.1 time: 0.372396 Jul 06 13:47:25.810731 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 206/408] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:47:25 2022] GET /compute/v2.1/servers/0a925141-db5f-4cae-bc6c-8ca4930adf73 => generated 1259 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:47:25.956715 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-a2e95f52-c30f-4090-8f10-28c889f99ebc tempest-VolumesActionsTest-262392969 tempest-VolumesActionsTest-262392969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '050d5eb22b2c45ee85eb8c118b9ef21e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f9f86fa910c4054b31927ba26ea96b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:47:25.966879 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-a2e95f52-c30f-4090-8f10-28c889f99ebc tempest-VolumesActionsTest-262392969 tempest-VolumesActionsTest-262392969-project] 10.222.0.20 "GET /compute/v2.1/servers/b3afe313-9d49-40e7-afac-343f7950053e" status: 200 len: 1217 microversion: 2.1 time: 0.283075 Jul 06 13:47:25.967467 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 203/409] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:47:25 2022] GET /compute/v2.1/servers/b3afe313-9d49-40e7-afac-343f7950053e => generated 1217 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 06 13:47:26.346510 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-293dfa55-1c66-45a0-8044-04721f5418e6 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Calling method '>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:47:26.347129 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-293dfa55-1c66-45a0-8044-04721f5418e6 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] [instance: c801676d-524f-42fc-a2b8-fe4186986d95] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:47:26.355427 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-293dfa55-1c66-45a0-8044-04721f5418e6 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:47:26.356312 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-293dfa55-1c66-45a0-8044-04721f5418e6 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:47:26.357278 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-293dfa55-1c66-45a0-8044-04721f5418e6 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:47:26.358034 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-293dfa55-1c66-45a0-8044-04721f5418e6 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:47:26.728196 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [req-04e45ff3-67a6-4ff1-872e-78a636713ee5 req-5097d2c9-5ad0-411a-a70f-3c80a19adcbc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0a925141-db5f-4cae-bc6c-8ca4930adf73", "name": "network-vif-plugged", "status": "completed", "tag": "e0490198-5029-4543-9a66-8d41adcd3783"}]} {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 06 13:47:26.748116 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [req-04e45ff3-67a6-4ff1-872e-78a636713ee5 req-5097d2c9-5ad0-411a-a70f-3c80a19adcbc service nova] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:47:26.749989 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [req-04e45ff3-67a6-4ff1-872e-78a636713ee5 req-5097d2c9-5ad0-411a-a70f-3c80a19adcbc service nova] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:47:26.781270 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.compute.server_external_events [req-04e45ff3-67a6-4ff1-872e-78a636713ee5 req-5097d2c9-5ad0-411a-a70f-3c80a19adcbc service nova] Creating event network-vif-plugged:e0490198-5029-4543-9a66-8d41adcd3783 for instance 0a925141-db5f-4cae-bc6c-8ca4930adf73 on hv-cinder-81914 Jul 06 13:47:26.797328 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [req-04e45ff3-67a6-4ff1-872e-78a636713ee5 req-5097d2c9-5ad0-411a-a70f-3c80a19adcbc service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073797 Jul 06 13:47:26.803101 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 204/410] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 6 13:47:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 06 13:47:26.831042 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-985e8591-1699-4ad8-bf94-bf38d561f6da tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:47:26.833141 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-985e8591-1699-4ad8-bf94-bf38d561f6da tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] [instance: 0a925141-db5f-4cae-bc6c-8ca4930adf73] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:47:26.843091 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-985e8591-1699-4ad8-bf94-bf38d561f6da tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:47:26.843880 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-985e8591-1699-4ad8-bf94-bf38d561f6da tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:47:26.844914 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-985e8591-1699-4ad8-bf94-bf38d561f6da tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:47:26.845535 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-985e8591-1699-4ad8-bf94-bf38d561f6da tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:47:26.991072 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-293dfa55-1c66-45a0-8044-04721f5418e6 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c83c05bec4f456d8aa7d51732ddc8af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b2a80a004e04da7ae12db9f3f87146f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:47:27.043357 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-293dfa55-1c66-45a0-8044-04721f5418e6 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] 10.222.0.20 "GET /compute/v2.1/servers/c801676d-524f-42fc-a2b8-fe4186986d95" status: 200 len: 1522 microversion: 2.1 time: 0.699156 Jul 06 13:47:27.048003 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 207/411] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:47:26 2022] GET /compute/v2.1/servers/c801676d-524f-42fc-a2b8-fe4186986d95 => generated 1522 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:47:27.061099 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-e9e953d1-40ee-4125-8a17-11566e1c0738 tempest-VolumesActionsTest-262392969 tempest-VolumesActionsTest-262392969-project] Calling method '>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:47:27.061928 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-e9e953d1-40ee-4125-8a17-11566e1c0738 tempest-VolumesActionsTest-262392969 tempest-VolumesActionsTest-262392969-project] [instance: b3afe313-9d49-40e7-afac-343f7950053e] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:47:27.085594 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-e9e953d1-40ee-4125-8a17-11566e1c0738 tempest-VolumesActionsTest-262392969 tempest-VolumesActionsTest-262392969-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:47:27.086062 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-e9e953d1-40ee-4125-8a17-11566e1c0738 tempest-VolumesActionsTest-262392969 tempest-VolumesActionsTest-262392969-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:47:27.086855 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-e9e953d1-40ee-4125-8a17-11566e1c0738 tempest-VolumesActionsTest-262392969 tempest-VolumesActionsTest-262392969-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:47:27.090012 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-e9e953d1-40ee-4125-8a17-11566e1c0738 tempest-VolumesActionsTest-262392969 tempest-VolumesActionsTest-262392969-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:47:27.200629 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-e9e953d1-40ee-4125-8a17-11566e1c0738 tempest-VolumesActionsTest-262392969 tempest-VolumesActionsTest-262392969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '050d5eb22b2c45ee85eb8c118b9ef21e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f9f86fa910c4054b31927ba26ea96b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:47:27.212270 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-e9e953d1-40ee-4125-8a17-11566e1c0738 tempest-VolumesActionsTest-262392969 tempest-VolumesActionsTest-262392969-project] 10.222.0.20 "GET /compute/v2.1/servers/b3afe313-9d49-40e7-afac-343f7950053e" status: 200 len: 1265 microversion: 2.1 time: 0.157415 Jul 06 13:47:27.212878 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 208/412] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:47:27 2022] GET /compute/v2.1/servers/b3afe313-9d49-40e7-afac-343f7950053e => generated 1265 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:47:27.307822 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-985e8591-1699-4ad8-bf94-bf38d561f6da tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53d00e4198e240c8a5c2fbe8bd241b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1727f66e37f94cc6971b574c8635e078', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:47:27.321321 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-985e8591-1699-4ad8-bf94-bf38d561f6da tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] 10.222.0.20 "GET /compute/v2.1/servers/0a925141-db5f-4cae-bc6c-8ca4930adf73" status: 200 len: 1259 microversion: 2.1 time: 0.496926 Jul 06 13:47:27.321897 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 205/413] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:47:26 2022] GET /compute/v2.1/servers/0a925141-db5f-4cae-bc6c-8ca4930adf73 => generated 1259 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 06 13:47:28.065028 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-68a703c3-2c95-4771-83fc-956b63b62f53 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Calling method '>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:47:28.065808 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-68a703c3-2c95-4771-83fc-956b63b62f53 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] [instance: c801676d-524f-42fc-a2b8-fe4186986d95] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:47:28.072269 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-68a703c3-2c95-4771-83fc-956b63b62f53 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:47:28.076144 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-68a703c3-2c95-4771-83fc-956b63b62f53 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:47:28.079579 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-68a703c3-2c95-4771-83fc-956b63b62f53 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:47:28.080189 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-68a703c3-2c95-4771-83fc-956b63b62f53 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:47:28.231406 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-1e88beb9-2195-4311-9147-bccecd264d87 tempest-VolumesActionsTest-262392969 tempest-VolumesActionsTest-262392969-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:47:28.232294 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-1e88beb9-2195-4311-9147-bccecd264d87 tempest-VolumesActionsTest-262392969 tempest-VolumesActionsTest-262392969-project] [instance: b3afe313-9d49-40e7-afac-343f7950053e] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:47:28.248461 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-1e88beb9-2195-4311-9147-bccecd264d87 tempest-VolumesActionsTest-262392969 tempest-VolumesActionsTest-262392969-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:47:28.248934 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-1e88beb9-2195-4311-9147-bccecd264d87 tempest-VolumesActionsTest-262392969 tempest-VolumesActionsTest-262392969-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:47:28.249746 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-1e88beb9-2195-4311-9147-bccecd264d87 tempest-VolumesActionsTest-262392969 tempest-VolumesActionsTest-262392969-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:47:28.250184 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-1e88beb9-2195-4311-9147-bccecd264d87 tempest-VolumesActionsTest-262392969 tempest-VolumesActionsTest-262392969-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:47:28.433465 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-1e88beb9-2195-4311-9147-bccecd264d87 tempest-VolumesActionsTest-262392969 tempest-VolumesActionsTest-262392969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '050d5eb22b2c45ee85eb8c118b9ef21e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f9f86fa910c4054b31927ba26ea96b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:47:28.443611 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-1e88beb9-2195-4311-9147-bccecd264d87 tempest-VolumesActionsTest-262392969 tempest-VolumesActionsTest-262392969-project] 10.222.0.20 "GET /compute/v2.1/servers/b3afe313-9d49-40e7-afac-343f7950053e" status: 200 len: 1273 microversion: 2.1 time: 0.217455 Jul 06 13:47:28.451394 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 206/414] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:47:28 2022] GET /compute/v2.1/servers/b3afe313-9d49-40e7-afac-343f7950053e => generated 1273 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:47:28.469110 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-f2df8348-7832-4490-be78-659212a5e74f tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:47:28.471943 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-f2df8348-7832-4490-be78-659212a5e74f tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] [instance: 0a925141-db5f-4cae-bc6c-8ca4930adf73] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:47:28.493126 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-f2df8348-7832-4490-be78-659212a5e74f tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:47:28.501158 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-f2df8348-7832-4490-be78-659212a5e74f tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:47:28.505125 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-f2df8348-7832-4490-be78-659212a5e74f tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:47:28.505776 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-f2df8348-7832-4490-be78-659212a5e74f tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:47:28.735234 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-f2df8348-7832-4490-be78-659212a5e74f tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53d00e4198e240c8a5c2fbe8bd241b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1727f66e37f94cc6971b574c8635e078', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:47:28.752471 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-f2df8348-7832-4490-be78-659212a5e74f tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] 10.222.0.20 "GET /compute/v2.1/servers/0a925141-db5f-4cae-bc6c-8ca4930adf73" status: 200 len: 1259 microversion: 2.1 time: 0.299541 Jul 06 13:47:28.753261 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 207/415] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:47:28 2022] GET /compute/v2.1/servers/0a925141-db5f-4cae-bc6c-8ca4930adf73 => generated 1259 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:47:28.826850 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-68a703c3-2c95-4771-83fc-956b63b62f53 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c83c05bec4f456d8aa7d51732ddc8af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b2a80a004e04da7ae12db9f3f87146f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:47:28.856726 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-68a703c3-2c95-4771-83fc-956b63b62f53 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] 10.222.0.20 "GET /compute/v2.1/servers/c801676d-524f-42fc-a2b8-fe4186986d95" status: 200 len: 1522 microversion: 2.1 time: 0.795871 Jul 06 13:47:28.866957 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 209/416] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:47:28 2022] GET /compute/v2.1/servers/c801676d-524f-42fc-a2b8-fe4186986d95 => generated 1522 bytes in 797 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:47:29.468517 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-2386cca8-a68a-43f1-a5b8-10d5a65b5157 tempest-VolumesActionsTest-262392969 tempest-VolumesActionsTest-262392969-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:47:29.469574 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-2386cca8-a68a-43f1-a5b8-10d5a65b5157 tempest-VolumesActionsTest-262392969 tempest-VolumesActionsTest-262392969-project] [instance: b3afe313-9d49-40e7-afac-343f7950053e] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:47:29.480699 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-2386cca8-a68a-43f1-a5b8-10d5a65b5157 tempest-VolumesActionsTest-262392969 tempest-VolumesActionsTest-262392969-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:47:29.481183 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-2386cca8-a68a-43f1-a5b8-10d5a65b5157 tempest-VolumesActionsTest-262392969 tempest-VolumesActionsTest-262392969-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:47:29.481961 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-2386cca8-a68a-43f1-a5b8-10d5a65b5157 tempest-VolumesActionsTest-262392969 tempest-VolumesActionsTest-262392969-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:47:29.482389 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-2386cca8-a68a-43f1-a5b8-10d5a65b5157 tempest-VolumesActionsTest-262392969 tempest-VolumesActionsTest-262392969-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:47:29.636495 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-2386cca8-a68a-43f1-a5b8-10d5a65b5157 tempest-VolumesActionsTest-262392969 tempest-VolumesActionsTest-262392969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '050d5eb22b2c45ee85eb8c118b9ef21e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f9f86fa910c4054b31927ba26ea96b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:47:29.649630 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-2386cca8-a68a-43f1-a5b8-10d5a65b5157 tempest-VolumesActionsTest-262392969 tempest-VolumesActionsTest-262392969-project] 10.222.0.20 "GET /compute/v2.1/servers/b3afe313-9d49-40e7-afac-343f7950053e" status: 200 len: 1271 microversion: 2.1 time: 0.185696 Jul 06 13:47:29.673419 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 208/417] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:47:29 2022] GET /compute/v2.1/servers/b3afe313-9d49-40e7-afac-343f7950053e => generated 1271 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:47:29.769736 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-5dca9bd7-78a1-44a3-a07b-58cc04a7cc76 tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] Calling method '>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:47:29.771151 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-5dca9bd7-78a1-44a3-a07b-58cc04a7cc76 tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] [instance: 0a925141-db5f-4cae-bc6c-8ca4930adf73] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:47:29.787227 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-5dca9bd7-78a1-44a3-a07b-58cc04a7cc76 tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:47:29.789264 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-5dca9bd7-78a1-44a3-a07b-58cc04a7cc76 tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:47:29.790495 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-5dca9bd7-78a1-44a3-a07b-58cc04a7cc76 tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:47:29.791087 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-5dca9bd7-78a1-44a3-a07b-58cc04a7cc76 tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:47:29.876776 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-07d82de3-35aa-437d-8a08-540b7c645ad0 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:47:29.877416 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-07d82de3-35aa-437d-8a08-540b7c645ad0 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] [instance: c801676d-524f-42fc-a2b8-fe4186986d95] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:47:29.889879 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-07d82de3-35aa-437d-8a08-540b7c645ad0 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:47:29.891717 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-07d82de3-35aa-437d-8a08-540b7c645ad0 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:47:29.895110 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-07d82de3-35aa-437d-8a08-540b7c645ad0 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:47:29.895607 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-07d82de3-35aa-437d-8a08-540b7c645ad0 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:47:30.083731 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-5dca9bd7-78a1-44a3-a07b-58cc04a7cc76 tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53d00e4198e240c8a5c2fbe8bd241b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1727f66e37f94cc6971b574c8635e078', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:47:30.092258 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-5dca9bd7-78a1-44a3-a07b-58cc04a7cc76 tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] 10.222.0.20 "GET /compute/v2.1/servers/0a925141-db5f-4cae-bc6c-8ca4930adf73" status: 200 len: 1259 microversion: 2.1 time: 0.326563 Jul 06 13:47:30.099285 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 210/418] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:47:29 2022] GET /compute/v2.1/servers/0a925141-db5f-4cae-bc6c-8ca4930adf73 => generated 1259 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:47:30.676499 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-f564553f-c393-42de-b557-3d76939210f7 tempest-VolumesActionsTest-262392969 tempest-VolumesActionsTest-262392969-project] Calling method '>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:47:30.677999 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-f564553f-c393-42de-b557-3d76939210f7 tempest-VolumesActionsTest-262392969 tempest-VolumesActionsTest-262392969-project] [instance: b3afe313-9d49-40e7-afac-343f7950053e] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:47:30.708994 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-f564553f-c393-42de-b557-3d76939210f7 tempest-VolumesActionsTest-262392969 tempest-VolumesActionsTest-262392969-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:47:30.709844 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-f564553f-c393-42de-b557-3d76939210f7 tempest-VolumesActionsTest-262392969 tempest-VolumesActionsTest-262392969-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:47:30.713678 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-f564553f-c393-42de-b557-3d76939210f7 tempest-VolumesActionsTest-262392969 tempest-VolumesActionsTest-262392969-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:47:30.714472 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-f564553f-c393-42de-b557-3d76939210f7 tempest-VolumesActionsTest-262392969 tempest-VolumesActionsTest-262392969-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:47:30.949999 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-07d82de3-35aa-437d-8a08-540b7c645ad0 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c83c05bec4f456d8aa7d51732ddc8af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b2a80a004e04da7ae12db9f3f87146f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:47:30.961382 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-07d82de3-35aa-437d-8a08-540b7c645ad0 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] 10.222.0.20 "GET /compute/v2.1/servers/c801676d-524f-42fc-a2b8-fe4186986d95" status: 200 len: 1502 microversion: 2.1 time: 1.086940 Jul 06 13:47:30.975388 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 209/419] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:47:29 2022] GET /compute/v2.1/servers/c801676d-524f-42fc-a2b8-fe4186986d95 => generated 1502 bytes in 1104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:47:30.987332 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-4afbdaa7-133a-44fb-9de3-3e6484797061 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:47:30.990175 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-4afbdaa7-133a-44fb-9de3-3e6484797061 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] [instance: 12bddea9-d545-43f2-9bf7-5e723900c8c6] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:47:31.007216 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-4afbdaa7-133a-44fb-9de3-3e6484797061 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:47:31.009349 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-4afbdaa7-133a-44fb-9de3-3e6484797061 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:47:31.010365 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-4afbdaa7-133a-44fb-9de3-3e6484797061 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:47:31.011760 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-4afbdaa7-133a-44fb-9de3-3e6484797061 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:47:31.351362 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-f564553f-c393-42de-b557-3d76939210f7 tempest-VolumesActionsTest-262392969 tempest-VolumesActionsTest-262392969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '050d5eb22b2c45ee85eb8c118b9ef21e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f9f86fa910c4054b31927ba26ea96b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:47:31.395767 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-f564553f-c393-42de-b557-3d76939210f7 tempest-VolumesActionsTest-262392969 tempest-VolumesActionsTest-262392969-project] 10.222.0.20 "GET /compute/v2.1/servers/b3afe313-9d49-40e7-afac-343f7950053e" status: 200 len: 1313 microversion: 2.1 time: 0.697159 Jul 06 13:47:31.406277 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 211/420] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:47:30 2022] GET /compute/v2.1/servers/b3afe313-9d49-40e7-afac-343f7950053e => generated 1313 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:47:31.430007 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-d152b233-d27c-493a-bdf3-5deb7619ef1a tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] Calling method '>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:47:31.430901 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-d152b233-d27c-493a-bdf3-5deb7619ef1a tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] [instance: 0a925141-db5f-4cae-bc6c-8ca4930adf73] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:47:31.447685 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-d152b233-d27c-493a-bdf3-5deb7619ef1a tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:47:31.448450 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-d152b233-d27c-493a-bdf3-5deb7619ef1a tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:47:31.449582 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-d152b233-d27c-493a-bdf3-5deb7619ef1a tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:47:31.450180 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-d152b233-d27c-493a-bdf3-5deb7619ef1a tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:47:31.742348 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-4afbdaa7-133a-44fb-9de3-3e6484797061 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c83c05bec4f456d8aa7d51732ddc8af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b2a80a004e04da7ae12db9f3f87146f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:47:31.747991 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-d152b233-d27c-493a-bdf3-5deb7619ef1a tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53d00e4198e240c8a5c2fbe8bd241b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1727f66e37f94cc6971b574c8635e078', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:47:31.757380 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-4afbdaa7-133a-44fb-9de3-3e6484797061 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] 10.222.0.20 "GET /compute/v2.1/servers/12bddea9-d545-43f2-9bf7-5e723900c8c6" status: 200 len: 1516 microversion: 2.1 time: 0.778456 Jul 06 13:47:31.757991 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 210/421] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:47:30 2022] GET /compute/v2.1/servers/12bddea9-d545-43f2-9bf7-5e723900c8c6 => generated 1516 bytes in 782 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:47:31.760300 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-d152b233-d27c-493a-bdf3-5deb7619ef1a tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] 10.222.0.20 "GET /compute/v2.1/servers/0a925141-db5f-4cae-bc6c-8ca4930adf73" status: 200 len: 1442 microversion: 2.1 time: 0.352360 Jul 06 13:47:31.773995 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 212/422] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:47:31 2022] GET /compute/v2.1/servers/0a925141-db5f-4cae-bc6c-8ca4930adf73 => generated 1442 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:47:31.781932 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-7d4f3379-d50f-4f11-a983-632e60148fac tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:47:31.782551 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-7d4f3379-d50f-4f11-a983-632e60148fac tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] [instance: 0a925141-db5f-4cae-bc6c-8ca4930adf73] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:47:31.796400 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-7d4f3379-d50f-4f11-a983-632e60148fac tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:47:31.796854 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-7d4f3379-d50f-4f11-a983-632e60148fac tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:47:31.797891 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-7d4f3379-d50f-4f11-a983-632e60148fac tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:47:31.798320 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-7d4f3379-d50f-4f11-a983-632e60148fac tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:47:32.283342 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-7d4f3379-d50f-4f11-a983-632e60148fac tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53d00e4198e240c8a5c2fbe8bd241b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1727f66e37f94cc6971b574c8635e078', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:47:32.300085 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-7d4f3379-d50f-4f11-a983-632e60148fac tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] 10.222.0.20 "GET /compute/v2.1/servers/0a925141-db5f-4cae-bc6c-8ca4930adf73" status: 200 len: 1442 microversion: 2.1 time: 0.524397 Jul 06 13:47:32.306463 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 211/423] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:47:31 2022] GET /compute/v2.1/servers/0a925141-db5f-4cae-bc6c-8ca4930adf73 => generated 1442 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:47:32.415985 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-cd19672d-0a70-4f4f-900f-35284d1370ae tempest-VolumesActionsTest-262392969 tempest-VolumesActionsTest-262392969-project] Calling method '>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:47:32.417219 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-cd19672d-0a70-4f4f-900f-35284d1370ae tempest-VolumesActionsTest-262392969 tempest-VolumesActionsTest-262392969-project] [instance: b3afe313-9d49-40e7-afac-343f7950053e] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:47:32.431331 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-cd19672d-0a70-4f4f-900f-35284d1370ae tempest-VolumesActionsTest-262392969 tempest-VolumesActionsTest-262392969-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:47:32.432885 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-cd19672d-0a70-4f4f-900f-35284d1370ae tempest-VolumesActionsTest-262392969 tempest-VolumesActionsTest-262392969-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:47:32.434591 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-cd19672d-0a70-4f4f-900f-35284d1370ae tempest-VolumesActionsTest-262392969 tempest-VolumesActionsTest-262392969-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:47:32.436592 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-cd19672d-0a70-4f4f-900f-35284d1370ae tempest-VolumesActionsTest-262392969 tempest-VolumesActionsTest-262392969-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:47:32.833658 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [req-a127c448-4d9a-46a2-8d1d-d891599db038 req-7b88ec66-daaf-4e2a-85e2-d265fb4c0546 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b3afe313-9d49-40e7-afac-343f7950053e", "tag": "c6613e8f-4caf-42de-865b-c8414e5bf45a"}]} {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 06 13:47:32.842567 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-cd19672d-0a70-4f4f-900f-35284d1370ae tempest-VolumesActionsTest-262392969 tempest-VolumesActionsTest-262392969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '050d5eb22b2c45ee85eb8c118b9ef21e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f9f86fa910c4054b31927ba26ea96b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:47:32.851573 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [req-a127c448-4d9a-46a2-8d1d-d891599db038 req-7b88ec66-daaf-4e2a-85e2-d265fb4c0546 service nova] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:47:32.852021 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [req-a127c448-4d9a-46a2-8d1d-d891599db038 req-7b88ec66-daaf-4e2a-85e2-d265fb4c0546 service nova] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:47:32.858088 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-cd19672d-0a70-4f4f-900f-35284d1370ae tempest-VolumesActionsTest-262392969 tempest-VolumesActionsTest-262392969-project] 10.222.0.20 "GET /compute/v2.1/servers/b3afe313-9d49-40e7-afac-343f7950053e" status: 200 len: 1313 microversion: 2.1 time: 0.443060 Jul 06 13:47:32.865764 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 213/424] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:47:32 2022] GET /compute/v2.1/servers/b3afe313-9d49-40e7-afac-343f7950053e => generated 1313 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:47:32.906176 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.compute.server_external_events [req-a127c448-4d9a-46a2-8d1d-d891599db038 req-7b88ec66-daaf-4e2a-85e2-d265fb4c0546 service nova] Creating event network-changed:c6613e8f-4caf-42de-865b-c8414e5bf45a for instance b3afe313-9d49-40e7-afac-343f7950053e on hv-cinder-81914 Jul 06 13:47:32.919612 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [req-a127c448-4d9a-46a2-8d1d-d891599db038 req-7b88ec66-daaf-4e2a-85e2-d265fb4c0546 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.096989 Jul 06 13:47:32.920207 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 212/425] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 6 13:47:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 06 13:47:33.311533 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-a06f4c0c-baaa-4001-90a7-d58b7d513b69 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 06 13:47:33.312564 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-a06f4c0c-baaa-4001-90a7-d58b7d513b69 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] [instance: 12bddea9-d545-43f2-9bf7-5e723900c8c6] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:47:33.332571 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-a06f4c0c-baaa-4001-90a7-d58b7d513b69 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:47:33.333053 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-a06f4c0c-baaa-4001-90a7-d58b7d513b69 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:47:33.333996 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-a06f4c0c-baaa-4001-90a7-d58b7d513b69 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:47:33.334615 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-a06f4c0c-baaa-4001-90a7-d58b7d513b69 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:47:33.338967 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG dbcounter [-] [124368] Writing DB stats nova_cell1:SELECT=100 {{(pid=124368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:47:33.367900 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.objects.instance [None req-a06f4c0c-baaa-4001-90a7-d58b7d513b69 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lazy-loading 'flavor' on Instance uuid 12bddea9-d545-43f2-9bf7-5e723900c8c6 {{(pid=124368) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 06 13:47:33.479176 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-a06f4c0c-baaa-4001-90a7-d58b7d513b69 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] 10.222.0.20 "POST /compute/v2.1/servers/12bddea9-d545-43f2-9bf7-5e723900c8c6/action" status: 200 len: 32 microversion: 2.1 time: 0.170304 Jul 06 13:47:33.487230 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 214/426] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Jul 6 13:47:33 2022] POST /compute/v2.1/servers/12bddea9-d545-43f2-9bf7-5e723900c8c6/action => generated 32 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 06 13:47:33.491069 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-ddaf2187-f8f8-4c61-a4e7-2e42c9262a1d tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:47:33.492321 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-ddaf2187-f8f8-4c61-a4e7-2e42c9262a1d tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] [instance: 12bddea9-d545-43f2-9bf7-5e723900c8c6] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:47:33.502269 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-ddaf2187-f8f8-4c61-a4e7-2e42c9262a1d tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:47:33.505629 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-ddaf2187-f8f8-4c61-a4e7-2e42c9262a1d tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:47:33.506454 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-ddaf2187-f8f8-4c61-a4e7-2e42c9262a1d tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:47:33.506886 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-ddaf2187-f8f8-4c61-a4e7-2e42c9262a1d tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:47:33.764277 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-ddaf2187-f8f8-4c61-a4e7-2e42c9262a1d tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c83c05bec4f456d8aa7d51732ddc8af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b2a80a004e04da7ae12db9f3f87146f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:47:33.772695 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-ddaf2187-f8f8-4c61-a4e7-2e42c9262a1d tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] 10.222.0.20 "GET /compute/v2.1/servers/12bddea9-d545-43f2-9bf7-5e723900c8c6" status: 200 len: 1522 microversion: 2.1 time: 0.286532 Jul 06 13:47:33.775555 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 213/427] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:47:33 2022] GET /compute/v2.1/servers/12bddea9-d545-43f2-9bf7-5e723900c8c6 => generated 1522 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 06 13:47:33.884608 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-20b25999-49a4-4780-b547-2e82a081a3ef tempest-VolumesActionsTest-262392969 tempest-VolumesActionsTest-262392969-project] Calling method '>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:47:33.885544 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-20b25999-49a4-4780-b547-2e82a081a3ef tempest-VolumesActionsTest-262392969 tempest-VolumesActionsTest-262392969-project] [instance: b3afe313-9d49-40e7-afac-343f7950053e] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:47:33.894591 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-20b25999-49a4-4780-b547-2e82a081a3ef tempest-VolumesActionsTest-262392969 tempest-VolumesActionsTest-262392969-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:47:33.895261 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-20b25999-49a4-4780-b547-2e82a081a3ef tempest-VolumesActionsTest-262392969 tempest-VolumesActionsTest-262392969-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:47:33.896248 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-20b25999-49a4-4780-b547-2e82a081a3ef tempest-VolumesActionsTest-262392969 tempest-VolumesActionsTest-262392969-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:47:33.897505 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-20b25999-49a4-4780-b547-2e82a081a3ef tempest-VolumesActionsTest-262392969 tempest-VolumesActionsTest-262392969-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:47:34.223359 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG dbcounter [-] [124368] Writing DB stats nova_cell0:SELECT=2 {{(pid=124368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:47:34.261151 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-20b25999-49a4-4780-b547-2e82a081a3ef tempest-VolumesActionsTest-262392969 tempest-VolumesActionsTest-262392969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '050d5eb22b2c45ee85eb8c118b9ef21e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f9f86fa910c4054b31927ba26ea96b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:47:34.272732 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-20b25999-49a4-4780-b547-2e82a081a3ef tempest-VolumesActionsTest-262392969 tempest-VolumesActionsTest-262392969-project] 10.222.0.20 "GET /compute/v2.1/servers/b3afe313-9d49-40e7-afac-343f7950053e" status: 200 len: 1313 microversion: 2.1 time: 0.393560 Jul 06 13:47:34.284389 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 215/428] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:47:33 2022] GET /compute/v2.1/servers/b3afe313-9d49-40e7-afac-343f7950053e => generated 1313 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:47:34.794818 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-bec98639-e6f8-446e-9aab-e492bbbac89b tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:47:34.796388 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-bec98639-e6f8-446e-9aab-e492bbbac89b tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] [instance: 12bddea9-d545-43f2-9bf7-5e723900c8c6] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:47:34.807636 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-bec98639-e6f8-446e-9aab-e492bbbac89b tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:47:34.810037 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-bec98639-e6f8-446e-9aab-e492bbbac89b tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:47:34.812809 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-bec98639-e6f8-446e-9aab-e492bbbac89b tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:47:34.815780 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-bec98639-e6f8-446e-9aab-e492bbbac89b tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:47:35.136224 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-bec98639-e6f8-446e-9aab-e492bbbac89b tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c83c05bec4f456d8aa7d51732ddc8af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b2a80a004e04da7ae12db9f3f87146f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:47:35.155487 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-bec98639-e6f8-446e-9aab-e492bbbac89b tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] 10.222.0.20 "GET /compute/v2.1/servers/12bddea9-d545-43f2-9bf7-5e723900c8c6" status: 200 len: 1522 microversion: 2.1 time: 0.368658 Jul 06 13:47:35.159005 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 214/429] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:47:34 2022] GET /compute/v2.1/servers/12bddea9-d545-43f2-9bf7-5e723900c8c6 => generated 1522 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:47:35.301427 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-ed6a494e-c5ed-4ccc-b777-c269ba5a76a2 tempest-VolumesActionsTest-262392969 tempest-VolumesActionsTest-262392969-project] Calling method '>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:47:35.302869 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-ed6a494e-c5ed-4ccc-b777-c269ba5a76a2 tempest-VolumesActionsTest-262392969 tempest-VolumesActionsTest-262392969-project] [instance: b3afe313-9d49-40e7-afac-343f7950053e] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:47:35.313777 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG dbcounter [-] [124368] Writing DB stats nova_cell0:SELECT=8 {{(pid=124368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:47:35.318844 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-ed6a494e-c5ed-4ccc-b777-c269ba5a76a2 tempest-VolumesActionsTest-262392969 tempest-VolumesActionsTest-262392969-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:47:35.321631 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-ed6a494e-c5ed-4ccc-b777-c269ba5a76a2 tempest-VolumesActionsTest-262392969 tempest-VolumesActionsTest-262392969-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:47:35.323954 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-ed6a494e-c5ed-4ccc-b777-c269ba5a76a2 tempest-VolumesActionsTest-262392969 tempest-VolumesActionsTest-262392969-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:47:35.324812 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-ed6a494e-c5ed-4ccc-b777-c269ba5a76a2 tempest-VolumesActionsTest-262392969 tempest-VolumesActionsTest-262392969-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:47:35.953771 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-ed6a494e-c5ed-4ccc-b777-c269ba5a76a2 tempest-VolumesActionsTest-262392969 tempest-VolumesActionsTest-262392969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '050d5eb22b2c45ee85eb8c118b9ef21e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f9f86fa910c4054b31927ba26ea96b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:47:35.970183 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-ed6a494e-c5ed-4ccc-b777-c269ba5a76a2 tempest-VolumesActionsTest-262392969 tempest-VolumesActionsTest-262392969-project] 10.222.0.20 "GET /compute/v2.1/servers/b3afe313-9d49-40e7-afac-343f7950053e" status: 200 len: 1313 microversion: 2.1 time: 0.681591 Jul 06 13:47:35.971295 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 216/430] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:47:35 2022] GET /compute/v2.1/servers/b3afe313-9d49-40e7-afac-343f7950053e => generated 1313 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:47:36.193519 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-391fb86e-4344-43d0-b2fa-76c284156e6e tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:47:36.194527 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-391fb86e-4344-43d0-b2fa-76c284156e6e tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] [instance: 12bddea9-d545-43f2-9bf7-5e723900c8c6] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:47:36.217723 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-391fb86e-4344-43d0-b2fa-76c284156e6e tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:47:36.218159 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-391fb86e-4344-43d0-b2fa-76c284156e6e tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:47:36.219796 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-391fb86e-4344-43d0-b2fa-76c284156e6e tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:47:36.220237 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-391fb86e-4344-43d0-b2fa-76c284156e6e tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:47:36.286564 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [req-13b13dda-54d7-4561-b3ca-48ac4963788d req-94016ef5-6e2a-4631-8924-1c8aaa55d372 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0a925141-db5f-4cae-bc6c-8ca4930adf73", "tag": "e0490198-5029-4543-9a66-8d41adcd3783"}]} {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 06 13:47:36.315688 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [req-13b13dda-54d7-4561-b3ca-48ac4963788d req-94016ef5-6e2a-4631-8924-1c8aaa55d372 service nova] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:47:36.316390 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [req-13b13dda-54d7-4561-b3ca-48ac4963788d req-94016ef5-6e2a-4631-8924-1c8aaa55d372 service nova] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:47:36.328814 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.compute.server_external_events [req-13b13dda-54d7-4561-b3ca-48ac4963788d req-94016ef5-6e2a-4631-8924-1c8aaa55d372 service nova] Creating event network-changed:e0490198-5029-4543-9a66-8d41adcd3783 for instance 0a925141-db5f-4cae-bc6c-8ca4930adf73 on hv-cinder-81914 Jul 06 13:47:36.347023 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [req-13b13dda-54d7-4561-b3ca-48ac4963788d req-94016ef5-6e2a-4631-8924-1c8aaa55d372 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064457 Jul 06 13:47:36.358097 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 217/431] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 6 13:47:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 06 13:47:36.530466 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-391fb86e-4344-43d0-b2fa-76c284156e6e tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c83c05bec4f456d8aa7d51732ddc8af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b2a80a004e04da7ae12db9f3f87146f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:47:36.558491 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG dbcounter [-] [124367] Writing DB stats nova_cell1:SELECT=100 {{(pid=124367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:47:36.586592 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-391fb86e-4344-43d0-b2fa-76c284156e6e tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] 10.222.0.20 "GET /compute/v2.1/servers/12bddea9-d545-43f2-9bf7-5e723900c8c6" status: 200 len: 1522 microversion: 2.1 time: 0.414187 Jul 06 13:47:36.587200 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 215/432] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:47:36 2022] GET /compute/v2.1/servers/12bddea9-d545-43f2-9bf7-5e723900c8c6 => generated 1522 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:47:36.988924 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-1cc0617b-bb73-4083-8457-3a0b38f10db8 tempest-VolumesActionsTest-262392969 tempest-VolumesActionsTest-262392969-project] Calling method '>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:47:36.990292 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-1cc0617b-bb73-4083-8457-3a0b38f10db8 tempest-VolumesActionsTest-262392969 tempest-VolumesActionsTest-262392969-project] [instance: b3afe313-9d49-40e7-afac-343f7950053e] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:47:37.010552 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-1cc0617b-bb73-4083-8457-3a0b38f10db8 tempest-VolumesActionsTest-262392969 tempest-VolumesActionsTest-262392969-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:47:37.011287 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-1cc0617b-bb73-4083-8457-3a0b38f10db8 tempest-VolumesActionsTest-262392969 tempest-VolumesActionsTest-262392969-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:47:37.012539 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-1cc0617b-bb73-4083-8457-3a0b38f10db8 tempest-VolumesActionsTest-262392969 tempest-VolumesActionsTest-262392969-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:47:37.013229 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-1cc0617b-bb73-4083-8457-3a0b38f10db8 tempest-VolumesActionsTest-262392969 tempest-VolumesActionsTest-262392969-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:47:37.608023 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-7ef76454-16c2-4d0a-9117-6572c7d2aaa4 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:47:37.608646 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-7ef76454-16c2-4d0a-9117-6572c7d2aaa4 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] [instance: 12bddea9-d545-43f2-9bf7-5e723900c8c6] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:47:37.618265 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-7ef76454-16c2-4d0a-9117-6572c7d2aaa4 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:47:37.636079 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-7ef76454-16c2-4d0a-9117-6572c7d2aaa4 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:47:37.636944 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-7ef76454-16c2-4d0a-9117-6572c7d2aaa4 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:47:37.637417 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-7ef76454-16c2-4d0a-9117-6572c7d2aaa4 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:47:37.811774 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-1cc0617b-bb73-4083-8457-3a0b38f10db8 tempest-VolumesActionsTest-262392969 tempest-VolumesActionsTest-262392969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '050d5eb22b2c45ee85eb8c118b9ef21e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f9f86fa910c4054b31927ba26ea96b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:47:37.829881 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-1cc0617b-bb73-4083-8457-3a0b38f10db8 tempest-VolumesActionsTest-262392969 tempest-VolumesActionsTest-262392969-project] 10.222.0.20 "GET /compute/v2.1/servers/b3afe313-9d49-40e7-afac-343f7950053e" status: 200 len: 1313 microversion: 2.1 time: 0.846016 Jul 06 13:47:37.830860 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 218/433] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:47:36 2022] GET /compute/v2.1/servers/b3afe313-9d49-40e7-afac-343f7950053e => generated 1313 bytes in 848 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:47:38.355862 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-7ef76454-16c2-4d0a-9117-6572c7d2aaa4 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c83c05bec4f456d8aa7d51732ddc8af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b2a80a004e04da7ae12db9f3f87146f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:47:38.372596 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-7ef76454-16c2-4d0a-9117-6572c7d2aaa4 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] 10.222.0.20 "GET /compute/v2.1/servers/12bddea9-d545-43f2-9bf7-5e723900c8c6" status: 200 len: 1522 microversion: 2.1 time: 0.772223 Jul 06 13:47:38.395974 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 216/434] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:47:37 2022] GET /compute/v2.1/servers/12bddea9-d545-43f2-9bf7-5e723900c8c6 => generated 1522 bytes in 796 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:47:38.851845 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-537a05d8-b8d6-4048-9d3e-273131f9f980 tempest-VolumesActionsTest-262392969 tempest-VolumesActionsTest-262392969-project] Calling method '>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:47:38.853208 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-537a05d8-b8d6-4048-9d3e-273131f9f980 tempest-VolumesActionsTest-262392969 tempest-VolumesActionsTest-262392969-project] [instance: b3afe313-9d49-40e7-afac-343f7950053e] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:47:38.874753 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-537a05d8-b8d6-4048-9d3e-273131f9f980 tempest-VolumesActionsTest-262392969 tempest-VolumesActionsTest-262392969-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:47:38.875781 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-537a05d8-b8d6-4048-9d3e-273131f9f980 tempest-VolumesActionsTest-262392969 tempest-VolumesActionsTest-262392969-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:47:38.876772 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-537a05d8-b8d6-4048-9d3e-273131f9f980 tempest-VolumesActionsTest-262392969 tempest-VolumesActionsTest-262392969-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:47:38.879156 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-537a05d8-b8d6-4048-9d3e-273131f9f980 tempest-VolumesActionsTest-262392969 tempest-VolumesActionsTest-262392969-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:47:39.182906 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-537a05d8-b8d6-4048-9d3e-273131f9f980 tempest-VolumesActionsTest-262392969 tempest-VolumesActionsTest-262392969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '050d5eb22b2c45ee85eb8c118b9ef21e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f9f86fa910c4054b31927ba26ea96b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:47:39.193436 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-537a05d8-b8d6-4048-9d3e-273131f9f980 tempest-VolumesActionsTest-262392969 tempest-VolumesActionsTest-262392969-project] 10.222.0.20 "GET /compute/v2.1/servers/b3afe313-9d49-40e7-afac-343f7950053e" status: 200 len: 1313 microversion: 2.1 time: 0.348715 Jul 06 13:47:39.194362 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 219/435] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:47:38 2022] GET /compute/v2.1/servers/b3afe313-9d49-40e7-afac-343f7950053e => generated 1313 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:47:39.414616 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-79cca961-058d-4c5d-99c9-932391190a48 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:47:39.415369 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-79cca961-058d-4c5d-99c9-932391190a48 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] [instance: 12bddea9-d545-43f2-9bf7-5e723900c8c6] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:47:39.426811 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-79cca961-058d-4c5d-99c9-932391190a48 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:47:39.427557 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-79cca961-058d-4c5d-99c9-932391190a48 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:47:39.428665 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-79cca961-058d-4c5d-99c9-932391190a48 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:47:39.429336 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-79cca961-058d-4c5d-99c9-932391190a48 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:47:39.615704 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-79cca961-058d-4c5d-99c9-932391190a48 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c83c05bec4f456d8aa7d51732ddc8af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b2a80a004e04da7ae12db9f3f87146f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:47:39.623541 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-79cca961-058d-4c5d-99c9-932391190a48 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] 10.222.0.20 "GET /compute/v2.1/servers/12bddea9-d545-43f2-9bf7-5e723900c8c6" status: 200 len: 1522 microversion: 2.1 time: 0.231568 Jul 06 13:47:39.624349 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 217/436] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:47:39 2022] GET /compute/v2.1/servers/12bddea9-d545-43f2-9bf7-5e723900c8c6 => generated 1522 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:47:40.210743 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-e834898f-8078-468f-8411-55a715cd0700 tempest-VolumesActionsTest-262392969 tempest-VolumesActionsTest-262392969-project] Calling method '>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:47:40.212638 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-e834898f-8078-468f-8411-55a715cd0700 tempest-VolumesActionsTest-262392969 tempest-VolumesActionsTest-262392969-project] [instance: b3afe313-9d49-40e7-afac-343f7950053e] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:47:40.225401 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-e834898f-8078-468f-8411-55a715cd0700 tempest-VolumesActionsTest-262392969 tempest-VolumesActionsTest-262392969-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:47:40.226772 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-e834898f-8078-468f-8411-55a715cd0700 tempest-VolumesActionsTest-262392969 tempest-VolumesActionsTest-262392969-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:47:40.229870 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-e834898f-8078-468f-8411-55a715cd0700 tempest-VolumesActionsTest-262392969 tempest-VolumesActionsTest-262392969-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:47:40.231002 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-e834898f-8078-468f-8411-55a715cd0700 tempest-VolumesActionsTest-262392969 tempest-VolumesActionsTest-262392969-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:47:40.573836 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-e834898f-8078-468f-8411-55a715cd0700 tempest-VolumesActionsTest-262392969 tempest-VolumesActionsTest-262392969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '050d5eb22b2c45ee85eb8c118b9ef21e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f9f86fa910c4054b31927ba26ea96b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:47:40.587732 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-e834898f-8078-468f-8411-55a715cd0700 tempest-VolumesActionsTest-262392969 tempest-VolumesActionsTest-262392969-project] 10.222.0.20 "GET /compute/v2.1/servers/b3afe313-9d49-40e7-afac-343f7950053e" status: 200 len: 1313 microversion: 2.1 time: 0.381548 Jul 06 13:47:40.590640 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 220/437] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:47:40 2022] GET /compute/v2.1/servers/b3afe313-9d49-40e7-afac-343f7950053e => generated 1313 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:47:40.644297 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-dcac3c13-1a97-4ea3-ae2d-c25d1423d555 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:47:40.646176 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-dcac3c13-1a97-4ea3-ae2d-c25d1423d555 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] [instance: 12bddea9-d545-43f2-9bf7-5e723900c8c6] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:47:40.657160 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-dcac3c13-1a97-4ea3-ae2d-c25d1423d555 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:47:40.670673 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-dcac3c13-1a97-4ea3-ae2d-c25d1423d555 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:47:40.673292 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-dcac3c13-1a97-4ea3-ae2d-c25d1423d555 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:47:40.673978 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-dcac3c13-1a97-4ea3-ae2d-c25d1423d555 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:47:40.928414 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-dcac3c13-1a97-4ea3-ae2d-c25d1423d555 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c83c05bec4f456d8aa7d51732ddc8af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b2a80a004e04da7ae12db9f3f87146f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:47:40.944355 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-dcac3c13-1a97-4ea3-ae2d-c25d1423d555 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] 10.222.0.20 "GET /compute/v2.1/servers/12bddea9-d545-43f2-9bf7-5e723900c8c6" status: 200 len: 1522 microversion: 2.1 time: 0.299855 Jul 06 13:47:40.944965 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 218/438] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:47:40 2022] GET /compute/v2.1/servers/12bddea9-d545-43f2-9bf7-5e723900c8c6 => generated 1522 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:47:41.452872 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [req-eeed5e5c-68b8-4f45-9193-65612192d6ef req-cf126d75-2e44-4f71-9113-0dbedfb9bfdc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b3afe313-9d49-40e7-afac-343f7950053e", "name": "network-vif-plugged", "status": "completed", "tag": "c6613e8f-4caf-42de-865b-c8414e5bf45a"}]} {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 06 13:47:41.473730 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [req-eeed5e5c-68b8-4f45-9193-65612192d6ef req-cf126d75-2e44-4f71-9113-0dbedfb9bfdc service nova] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:47:41.474215 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [req-eeed5e5c-68b8-4f45-9193-65612192d6ef req-cf126d75-2e44-4f71-9113-0dbedfb9bfdc service nova] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:47:41.518137 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.compute.server_external_events [req-eeed5e5c-68b8-4f45-9193-65612192d6ef req-cf126d75-2e44-4f71-9113-0dbedfb9bfdc service nova] Creating event network-vif-plugged:c6613e8f-4caf-42de-865b-c8414e5bf45a for instance b3afe313-9d49-40e7-afac-343f7950053e on hv-cinder-81914 Jul 06 13:47:41.536323 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [req-eeed5e5c-68b8-4f45-9193-65612192d6ef req-cf126d75-2e44-4f71-9113-0dbedfb9bfdc service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089492 Jul 06 13:47:41.547797 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 221/439] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 6 13:47:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 06 13:47:41.607865 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-9e40b469-ee9c-4ef5-9474-3e5e6fab7ba7 tempest-VolumesActionsTest-262392969 tempest-VolumesActionsTest-262392969-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:47:41.608467 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-9e40b469-ee9c-4ef5-9474-3e5e6fab7ba7 tempest-VolumesActionsTest-262392969 tempest-VolumesActionsTest-262392969-project] [instance: b3afe313-9d49-40e7-afac-343f7950053e] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:47:41.622977 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-9e40b469-ee9c-4ef5-9474-3e5e6fab7ba7 tempest-VolumesActionsTest-262392969 tempest-VolumesActionsTest-262392969-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:47:41.623936 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-9e40b469-ee9c-4ef5-9474-3e5e6fab7ba7 tempest-VolumesActionsTest-262392969 tempest-VolumesActionsTest-262392969-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:47:41.628764 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-9e40b469-ee9c-4ef5-9474-3e5e6fab7ba7 tempest-VolumesActionsTest-262392969 tempest-VolumesActionsTest-262392969-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:47:41.629486 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-9e40b469-ee9c-4ef5-9474-3e5e6fab7ba7 tempest-VolumesActionsTest-262392969 tempest-VolumesActionsTest-262392969-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:47:41.881504 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-9e40b469-ee9c-4ef5-9474-3e5e6fab7ba7 tempest-VolumesActionsTest-262392969 tempest-VolumesActionsTest-262392969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '050d5eb22b2c45ee85eb8c118b9ef21e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f9f86fa910c4054b31927ba26ea96b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:47:41.895572 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-9e40b469-ee9c-4ef5-9474-3e5e6fab7ba7 tempest-VolumesActionsTest-262392969 tempest-VolumesActionsTest-262392969-project] 10.222.0.20 "GET /compute/v2.1/servers/b3afe313-9d49-40e7-afac-343f7950053e" status: 200 len: 1313 microversion: 2.1 time: 0.289551 Jul 06 13:47:41.897776 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 219/440] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:47:41 2022] GET /compute/v2.1/servers/b3afe313-9d49-40e7-afac-343f7950053e => generated 1313 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:47:41.963841 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-3f957620-ab7d-4902-9bd3-5114503ae9a5 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Calling method '>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:47:41.964595 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-3f957620-ab7d-4902-9bd3-5114503ae9a5 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] [instance: 12bddea9-d545-43f2-9bf7-5e723900c8c6] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:47:41.977775 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-3f957620-ab7d-4902-9bd3-5114503ae9a5 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:47:41.978236 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-3f957620-ab7d-4902-9bd3-5114503ae9a5 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:47:41.979085 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-3f957620-ab7d-4902-9bd3-5114503ae9a5 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:47:41.979528 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-3f957620-ab7d-4902-9bd3-5114503ae9a5 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:47:42.190520 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-3f957620-ab7d-4902-9bd3-5114503ae9a5 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c83c05bec4f456d8aa7d51732ddc8af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b2a80a004e04da7ae12db9f3f87146f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:47:42.198797 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-3f957620-ab7d-4902-9bd3-5114503ae9a5 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] 10.222.0.20 "GET /compute/v2.1/servers/12bddea9-d545-43f2-9bf7-5e723900c8c6" status: 200 len: 1522 microversion: 2.1 time: 0.240071 Jul 06 13:47:42.200056 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 222/441] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:47:41 2022] GET /compute/v2.1/servers/12bddea9-d545-43f2-9bf7-5e723900c8c6 => generated 1522 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:47:42.915850 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-a92b48ea-0236-4ea2-af3b-b33be9edb3c0 tempest-VolumesActionsTest-262392969 tempest-VolumesActionsTest-262392969-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:47:42.916469 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-a92b48ea-0236-4ea2-af3b-b33be9edb3c0 tempest-VolumesActionsTest-262392969 tempest-VolumesActionsTest-262392969-project] [instance: b3afe313-9d49-40e7-afac-343f7950053e] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:47:42.928059 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-a92b48ea-0236-4ea2-af3b-b33be9edb3c0 tempest-VolumesActionsTest-262392969 tempest-VolumesActionsTest-262392969-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:47:42.928792 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-a92b48ea-0236-4ea2-af3b-b33be9edb3c0 tempest-VolumesActionsTest-262392969 tempest-VolumesActionsTest-262392969-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:47:42.929773 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-a92b48ea-0236-4ea2-af3b-b33be9edb3c0 tempest-VolumesActionsTest-262392969 tempest-VolumesActionsTest-262392969-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:47:42.930456 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-a92b48ea-0236-4ea2-af3b-b33be9edb3c0 tempest-VolumesActionsTest-262392969 tempest-VolumesActionsTest-262392969-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:47:43.102627 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-a92b48ea-0236-4ea2-af3b-b33be9edb3c0 tempest-VolumesActionsTest-262392969 tempest-VolumesActionsTest-262392969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '050d5eb22b2c45ee85eb8c118b9ef21e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f9f86fa910c4054b31927ba26ea96b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:47:43.110464 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-a92b48ea-0236-4ea2-af3b-b33be9edb3c0 tempest-VolumesActionsTest-262392969 tempest-VolumesActionsTest-262392969-project] 10.222.0.20 "GET /compute/v2.1/servers/b3afe313-9d49-40e7-afac-343f7950053e" status: 200 len: 1313 microversion: 2.1 time: 0.199997 Jul 06 13:47:43.111760 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 220/442] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:47:42 2022] GET /compute/v2.1/servers/b3afe313-9d49-40e7-afac-343f7950053e => generated 1313 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:47:43.216401 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-f2f08006-2f2f-4aaa-9600-34b4be855ace tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Calling method '>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:47:43.219892 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-f2f08006-2f2f-4aaa-9600-34b4be855ace tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] [instance: 12bddea9-d545-43f2-9bf7-5e723900c8c6] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:47:43.227078 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-f2f08006-2f2f-4aaa-9600-34b4be855ace tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:47:43.227530 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-f2f08006-2f2f-4aaa-9600-34b4be855ace tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:47:43.228315 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-f2f08006-2f2f-4aaa-9600-34b4be855ace tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:47:43.228763 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-f2f08006-2f2f-4aaa-9600-34b4be855ace tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:47:43.383323 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-f2f08006-2f2f-4aaa-9600-34b4be855ace tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c83c05bec4f456d8aa7d51732ddc8af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b2a80a004e04da7ae12db9f3f87146f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:47:43.395039 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-f2f08006-2f2f-4aaa-9600-34b4be855ace tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] 10.222.0.20 "GET /compute/v2.1/servers/12bddea9-d545-43f2-9bf7-5e723900c8c6" status: 200 len: 1522 microversion: 2.1 time: 0.182456 Jul 06 13:47:43.405317 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 223/443] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:47:43 2022] GET /compute/v2.1/servers/12bddea9-d545-43f2-9bf7-5e723900c8c6 => generated 1522 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:47:44.130087 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-e5fe3e3b-0899-4ccc-9f40-67e5cbdc35f3 tempest-VolumesActionsTest-262392969 tempest-VolumesActionsTest-262392969-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:47:44.130645 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-e5fe3e3b-0899-4ccc-9f40-67e5cbdc35f3 tempest-VolumesActionsTest-262392969 tempest-VolumesActionsTest-262392969-project] [instance: b3afe313-9d49-40e7-afac-343f7950053e] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:47:44.137032 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-e5fe3e3b-0899-4ccc-9f40-67e5cbdc35f3 tempest-VolumesActionsTest-262392969 tempest-VolumesActionsTest-262392969-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:47:44.137491 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-e5fe3e3b-0899-4ccc-9f40-67e5cbdc35f3 tempest-VolumesActionsTest-262392969 tempest-VolumesActionsTest-262392969-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:47:44.138273 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-e5fe3e3b-0899-4ccc-9f40-67e5cbdc35f3 tempest-VolumesActionsTest-262392969 tempest-VolumesActionsTest-262392969-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:47:44.138705 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-e5fe3e3b-0899-4ccc-9f40-67e5cbdc35f3 tempest-VolumesActionsTest-262392969 tempest-VolumesActionsTest-262392969-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:47:44.290630 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-e5fe3e3b-0899-4ccc-9f40-67e5cbdc35f3 tempest-VolumesActionsTest-262392969 tempest-VolumesActionsTest-262392969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '050d5eb22b2c45ee85eb8c118b9ef21e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f9f86fa910c4054b31927ba26ea96b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:47:44.302869 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-e5fe3e3b-0899-4ccc-9f40-67e5cbdc35f3 tempest-VolumesActionsTest-262392969 tempest-VolumesActionsTest-262392969-project] 10.222.0.20 "GET /compute/v2.1/servers/b3afe313-9d49-40e7-afac-343f7950053e" status: 200 len: 1313 microversion: 2.1 time: 0.177608 Jul 06 13:47:44.303609 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 221/444] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:47:44 2022] GET /compute/v2.1/servers/b3afe313-9d49-40e7-afac-343f7950053e => generated 1313 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:47:44.412800 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-e7e02796-0194-44df-8570-e2484098300a tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Calling method '>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:47:44.413394 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-e7e02796-0194-44df-8570-e2484098300a tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] [instance: 12bddea9-d545-43f2-9bf7-5e723900c8c6] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:47:44.420650 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-e7e02796-0194-44df-8570-e2484098300a tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:47:44.421461 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-e7e02796-0194-44df-8570-e2484098300a tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:47:44.422417 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-e7e02796-0194-44df-8570-e2484098300a tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:47:44.422847 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-e7e02796-0194-44df-8570-e2484098300a tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:47:44.600489 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-e7e02796-0194-44df-8570-e2484098300a tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c83c05bec4f456d8aa7d51732ddc8af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b2a80a004e04da7ae12db9f3f87146f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:47:44.609394 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-e7e02796-0194-44df-8570-e2484098300a tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] 10.222.0.20 "GET /compute/v2.1/servers/12bddea9-d545-43f2-9bf7-5e723900c8c6" status: 200 len: 1522 microversion: 2.1 time: 0.201240 Jul 06 13:47:44.610209 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 224/445] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:47:44 2022] GET /compute/v2.1/servers/12bddea9-d545-43f2-9bf7-5e723900c8c6 => generated 1522 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:47:45.321065 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-3ea43793-0cd1-44f9-b845-fe426e6cd82d tempest-VolumesActionsTest-262392969 tempest-VolumesActionsTest-262392969-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:47:45.322937 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-3ea43793-0cd1-44f9-b845-fe426e6cd82d tempest-VolumesActionsTest-262392969 tempest-VolumesActionsTest-262392969-project] [instance: b3afe313-9d49-40e7-afac-343f7950053e] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:47:45.329970 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-3ea43793-0cd1-44f9-b845-fe426e6cd82d tempest-VolumesActionsTest-262392969 tempest-VolumesActionsTest-262392969-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:47:45.330559 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-3ea43793-0cd1-44f9-b845-fe426e6cd82d tempest-VolumesActionsTest-262392969 tempest-VolumesActionsTest-262392969-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:47:45.332869 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-3ea43793-0cd1-44f9-b845-fe426e6cd82d tempest-VolumesActionsTest-262392969 tempest-VolumesActionsTest-262392969-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:47:45.333671 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-3ea43793-0cd1-44f9-b845-fe426e6cd82d tempest-VolumesActionsTest-262392969 tempest-VolumesActionsTest-262392969-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:47:45.506984 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-3ea43793-0cd1-44f9-b845-fe426e6cd82d tempest-VolumesActionsTest-262392969 tempest-VolumesActionsTest-262392969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '050d5eb22b2c45ee85eb8c118b9ef21e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f9f86fa910c4054b31927ba26ea96b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:47:45.517243 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-3ea43793-0cd1-44f9-b845-fe426e6cd82d tempest-VolumesActionsTest-262392969 tempest-VolumesActionsTest-262392969-project] 10.222.0.20 "GET /compute/v2.1/servers/b3afe313-9d49-40e7-afac-343f7950053e" status: 200 len: 1498 microversion: 2.1 time: 0.200657 Jul 06 13:47:45.519394 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 222/446] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:47:45 2022] GET /compute/v2.1/servers/b3afe313-9d49-40e7-afac-343f7950053e => generated 1498 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:47:45.629472 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-fc540f5f-f496-463a-b38d-250f1f1f1b59 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Calling method '>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:47:45.630767 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-fc540f5f-f496-463a-b38d-250f1f1f1b59 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] [instance: 12bddea9-d545-43f2-9bf7-5e723900c8c6] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:47:45.642388 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-fc540f5f-f496-463a-b38d-250f1f1f1b59 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:47:45.643197 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-fc540f5f-f496-463a-b38d-250f1f1f1b59 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:47:45.645683 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-fc540f5f-f496-463a-b38d-250f1f1f1b59 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:47:45.646572 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-fc540f5f-f496-463a-b38d-250f1f1f1b59 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:47:45.856606 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-fc540f5f-f496-463a-b38d-250f1f1f1b59 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c83c05bec4f456d8aa7d51732ddc8af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b2a80a004e04da7ae12db9f3f87146f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:47:45.866973 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-fc540f5f-f496-463a-b38d-250f1f1f1b59 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] 10.222.0.20 "GET /compute/v2.1/servers/12bddea9-d545-43f2-9bf7-5e723900c8c6" status: 200 len: 1522 microversion: 2.1 time: 0.242110 Jul 06 13:47:45.867877 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 225/447] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:47:45 2022] GET /compute/v2.1/servers/12bddea9-d545-43f2-9bf7-5e723900c8c6 => generated 1522 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:47:46.233978 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-dab16154-e335-4005-8113-7addd12c1c11 tempest-VolumesActionsTest-262392969 tempest-VolumesActionsTest-262392969-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:47:46.234471 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-dab16154-e335-4005-8113-7addd12c1c11 tempest-VolumesActionsTest-262392969 tempest-VolumesActionsTest-262392969-project] [instance: b3afe313-9d49-40e7-afac-343f7950053e] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:47:46.244089 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-dab16154-e335-4005-8113-7addd12c1c11 tempest-VolumesActionsTest-262392969 tempest-VolumesActionsTest-262392969-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:47:46.244585 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-dab16154-e335-4005-8113-7addd12c1c11 tempest-VolumesActionsTest-262392969 tempest-VolumesActionsTest-262392969-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:47:46.245420 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-dab16154-e335-4005-8113-7addd12c1c11 tempest-VolumesActionsTest-262392969 tempest-VolumesActionsTest-262392969-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:47:46.246039 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-dab16154-e335-4005-8113-7addd12c1c11 tempest-VolumesActionsTest-262392969 tempest-VolumesActionsTest-262392969-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:47:46.282330 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-dab16154-e335-4005-8113-7addd12c1c11 tempest-VolumesActionsTest-262392969 tempest-VolumesActionsTest-262392969-project] [instance: b3afe313-9d49-40e7-afac-343f7950053e] Going to try to terminate instance {{(pid=124367) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 06 13:47:46.428737 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-dab16154-e335-4005-8113-7addd12c1c11 tempest-VolumesActionsTest-262392969 tempest-VolumesActionsTest-262392969-project] 10.222.0.20 "DELETE /compute/v2.1/servers/b3afe313-9d49-40e7-afac-343f7950053e" status: 204 len: 0 microversion: 2.1 time: 0.200109 Jul 06 13:47:46.429905 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 223/448] 10.222.0.20 () {58 vars in 1238 bytes} [Wed Jul 6 13:47:46 2022] DELETE /compute/v2.1/servers/b3afe313-9d49-40e7-afac-343f7950053e => generated 0 bytes in 203 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 06 13:47:46.438475 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-ee945ee5-8baa-4b92-b005-26f65d616693 tempest-VolumesActionsTest-262392969 tempest-VolumesActionsTest-262392969-project] Calling method '>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:47:46.439104 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-ee945ee5-8baa-4b92-b005-26f65d616693 tempest-VolumesActionsTest-262392969 tempest-VolumesActionsTest-262392969-project] [instance: b3afe313-9d49-40e7-afac-343f7950053e] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:47:46.447342 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-ee945ee5-8baa-4b92-b005-26f65d616693 tempest-VolumesActionsTest-262392969 tempest-VolumesActionsTest-262392969-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:47:46.447798 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-ee945ee5-8baa-4b92-b005-26f65d616693 tempest-VolumesActionsTest-262392969 tempest-VolumesActionsTest-262392969-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:47:46.448579 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-ee945ee5-8baa-4b92-b005-26f65d616693 tempest-VolumesActionsTest-262392969 tempest-VolumesActionsTest-262392969-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:47:46.449037 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-ee945ee5-8baa-4b92-b005-26f65d616693 tempest-VolumesActionsTest-262392969 tempest-VolumesActionsTest-262392969-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:47:46.636950 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-ee945ee5-8baa-4b92-b005-26f65d616693 tempest-VolumesActionsTest-262392969 tempest-VolumesActionsTest-262392969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '050d5eb22b2c45ee85eb8c118b9ef21e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f9f86fa910c4054b31927ba26ea96b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:47:46.653243 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-ee945ee5-8baa-4b92-b005-26f65d616693 tempest-VolumesActionsTest-262392969 tempest-VolumesActionsTest-262392969-project] 10.222.0.20 "GET /compute/v2.1/servers/b3afe313-9d49-40e7-afac-343f7950053e" status: 200 len: 1504 microversion: 2.1 time: 0.218589 Jul 06 13:47:46.654305 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 226/449] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:47:46 2022] GET /compute/v2.1/servers/b3afe313-9d49-40e7-afac-343f7950053e => generated 1504 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:47:46.887480 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-5fb5c5e9-3044-4ec6-875f-6e12695cf603 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:47:46.888576 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-5fb5c5e9-3044-4ec6-875f-6e12695cf603 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] [instance: 12bddea9-d545-43f2-9bf7-5e723900c8c6] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:47:46.903935 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-5fb5c5e9-3044-4ec6-875f-6e12695cf603 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:47:46.904730 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-5fb5c5e9-3044-4ec6-875f-6e12695cf603 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:47:46.908274 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-5fb5c5e9-3044-4ec6-875f-6e12695cf603 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:47:46.910021 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-5fb5c5e9-3044-4ec6-875f-6e12695cf603 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:47:47.160121 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-5fb5c5e9-3044-4ec6-875f-6e12695cf603 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c83c05bec4f456d8aa7d51732ddc8af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b2a80a004e04da7ae12db9f3f87146f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:47:47.169295 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-5fb5c5e9-3044-4ec6-875f-6e12695cf603 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] 10.222.0.20 "GET /compute/v2.1/servers/12bddea9-d545-43f2-9bf7-5e723900c8c6" status: 200 len: 1522 microversion: 2.1 time: 0.288852 Jul 06 13:47:47.169999 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 224/450] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:47:46 2022] GET /compute/v2.1/servers/12bddea9-d545-43f2-9bf7-5e723900c8c6 => generated 1522 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 06 13:47:47.678655 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-9b11c7a8-1daf-4dbb-b959-8efec4d66f66 tempest-VolumesActionsTest-262392969 tempest-VolumesActionsTest-262392969-project] Calling method '>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:47:47.680164 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-9b11c7a8-1daf-4dbb-b959-8efec4d66f66 tempest-VolumesActionsTest-262392969 tempest-VolumesActionsTest-262392969-project] [instance: b3afe313-9d49-40e7-afac-343f7950053e] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:47:47.703498 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-9b11c7a8-1daf-4dbb-b959-8efec4d66f66 tempest-VolumesActionsTest-262392969 tempest-VolumesActionsTest-262392969-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:47:47.706722 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-9b11c7a8-1daf-4dbb-b959-8efec4d66f66 tempest-VolumesActionsTest-262392969 tempest-VolumesActionsTest-262392969-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:47:47.709139 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-9b11c7a8-1daf-4dbb-b959-8efec4d66f66 tempest-VolumesActionsTest-262392969 tempest-VolumesActionsTest-262392969-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:47:47.709802 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-9b11c7a8-1daf-4dbb-b959-8efec4d66f66 tempest-VolumesActionsTest-262392969 tempest-VolumesActionsTest-262392969-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:47:47.945970 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-9b11c7a8-1daf-4dbb-b959-8efec4d66f66 tempest-VolumesActionsTest-262392969 tempest-VolumesActionsTest-262392969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '050d5eb22b2c45ee85eb8c118b9ef21e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f9f86fa910c4054b31927ba26ea96b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:47:47.957648 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-9b11c7a8-1daf-4dbb-b959-8efec4d66f66 tempest-VolumesActionsTest-262392969 tempest-VolumesActionsTest-262392969-project] 10.222.0.20 "GET /compute/v2.1/servers/b3afe313-9d49-40e7-afac-343f7950053e" status: 200 len: 1504 microversion: 2.1 time: 0.287089 Jul 06 13:47:47.958255 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 227/451] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:47:47 2022] GET /compute/v2.1/servers/b3afe313-9d49-40e7-afac-343f7950053e => generated 1504 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:47:48.189282 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-fd0c0141-7c4d-442d-a87a-3a9c7d533839 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:47:48.191231 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-fd0c0141-7c4d-442d-a87a-3a9c7d533839 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] [instance: 12bddea9-d545-43f2-9bf7-5e723900c8c6] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:47:48.216412 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-fd0c0141-7c4d-442d-a87a-3a9c7d533839 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:47:48.217749 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-fd0c0141-7c4d-442d-a87a-3a9c7d533839 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:47:48.218989 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-fd0c0141-7c4d-442d-a87a-3a9c7d533839 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:47:48.236120 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-fd0c0141-7c4d-442d-a87a-3a9c7d533839 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:47:48.515690 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-fd0c0141-7c4d-442d-a87a-3a9c7d533839 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c83c05bec4f456d8aa7d51732ddc8af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b2a80a004e04da7ae12db9f3f87146f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:47:48.523376 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-fd0c0141-7c4d-442d-a87a-3a9c7d533839 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] 10.222.0.20 "GET /compute/v2.1/servers/12bddea9-d545-43f2-9bf7-5e723900c8c6" status: 200 len: 1522 microversion: 2.1 time: 0.339346 Jul 06 13:47:48.539738 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 225/452] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:47:48 2022] GET /compute/v2.1/servers/12bddea9-d545-43f2-9bf7-5e723900c8c6 => generated 1522 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:47:48.976098 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-888d314c-b393-4713-b2c5-384f96847f17 tempest-VolumesActionsTest-262392969 tempest-VolumesActionsTest-262392969-project] Calling method '>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:47:48.977640 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-888d314c-b393-4713-b2c5-384f96847f17 tempest-VolumesActionsTest-262392969 tempest-VolumesActionsTest-262392969-project] [instance: b3afe313-9d49-40e7-afac-343f7950053e] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:47:48.985099 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-888d314c-b393-4713-b2c5-384f96847f17 tempest-VolumesActionsTest-262392969 tempest-VolumesActionsTest-262392969-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:47:48.986012 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-888d314c-b393-4713-b2c5-384f96847f17 tempest-VolumesActionsTest-262392969 tempest-VolumesActionsTest-262392969-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:47:48.986919 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-888d314c-b393-4713-b2c5-384f96847f17 tempest-VolumesActionsTest-262392969 tempest-VolumesActionsTest-262392969-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:47:48.988121 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-888d314c-b393-4713-b2c5-384f96847f17 tempest-VolumesActionsTest-262392969 tempest-VolumesActionsTest-262392969-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:47:49.045041 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-7314065f-070e-4ad1-9ea4-2f0ec8220a5d tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] Action: 'create', calling method: .version_select at 0x7ffbc42ebaf0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-2015858302", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGeFnDM99xYJj72BmB7klvnl+yN6BHoCwW+G0XJtNFqY85/HXkOUCRzEDaJsqwm/rrX4ZzeaJHhXW+c2Ait41PmxYur+3/58P+OsMPz/RLmauJNT8/l+urEZ3NNbvbMcww=="}} {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 06 13:47:49.066342 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.quota [None req-7314065f-070e-4ad1-9ea4-2f0ec8220a5d tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] Getting quotas for project 3ffa9da064c64346b5f227c28a89ea81. Resources: {'key_pairs'} {{(pid=124367) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 06 13:47:49.074367 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.quota [None req-7314065f-070e-4ad1-9ea4-2f0ec8220a5d tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] Getting quotas for user 19ccda8f7ce447c490910ffa14165c8b and project 3ffa9da064c64346b5f227c28a89ea81. Resources: {'key_pairs'} {{(pid=124367) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 06 13:47:49.101217 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-7314065f-070e-4ad1-9ea4-2f0ec8220a5d tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.061759 Jul 06 13:47:49.101979 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 226/453] 10.222.0.20 () {60 vars in 1158 bytes} [Wed Jul 6 13:47:49 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 06 13:47:49.229356 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-1f185c7a-68f2-42c7-8f75-71e47e8d967c tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-804926814", "imageRef": "08dd369f-3492-4d17-b02b-61219d6dc2b4", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-2015858302", "networks": [{"uuid": "0f788e92-d88f-409a-8e81-b02e1ed607f4"}]}} {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 06 13:47:49.247004 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-888d314c-b393-4713-b2c5-384f96847f17 tempest-VolumesActionsTest-262392969 tempest-VolumesActionsTest-262392969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '050d5eb22b2c45ee85eb8c118b9ef21e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f9f86fa910c4054b31927ba26ea96b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:47:49.255818 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-888d314c-b393-4713-b2c5-384f96847f17 tempest-VolumesActionsTest-262392969 tempest-VolumesActionsTest-262392969-project] 10.222.0.20 "GET /compute/v2.1/servers/b3afe313-9d49-40e7-afac-343f7950053e" status: 200 len: 1504 microversion: 2.1 time: 0.284665 Jul 06 13:47:49.257033 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 228/454] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:47:48 2022] GET /compute/v2.1/servers/b3afe313-9d49-40e7-afac-343f7950053e => generated 1504 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:47:49.262350 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [req-90b95a0f-b636-4516-8ba6-aaa62dd7134a req-f38970c6-945c-4a53-9ede-d130dc74c517 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b3afe313-9d49-40e7-afac-343f7950053e", "name": "network-vif-deleted", "tag": "c6613e8f-4caf-42de-865b-c8414e5bf45a"}]} {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 06 13:47:49.267157 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG dbcounter [-] [124368] Writing DB stats nova_api:SELECT=79,nova_api:INSERT=3 {{(pid=124368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:47:49.271845 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [req-90b95a0f-b636-4516-8ba6-aaa62dd7134a req-f38970c6-945c-4a53-9ede-d130dc74c517 service nova] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:47:49.272410 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [req-90b95a0f-b636-4516-8ba6-aaa62dd7134a req-f38970c6-945c-4a53-9ede-d130dc74c517 service nova] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:47:49.285561 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.compute.server_external_events [req-90b95a0f-b636-4516-8ba6-aaa62dd7134a req-f38970c6-945c-4a53-9ede-d130dc74c517 service nova] Creating event network-vif-deleted:c6613e8f-4caf-42de-865b-c8414e5bf45a for instance b3afe313-9d49-40e7-afac-343f7950053e on hv-cinder-81914 Jul 06 13:47:49.298720 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [req-90b95a0f-b636-4516-8ba6-aaa62dd7134a req-f38970c6-945c-4a53-9ede-d130dc74c517 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040246 Jul 06 13:47:49.299565 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 229/455] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 6 13:47:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 06 13:47:49.318222 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.network.neutron [None req-1f185c7a-68f2-42c7-8f75-71e47e8d967c tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] validate_networks() for [('0f788e92-d88f-409a-8e81-b02e1ed607f4', None, None, None, None, None)] {{(pid=124367) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 06 13:47:49.547448 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-f4fac28b-090b-48b3-811e-10886eca7ced tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Calling method '>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:47:49.548153 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-f4fac28b-090b-48b3-811e-10886eca7ced tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] [instance: 12bddea9-d545-43f2-9bf7-5e723900c8c6] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:47:49.554778 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-f4fac28b-090b-48b3-811e-10886eca7ced tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:47:49.555440 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-f4fac28b-090b-48b3-811e-10886eca7ced tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:47:49.556409 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-f4fac28b-090b-48b3-811e-10886eca7ced tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:47:49.557185 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-f4fac28b-090b-48b3-811e-10886eca7ced tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:47:49.721722 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-f4fac28b-090b-48b3-811e-10886eca7ced tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c83c05bec4f456d8aa7d51732ddc8af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b2a80a004e04da7ae12db9f3f87146f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:47:49.725220 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG dbcounter [-] [124368] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:47:49.734091 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-f4fac28b-090b-48b3-811e-10886eca7ced tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] 10.222.0.20 "GET /compute/v2.1/servers/12bddea9-d545-43f2-9bf7-5e723900c8c6" status: 200 len: 1522 microversion: 2.1 time: 0.190876 Jul 06 13:47:49.734675 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 230/456] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:47:49 2022] GET /compute/v2.1/servers/12bddea9-d545-43f2-9bf7-5e723900c8c6 => generated 1522 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:47:49.790308 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.virt.hardware [None req-1f185c7a-68f2-42c7-8f75-71e47e8d967c tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] Flavor limits 0:0:0 {{(pid=124367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 06 13:47:49.790854 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.virt.hardware [None req-1f185c7a-68f2-42c7-8f75-71e47e8d967c tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] Image limits 0:0:0 {{(pid=124367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 06 13:47:49.791314 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.virt.hardware [None req-1f185c7a-68f2-42c7-8f75-71e47e8d967c tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] Flavor pref 0:0:0 {{(pid=124367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 06 13:47:49.791747 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.virt.hardware [None req-1f185c7a-68f2-42c7-8f75-71e47e8d967c tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] Image pref 0:0:0 {{(pid=124367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 06 13:47:49.792244 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.virt.hardware [None req-1f185c7a-68f2-42c7-8f75-71e47e8d967c tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 06 13:47:49.802915 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-1f185c7a-68f2-42c7-8f75-71e47e8d967c tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:47:49.803361 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-1f185c7a-68f2-42c7-8f75-71e47e8d967c tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:47:49.804164 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-1f185c7a-68f2-42c7-8f75-71e47e8d967c tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:47:49.804585 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-1f185c7a-68f2-42c7-8f75-71e47e8d967c tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:47:49.822643 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.quota [None req-1f185c7a-68f2-42c7-8f75-71e47e8d967c tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] Getting quotas for project 3ffa9da064c64346b5f227c28a89ea81. Resources: {'instances', 'cores', 'ram'} {{(pid=124367) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 06 13:47:49.827442 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.quota [None req-1f185c7a-68f2-42c7-8f75-71e47e8d967c tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] Getting quotas for user 19ccda8f7ce447c490910ffa14165c8b and project 3ffa9da064c64346b5f227c28a89ea81. Resources: {'instances', 'cores', 'ram'} {{(pid=124367) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 06 13:47:49.839383 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-1f185c7a-68f2-42c7-8f75-71e47e8d967c tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] Going to run 1 instances... {{(pid=124367) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 06 13:47:49.841599 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-1f185c7a-68f2-42c7-8f75-71e47e8d967c tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] [instance: 4895b615-7e9b-4a58-ac74-008e7ba87aad] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='08dd369f-3492-4d17-b02b-61219d6dc2b4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124367) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 06 13:47:49.890290 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-1f185c7a-68f2-42c7-8f75-71e47e8d967c tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.665732 Jul 06 13:47:49.891090 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 227/457] 10.222.0.20 () {60 vars in 1146 bytes} [Wed Jul 6 13:47:49 2022] POST /compute/v2.1/servers => generated 380 bytes in 667 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 06 13:47:49.901473 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-7ff14b9f-32a1-4c46-a718-4640c7238944 tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] Calling method '>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:47:49.902085 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-7ff14b9f-32a1-4c46-a718-4640c7238944 tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] [instance: 4895b615-7e9b-4a58-ac74-008e7ba87aad] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:47:49.968138 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-7ff14b9f-32a1-4c46-a718-4640c7238944 tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19ccda8f7ce447c490910ffa14165c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ffa9da064c64346b5f227c28a89ea81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:47:49.977932 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-7ff14b9f-32a1-4c46-a718-4640c7238944 tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] 10.222.0.20 "GET /compute/v2.1/servers/4895b615-7e9b-4a58-ac74-008e7ba87aad" status: 200 len: 1258 microversion: 2.1 time: 0.080417 Jul 06 13:47:49.978721 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 231/458] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:47:49 2022] GET /compute/v2.1/servers/4895b615-7e9b-4a58-ac74-008e7ba87aad => generated 1258 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:47:50.273675 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-b15a7844-85af-4396-83eb-9358b26434f8 tempest-VolumesActionsTest-262392969 tempest-VolumesActionsTest-262392969-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:47:50.275036 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-b15a7844-85af-4396-83eb-9358b26434f8 tempest-VolumesActionsTest-262392969 tempest-VolumesActionsTest-262392969-project] [instance: b3afe313-9d49-40e7-afac-343f7950053e] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:47:50.283736 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-b15a7844-85af-4396-83eb-9358b26434f8 tempest-VolumesActionsTest-262392969 tempest-VolumesActionsTest-262392969-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:47:50.284690 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-b15a7844-85af-4396-83eb-9358b26434f8 tempest-VolumesActionsTest-262392969 tempest-VolumesActionsTest-262392969-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:47:50.285758 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-b15a7844-85af-4396-83eb-9358b26434f8 tempest-VolumesActionsTest-262392969 tempest-VolumesActionsTest-262392969-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:47:50.286381 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-b15a7844-85af-4396-83eb-9358b26434f8 tempest-VolumesActionsTest-262392969 tempest-VolumesActionsTest-262392969-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:47:50.379789 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-b15a7844-85af-4396-83eb-9358b26434f8 tempest-VolumesActionsTest-262392969 tempest-VolumesActionsTest-262392969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '050d5eb22b2c45ee85eb8c118b9ef21e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f9f86fa910c4054b31927ba26ea96b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:47:50.388804 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-b15a7844-85af-4396-83eb-9358b26434f8 tempest-VolumesActionsTest-262392969 tempest-VolumesActionsTest-262392969-project] 10.222.0.20 "GET /compute/v2.1/servers/b3afe313-9d49-40e7-afac-343f7950053e" status: 200 len: 1462 microversion: 2.1 time: 0.118928 Jul 06 13:47:50.389905 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 228/459] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:47:50 2022] GET /compute/v2.1/servers/b3afe313-9d49-40e7-afac-343f7950053e => generated 1462 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:47:50.751479 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-18518550-09c1-444a-a2a6-0e52a8469e59 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Calling method '>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:47:50.752392 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-18518550-09c1-444a-a2a6-0e52a8469e59 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] [instance: 12bddea9-d545-43f2-9bf7-5e723900c8c6] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:47:50.765448 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-18518550-09c1-444a-a2a6-0e52a8469e59 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:47:50.765997 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-18518550-09c1-444a-a2a6-0e52a8469e59 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:47:50.766867 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-18518550-09c1-444a-a2a6-0e52a8469e59 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:47:50.767386 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-18518550-09c1-444a-a2a6-0e52a8469e59 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:47:50.943024 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-18518550-09c1-444a-a2a6-0e52a8469e59 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c83c05bec4f456d8aa7d51732ddc8af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b2a80a004e04da7ae12db9f3f87146f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:47:50.950978 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-18518550-09c1-444a-a2a6-0e52a8469e59 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] 10.222.0.20 "GET /compute/v2.1/servers/12bddea9-d545-43f2-9bf7-5e723900c8c6" status: 200 len: 1522 microversion: 2.1 time: 0.203491 Jul 06 13:47:50.951814 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 232/460] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:47:50 2022] GET /compute/v2.1/servers/12bddea9-d545-43f2-9bf7-5e723900c8c6 => generated 1522 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:47:51.000321 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-001b7437-b40a-4ca5-a606-1ccbcfbb4d0f tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:47:51.001501 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-001b7437-b40a-4ca5-a606-1ccbcfbb4d0f tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] [instance: 4895b615-7e9b-4a58-ac74-008e7ba87aad] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:47:51.009575 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-001b7437-b40a-4ca5-a606-1ccbcfbb4d0f tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:47:51.010236 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-001b7437-b40a-4ca5-a606-1ccbcfbb4d0f tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:47:51.011154 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-001b7437-b40a-4ca5-a606-1ccbcfbb4d0f tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:47:51.011737 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-001b7437-b40a-4ca5-a606-1ccbcfbb4d0f tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:47:51.082469 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-001b7437-b40a-4ca5-a606-1ccbcfbb4d0f tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19ccda8f7ce447c490910ffa14165c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ffa9da064c64346b5f227c28a89ea81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:47:51.094129 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-001b7437-b40a-4ca5-a606-1ccbcfbb4d0f tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] 10.222.0.20 "GET /compute/v2.1/servers/4895b615-7e9b-4a58-ac74-008e7ba87aad" status: 200 len: 1310 microversion: 2.1 time: 0.101627 Jul 06 13:47:51.095273 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 229/461] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:47:50 2022] GET /compute/v2.1/servers/4895b615-7e9b-4a58-ac74-008e7ba87aad => generated 1310 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:47:51.407462 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-96df5cf1-ce7e-48ba-a634-f73d51a1ea65 tempest-VolumesActionsTest-262392969 tempest-VolumesActionsTest-262392969-project] Calling method '>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:47:51.408226 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-96df5cf1-ce7e-48ba-a634-f73d51a1ea65 tempest-VolumesActionsTest-262392969 tempest-VolumesActionsTest-262392969-project] [instance: b3afe313-9d49-40e7-afac-343f7950053e] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:47:51.415921 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-96df5cf1-ce7e-48ba-a634-f73d51a1ea65 tempest-VolumesActionsTest-262392969 tempest-VolumesActionsTest-262392969-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:47:51.416620 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-96df5cf1-ce7e-48ba-a634-f73d51a1ea65 tempest-VolumesActionsTest-262392969 tempest-VolumesActionsTest-262392969-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:47:51.417848 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-96df5cf1-ce7e-48ba-a634-f73d51a1ea65 tempest-VolumesActionsTest-262392969 tempest-VolumesActionsTest-262392969-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:47:51.418297 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-96df5cf1-ce7e-48ba-a634-f73d51a1ea65 tempest-VolumesActionsTest-262392969 tempest-VolumesActionsTest-262392969-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:47:51.453286 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-96df5cf1-ce7e-48ba-a634-f73d51a1ea65 tempest-VolumesActionsTest-262392969 tempest-VolumesActionsTest-262392969-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:47:51.453868 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-96df5cf1-ce7e-48ba-a634-f73d51a1ea65 tempest-VolumesActionsTest-262392969 tempest-VolumesActionsTest-262392969-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:47:51.454389 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.objects.instance [None req-96df5cf1-ce7e-48ba-a634-f73d51a1ea65 tempest-VolumesActionsTest-262392969 tempest-VolumesActionsTest-262392969-project] Lazy-loading 'fault' on Instance uuid b3afe313-9d49-40e7-afac-343f7950053e {{(pid=124368) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 06 13:47:51.500224 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-96df5cf1-ce7e-48ba-a634-f73d51a1ea65 tempest-VolumesActionsTest-262392969 tempest-VolumesActionsTest-262392969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '050d5eb22b2c45ee85eb8c118b9ef21e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f9f86fa910c4054b31927ba26ea96b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:47:51.512550 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-96df5cf1-ce7e-48ba-a634-f73d51a1ea65 tempest-VolumesActionsTest-262392969 tempest-VolumesActionsTest-262392969-project] 10.222.0.20 "GET /compute/v2.1/servers/b3afe313-9d49-40e7-afac-343f7950053e" status: 200 len: 1303 microversion: 2.1 time: 0.109725 Jul 06 13:47:51.513208 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 233/462] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:47:51 2022] GET /compute/v2.1/servers/b3afe313-9d49-40e7-afac-343f7950053e => generated 1303 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:47:51.968972 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-c6872757-23e1-4c5c-9d06-bc12e8aaf142 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:47:51.969595 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-c6872757-23e1-4c5c-9d06-bc12e8aaf142 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] [instance: 12bddea9-d545-43f2-9bf7-5e723900c8c6] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:47:51.976872 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-c6872757-23e1-4c5c-9d06-bc12e8aaf142 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:47:51.977494 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-c6872757-23e1-4c5c-9d06-bc12e8aaf142 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:47:51.978545 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-c6872757-23e1-4c5c-9d06-bc12e8aaf142 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:47:51.978981 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-c6872757-23e1-4c5c-9d06-bc12e8aaf142 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:47:52.112926 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-6518c54b-6ff4-42d5-aa32-5338ee10bf48 tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] Calling method '>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:47:52.114135 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-6518c54b-6ff4-42d5-aa32-5338ee10bf48 tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] [instance: 4895b615-7e9b-4a58-ac74-008e7ba87aad] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:47:52.122958 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-c6872757-23e1-4c5c-9d06-bc12e8aaf142 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c83c05bec4f456d8aa7d51732ddc8af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b2a80a004e04da7ae12db9f3f87146f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:47:52.127314 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-6518c54b-6ff4-42d5-aa32-5338ee10bf48 tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:47:52.127881 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-6518c54b-6ff4-42d5-aa32-5338ee10bf48 tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:47:52.129280 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-6518c54b-6ff4-42d5-aa32-5338ee10bf48 tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:47:52.130045 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-6518c54b-6ff4-42d5-aa32-5338ee10bf48 tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:47:52.132496 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-c6872757-23e1-4c5c-9d06-bc12e8aaf142 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] 10.222.0.20 "GET /compute/v2.1/servers/12bddea9-d545-43f2-9bf7-5e723900c8c6" status: 200 len: 1522 microversion: 2.1 time: 0.167269 Jul 06 13:47:52.137077 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 230/463] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:47:51 2022] GET /compute/v2.1/servers/12bddea9-d545-43f2-9bf7-5e723900c8c6 => generated 1522 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:47:52.194720 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-6518c54b-6ff4-42d5-aa32-5338ee10bf48 tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19ccda8f7ce447c490910ffa14165c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ffa9da064c64346b5f227c28a89ea81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:47:52.202263 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-6518c54b-6ff4-42d5-aa32-5338ee10bf48 tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] 10.222.0.20 "GET /compute/v2.1/servers/4895b615-7e9b-4a58-ac74-008e7ba87aad" status: 200 len: 1318 microversion: 2.1 time: 0.094529 Jul 06 13:47:52.202971 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 234/464] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:47:52 2022] GET /compute/v2.1/servers/4895b615-7e9b-4a58-ac74-008e7ba87aad => generated 1318 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 06 13:47:52.529776 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-6c698a48-18f9-44de-8877-647ac76bc1b2 tempest-VolumesActionsTest-262392969 tempest-VolumesActionsTest-262392969-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:47:52.530386 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-6c698a48-18f9-44de-8877-647ac76bc1b2 tempest-VolumesActionsTest-262392969 tempest-VolumesActionsTest-262392969-project] [instance: b3afe313-9d49-40e7-afac-343f7950053e] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:47:52.532665 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG dbcounter [-] [124367] Writing DB stats nova_api:SELECT=91,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=124367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:47:52.539884 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-6c698a48-18f9-44de-8877-647ac76bc1b2 tempest-VolumesActionsTest-262392969 tempest-VolumesActionsTest-262392969-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:47:52.540336 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-6c698a48-18f9-44de-8877-647ac76bc1b2 tempest-VolumesActionsTest-262392969 tempest-VolumesActionsTest-262392969-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:47:52.541156 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-6c698a48-18f9-44de-8877-647ac76bc1b2 tempest-VolumesActionsTest-262392969 tempest-VolumesActionsTest-262392969-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:47:52.541595 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-6c698a48-18f9-44de-8877-647ac76bc1b2 tempest-VolumesActionsTest-262392969 tempest-VolumesActionsTest-262392969-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:47:52.559873 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.wsgi [None req-6c698a48-18f9-44de-8877-647ac76bc1b2 tempest-VolumesActionsTest-262392969 tempest-VolumesActionsTest-262392969-project] HTTP exception thrown: Instance b3afe313-9d49-40e7-afac-343f7950053e could not be found. Jul 06 13:47:52.561812 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-6c698a48-18f9-44de-8877-647ac76bc1b2 tempest-VolumesActionsTest-262392969 tempest-VolumesActionsTest-262392969-project] Request method failure captured: Jul 06 13:47:52.561812 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: request: GET /compute/v2.1/servers/b3afe313-9d49-40e7-afac-343f7950053e HTTP/1.1 Jul 06 13:47:52.561812 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: Accept: application/json Jul 06 13:47:52.561812 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: Accept-Encoding: identity Jul 06 13:47:52.561812 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: Connection: close Jul 06 13:47:52.561812 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: Content-Length: 0 Jul 06 13:47:52.561812 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: Content-Type: application/json Jul 06 13:47:52.561812 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: Host: 10.222.0.20 Jul 06 13:47:52.561812 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: Openstack-System-Scope: None Jul 06 13:47:52.561812 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: User-Agent: python-urllib3/1.26.9 Jul 06 13:47:52.561812 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: X-Auth-Token: gAAAAABixZI7S08CZ_Z2xPPc_vtcRYeEHxjf6c7ve3y6I7RiE4vYMm-NF7QXt-XS4AQ1AKRVtU7YrHK93nn3z76tZ7D7VRvtLmRCEYQLTT8P9_RH3u1EVlWyRG-4JNZ-431yP5iPGLoLxQ4yruXwTLyOc66m2Jh4gM5K-_OMNNm3ffI-9Shoytw Jul 06 13:47:52.561812 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: X-Domain-Id: None Jul 06 13:47:52.561812 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: X-Domain-Name: None Jul 06 13:47:52.561812 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: X-Identity-Status: Confirmed Jul 06 13:47:52.561812 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: X-Is-Admin-Project: True Jul 06 13:47:52.561812 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: X-Project-Domain-Id: default Jul 06 13:47:52.561812 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: X-Project-Domain-Name: Default Jul 06 13:47:52.561812 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: X-Project-Id: 2f9f86fa910c4054b31927ba26ea96b9 Jul 06 13:47:52.561812 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: X-Project-Name: tempest-VolumesActionsTest-262392969 Jul 06 13:47:52.561812 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: X-Role: reader,member Jul 06 13:47:52.561812 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: X-Roles: reader,member Jul 06 13:47:52.563483 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_2f9f86fa910c4054b31927ba26ea96b9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2f9f86fa910c4054b31927ba26ea96b9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2f9f86fa910c4054b31927ba26ea96b9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/2f9f86fa910c4054b31927ba26ea96b9"}]}] Jul 06 13:47:52.563483 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: X-Tenant: tempest-VolumesActionsTest-262392969 Jul 06 13:47:52.563483 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: X-Tenant-Id: 2f9f86fa910c4054b31927ba26ea96b9 Jul 06 13:47:52.563483 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: X-Tenant-Name: tempest-VolumesActionsTest-262392969 Jul 06 13:47:52.563483 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: X-User: tempest-VolumesActionsTest-262392969-project Jul 06 13:47:52.563483 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: X-User-Domain-Id: default Jul 06 13:47:52.563483 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: X-User-Domain-Name: Default Jul 06 13:47:52.563483 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: X-User-Id: 050d5eb22b2c45ee85eb8c118b9ef21e Jul 06 13:47:52.563483 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: X-User-Name: tempest-VolumesActionsTest-262392969-project Jul 06 13:47:52.563483 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: method: > Jul 06 13:47:52.563483 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: exception: Instance b3afe313-9d49-40e7-afac-343f7950053e could not be found. Jul 06 13:47:52.563483 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: action_args: {'id': 'b3afe313-9d49-40e7-afac-343f7950053e'} Jul 06 13:47:52.564315 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 06 13:47:52.564315 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 06 13:47:52.564315 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 06 13:47:52.564315 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 06 13:47:52.564315 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 06 13:47:52.564315 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 06 13:47:52.564315 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 06 13:47:52.564315 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 06 13:47:52.564315 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 06 13:47:52.564315 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 06 13:47:52.564315 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b3afe313-9d49-40e7-afac-343f7950053e could not be found. Jul 06 13:47:52.564315 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi Jul 06 13:47:52.564315 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 06 13:47:52.564315 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi Jul 06 13:47:52.564315 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 06 13:47:52.564315 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 06 13:47:52.564315 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 06 13:47:52.564315 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 06 13:47:52.564315 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 06 13:47:52.564315 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 06 13:47:52.566480 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 06 13:47:52.566480 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 06 13:47:52.566480 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 06 13:47:52.566480 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 06 13:47:52.566480 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 06 13:47:52.566480 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 06 13:47:52.566480 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 06 13:47:52.566480 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b3afe313-9d49-40e7-afac-343f7950053e could not be found. Jul 06 13:47:52.566480 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi Jul 06 13:47:52.566480 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 06 13:47:52.566480 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi Jul 06 13:47:52.566480 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 06 13:47:52.566480 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 06 13:47:52.566480 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 06 13:47:52.566480 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 06 13:47:52.566480 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 06 13:47:52.566480 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b3afe313-9d49-40e7-afac-343f7950053e could not be found. Jul 06 13:47:52.566480 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi Jul 06 13:47:52.567565 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-6c698a48-18f9-44de-8877-647ac76bc1b2 tempest-VolumesActionsTest-262392969 tempest-VolumesActionsTest-262392969-project] Returning 404 to user: Instance b3afe313-9d49-40e7-afac-343f7950053e could not be found. {{(pid=124367) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 06 13:47:52.567565 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-6c698a48-18f9-44de-8877-647ac76bc1b2 tempest-VolumesActionsTest-262392969 tempest-VolumesActionsTest-262392969-project] 10.222.0.20 "GET /compute/v2.1/servers/b3afe313-9d49-40e7-afac-343f7950053e" status: 404 len: 111 microversion: 2.1 time: 0.037555 Jul 06 13:47:52.567565 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 231/465] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:47:52 2022] GET /compute/v2.1/servers/b3afe313-9d49-40e7-afac-343f7950053e => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 06 13:47:53.151651 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-e9930a75-0341-4884-9b45-5e66853d7315 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Calling method '>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:47:53.152059 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-e9930a75-0341-4884-9b45-5e66853d7315 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] [instance: 12bddea9-d545-43f2-9bf7-5e723900c8c6] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:47:53.162985 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-e9930a75-0341-4884-9b45-5e66853d7315 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:47:53.164776 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-e9930a75-0341-4884-9b45-5e66853d7315 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:47:53.165601 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-e9930a75-0341-4884-9b45-5e66853d7315 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:47:53.166042 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-e9930a75-0341-4884-9b45-5e66853d7315 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:47:53.220861 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-a3d4737b-f01f-47eb-acd3-71fa4d50fdd5 tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:47:53.224266 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-a3d4737b-f01f-47eb-acd3-71fa4d50fdd5 tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] [instance: 4895b615-7e9b-4a58-ac74-008e7ba87aad] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:47:53.246789 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-a3d4737b-f01f-47eb-acd3-71fa4d50fdd5 tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:47:53.247237 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-a3d4737b-f01f-47eb-acd3-71fa4d50fdd5 tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:47:53.248021 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-a3d4737b-f01f-47eb-acd3-71fa4d50fdd5 tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:47:53.248446 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-a3d4737b-f01f-47eb-acd3-71fa4d50fdd5 tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:47:53.396250 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-e9930a75-0341-4884-9b45-5e66853d7315 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c83c05bec4f456d8aa7d51732ddc8af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b2a80a004e04da7ae12db9f3f87146f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:47:53.404985 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-e9930a75-0341-4884-9b45-5e66853d7315 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] 10.222.0.20 "GET /compute/v2.1/servers/12bddea9-d545-43f2-9bf7-5e723900c8c6" status: 200 len: 1502 microversion: 2.1 time: 0.258898 Jul 06 13:47:53.406146 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 235/466] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:47:53 2022] GET /compute/v2.1/servers/12bddea9-d545-43f2-9bf7-5e723900c8c6 => generated 1502 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:47:53.426558 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-a492c69e-f630-42fc-b77e-c782d6e96ca8 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "757c4ccd-d138-4ac3-ad54-3917b4a1b839"}} {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 06 13:47:53.429368 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-a492c69e-f630-42fc-b77e-c782d6e96ca8 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] [instance: 12bddea9-d545-43f2-9bf7-5e723900c8c6] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:47:53.436026 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-a492c69e-f630-42fc-b77e-c782d6e96ca8 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:47:53.436944 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-a492c69e-f630-42fc-b77e-c782d6e96ca8 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:47:53.438090 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-a492c69e-f630-42fc-b77e-c782d6e96ca8 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:47:53.438850 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-a492c69e-f630-42fc-b77e-c782d6e96ca8 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:47:53.456594 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-a3d4737b-f01f-47eb-acd3-71fa4d50fdd5 tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19ccda8f7ce447c490910ffa14165c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ffa9da064c64346b5f227c28a89ea81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:47:53.464784 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-a3d4737b-f01f-47eb-acd3-71fa4d50fdd5 tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] 10.222.0.20 "GET /compute/v2.1/servers/4895b615-7e9b-4a58-ac74-008e7ba87aad" status: 200 len: 1358 microversion: 2.1 time: 0.249080 Jul 06 13:47:53.465389 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 232/467] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:47:53 2022] GET /compute/v2.1/servers/4895b615-7e9b-4a58-ac74-008e7ba87aad => generated 1358 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 06 13:47:53.468913 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.wsgi [None req-a492c69e-f630-42fc-b77e-c782d6e96ca8 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] HTTP exception thrown: Cannot 'attach_volume' instance 12bddea9-d545-43f2-9bf7-5e723900c8c6 while it is in vm_state rescued Jul 06 13:47:53.478806 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-a492c69e-f630-42fc-b77e-c782d6e96ca8 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Request method failure captured: Jul 06 13:47:53.478806 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: request: POST /compute/v2.1/servers/12bddea9-d545-43f2-9bf7-5e723900c8c6/os-volume_attachments HTTP/1.1 Jul 06 13:47:53.478806 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: Accept: application/json Jul 06 13:47:53.478806 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: Accept-Encoding: identity Jul 06 13:47:53.478806 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: Connection: close Jul 06 13:47:53.478806 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: Content-Length: 74 Jul 06 13:47:53.478806 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: Content-Type: application/json Jul 06 13:47:53.478806 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: Host: 10.222.0.20 Jul 06 13:47:53.478806 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: Openstack-System-Scope: None Jul 06 13:47:53.478806 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: User-Agent: python-urllib3/1.26.9 Jul 06 13:47:53.478806 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Auth-Token: gAAAAABixZH75p1b2ILOi45fcNF92-zTsRsIgZ35DgQcq749C0w1kkYHYWHbuoMJGGkHW9WPBjYh0zxzWH474VrSUUR4tFNhBBNpjbmin3OznzgbylsUH2zxuJOhwhiPNwMppgS72cUuSxmI0bW6Nxx2svX__3EGBU7RgRf-kZZLsUGvLTS4iek Jul 06 13:47:53.478806 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Domain-Id: None Jul 06 13:47:53.478806 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Domain-Name: None Jul 06 13:47:53.478806 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Identity-Status: Confirmed Jul 06 13:47:53.478806 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Is-Admin-Project: True Jul 06 13:47:53.478806 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Project-Domain-Id: default Jul 06 13:47:53.478806 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Project-Domain-Name: Default Jul 06 13:47:53.478806 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Project-Id: 3b2a80a004e04da7ae12db9f3f87146f Jul 06 13:47:53.478806 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-428270635 Jul 06 13:47:53.478806 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Role: reader,member Jul 06 13:47:53.478806 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Roles: reader,member Jul 06 13:47:53.480376 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_3b2a80a004e04da7ae12db9f3f87146f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/3b2a80a004e04da7ae12db9f3f87146f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/3b2a80a004e04da7ae12db9f3f87146f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/3b2a80a004e04da7ae12db9f3f87146f"}]}] Jul 06 13:47:53.480376 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Tenant: tempest-ServerRescueNegativeTestJSON-428270635 Jul 06 13:47:53.480376 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Tenant-Id: 3b2a80a004e04da7ae12db9f3f87146f Jul 06 13:47:53.480376 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-428270635 Jul 06 13:47:53.480376 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-User: tempest-ServerRescueNegativeTestJSON-428270635-project Jul 06 13:47:53.480376 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-User-Domain-Id: default Jul 06 13:47:53.480376 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-User-Domain-Name: Default Jul 06 13:47:53.480376 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-User-Id: 0c83c05bec4f456d8aa7d51732ddc8af Jul 06 13:47:53.480376 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-User-Name: tempest-ServerRescueNegativeTestJSON-428270635-project Jul 06 13:47:53.480376 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: Jul 06 13:47:53.480376 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: {"volumeAttachment": {"volumeId": "757c4ccd-d138-4ac3-ad54-3917b4a1b839"}} Jul 06 13:47:53.480376 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: method: > Jul 06 13:47:53.481174 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: exception: Cannot 'attach_volume' instance 12bddea9-d545-43f2-9bf7-5e723900c8c6 while it is in vm_state rescued Jul 06 13:47:53.481174 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: action_args: {'server_id': '12bddea9-d545-43f2-9bf7-5e723900c8c6', 'body': {'volumeAttachment': {'volumeId': '757c4ccd-d138-4ac3-ad54-3917b4a1b839'}}} Jul 06 13:47:53.481174 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 06 13:47:53.481174 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 06 13:47:53.481174 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 06 13:47:53.481174 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 06 13:47:53.481174 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 06 13:47:53.481174 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 06 13:47:53.481174 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 06 13:47:53.481174 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 06 13:47:53.481174 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 12bddea9-d545-43f2-9bf7-5e723900c8c6 in vm_state rescued. Cannot attach_volume while the instance is in this state. Jul 06 13:47:53.481174 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi Jul 06 13:47:53.481174 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 06 13:47:53.481174 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi Jul 06 13:47:53.481174 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 06 13:47:53.481174 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 06 13:47:53.481174 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 06 13:47:53.481174 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 06 13:47:53.481174 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 06 13:47:53.482256 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 06 13:47:53.482256 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 06 13:47:53.482256 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 06 13:47:53.482256 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 06 13:47:53.482256 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 06 13:47:53.482256 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 06 13:47:53.482256 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 06 13:47:53.482256 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 06 13:47:53.482256 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Jul 06 13:47:53.482256 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 06 13:47:53.482256 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 06 13:47:53.482256 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 06 13:47:53.482256 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 12bddea9-d545-43f2-9bf7-5e723900c8c6 while it is in vm_state rescued Jul 06 13:47:53.482256 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi Jul 06 13:47:53.482256 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 06 13:47:53.482256 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi Jul 06 13:47:53.482256 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 06 13:47:53.482256 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 06 13:47:53.482256 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 06 13:47:53.483332 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 06 13:47:53.483332 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 06 13:47:53.483332 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 12bddea9-d545-43f2-9bf7-5e723900c8c6 while it is in vm_state rescued Jul 06 13:47:53.483332 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi Jul 06 13:47:53.483332 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-a492c69e-f630-42fc-b77e-c782d6e96ca8 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Returning 409 to user: Cannot 'attach_volume' instance 12bddea9-d545-43f2-9bf7-5e723900c8c6 while it is in vm_state rescued {{(pid=124368) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 06 13:47:53.483332 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-a492c69e-f630-42fc-b77e-c782d6e96ca8 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] 10.222.0.20 "POST /compute/v2.1/servers/12bddea9-d545-43f2-9bf7-5e723900c8c6/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.061311 Jul 06 13:47:53.483332 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 236/468] 10.222.0.20 () {60 vars in 1322 bytes} [Wed Jul 6 13:47:53 2022] POST /compute/v2.1/servers/12bddea9-d545-43f2-9bf7-5e723900c8c6/os-volume_attachments => generated 152 bytes in 63 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 06 13:47:53.490345 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-9ebfaad1-ed35-4429-9989-f633ac0062f3 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 06 13:47:53.490869 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-9ebfaad1-ed35-4429-9989-f633ac0062f3 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] [instance: 12bddea9-d545-43f2-9bf7-5e723900c8c6] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:47:53.497605 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-9ebfaad1-ed35-4429-9989-f633ac0062f3 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:47:53.498296 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-9ebfaad1-ed35-4429-9989-f633ac0062f3 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:47:53.499321 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-9ebfaad1-ed35-4429-9989-f633ac0062f3 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:47:53.499960 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-9ebfaad1-ed35-4429-9989-f633ac0062f3 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:47:53.502625 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG dbcounter [-] [124367] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:47:53.575647 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-9ebfaad1-ed35-4429-9989-f633ac0062f3 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] 10.222.0.20 "POST /compute/v2.1/servers/12bddea9-d545-43f2-9bf7-5e723900c8c6/action" status: 202 len: 0 microversion: 2.1 time: 0.089497 Jul 06 13:47:53.579326 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 233/469] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Jul 6 13:47:53 2022] POST /compute/v2.1/servers/12bddea9-d545-43f2-9bf7-5e723900c8c6/action => generated 0 bytes in 91 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 06 13:47:53.585151 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-6fc5bcce-fc3c-4fcb-9be0-9b39e0d8ab98 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Calling method '>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:47:53.586018 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-6fc5bcce-fc3c-4fcb-9be0-9b39e0d8ab98 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] [instance: 12bddea9-d545-43f2-9bf7-5e723900c8c6] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:47:53.592449 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-6fc5bcce-fc3c-4fcb-9be0-9b39e0d8ab98 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:47:53.593357 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-6fc5bcce-fc3c-4fcb-9be0-9b39e0d8ab98 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:47:53.593944 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-6fc5bcce-fc3c-4fcb-9be0-9b39e0d8ab98 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:47:53.594464 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-6fc5bcce-fc3c-4fcb-9be0-9b39e0d8ab98 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:47:53.801356 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-6fc5bcce-fc3c-4fcb-9be0-9b39e0d8ab98 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c83c05bec4f456d8aa7d51732ddc8af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b2a80a004e04da7ae12db9f3f87146f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:47:53.815431 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-6fc5bcce-fc3c-4fcb-9be0-9b39e0d8ab98 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] 10.222.0.20 "GET /compute/v2.1/servers/12bddea9-d545-43f2-9bf7-5e723900c8c6" status: 200 len: 1510 microversion: 2.1 time: 0.234838 Jul 06 13:47:53.817063 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 237/470] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:47:53 2022] GET /compute/v2.1/servers/12bddea9-d545-43f2-9bf7-5e723900c8c6 => generated 1510 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:47:54.483140 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-4b602ba5-c0c0-47f7-b313-44135d65c5fb tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:47:54.483827 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-4b602ba5-c0c0-47f7-b313-44135d65c5fb tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] [instance: 4895b615-7e9b-4a58-ac74-008e7ba87aad] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:47:54.490974 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-4b602ba5-c0c0-47f7-b313-44135d65c5fb tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:47:54.491425 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-4b602ba5-c0c0-47f7-b313-44135d65c5fb tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:47:54.492200 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-4b602ba5-c0c0-47f7-b313-44135d65c5fb tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:47:54.492625 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-4b602ba5-c0c0-47f7-b313-44135d65c5fb tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:47:54.657891 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-4b602ba5-c0c0-47f7-b313-44135d65c5fb tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19ccda8f7ce447c490910ffa14165c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ffa9da064c64346b5f227c28a89ea81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:47:54.659288 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [req-a7cce454-9f68-4a33-859b-32736a2ac492 req-22b35cbb-1f2b-4fcf-8f0d-60edb0830098 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4895b615-7e9b-4a58-ac74-008e7ba87aad", "tag": "41ac049c-27f7-4531-b7d5-cc2e3f0f8c79"}]} {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 06 13:47:54.667713 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [req-a7cce454-9f68-4a33-859b-32736a2ac492 req-22b35cbb-1f2b-4fcf-8f0d-60edb0830098 service nova] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:47:54.668166 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [req-a7cce454-9f68-4a33-859b-32736a2ac492 req-22b35cbb-1f2b-4fcf-8f0d-60edb0830098 service nova] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:47:54.668598 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-4b602ba5-c0c0-47f7-b313-44135d65c5fb tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] 10.222.0.20 "GET /compute/v2.1/servers/4895b615-7e9b-4a58-ac74-008e7ba87aad" status: 200 len: 1358 microversion: 2.1 time: 0.189706 Jul 06 13:47:54.679502 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 234/471] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:47:54 2022] GET /compute/v2.1/servers/4895b615-7e9b-4a58-ac74-008e7ba87aad => generated 1358 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:47:54.693704 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.compute.server_external_events [req-a7cce454-9f68-4a33-859b-32736a2ac492 req-22b35cbb-1f2b-4fcf-8f0d-60edb0830098 service nova] Creating event network-changed:41ac049c-27f7-4531-b7d5-cc2e3f0f8c79 for instance 4895b615-7e9b-4a58-ac74-008e7ba87aad on hv-cinder-81914 Jul 06 13:47:54.698945 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [req-a7cce454-9f68-4a33-859b-32736a2ac492 req-22b35cbb-1f2b-4fcf-8f0d-60edb0830098 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043217 Jul 06 13:47:54.699928 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 238/472] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 6 13:47:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 06 13:47:54.833631 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-5b0368df-9daa-4653-a10e-54e473f4b0c1 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:47:54.834172 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-5b0368df-9daa-4653-a10e-54e473f4b0c1 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] [instance: 12bddea9-d545-43f2-9bf7-5e723900c8c6] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:47:54.840066 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-5b0368df-9daa-4653-a10e-54e473f4b0c1 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:47:54.840510 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-5b0368df-9daa-4653-a10e-54e473f4b0c1 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:47:54.841292 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-5b0368df-9daa-4653-a10e-54e473f4b0c1 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:47:54.841729 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-5b0368df-9daa-4653-a10e-54e473f4b0c1 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:47:54.967737 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-5b0368df-9daa-4653-a10e-54e473f4b0c1 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c83c05bec4f456d8aa7d51732ddc8af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b2a80a004e04da7ae12db9f3f87146f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:47:54.975658 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-5b0368df-9daa-4653-a10e-54e473f4b0c1 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] 10.222.0.20 "GET /compute/v2.1/servers/12bddea9-d545-43f2-9bf7-5e723900c8c6" status: 200 len: 1510 microversion: 2.1 time: 0.145974 Jul 06 13:47:54.976216 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 235/473] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:47:54 2022] GET /compute/v2.1/servers/12bddea9-d545-43f2-9bf7-5e723900c8c6 => generated 1510 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:47:55.686786 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-de41cf41-8bae-44a8-ad0f-eda0ecb63594 tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] Calling method '>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:47:55.687425 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-de41cf41-8bae-44a8-ad0f-eda0ecb63594 tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] [instance: 4895b615-7e9b-4a58-ac74-008e7ba87aad] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:47:55.694155 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-de41cf41-8bae-44a8-ad0f-eda0ecb63594 tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:47:55.694601 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-de41cf41-8bae-44a8-ad0f-eda0ecb63594 tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:47:55.695351 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-de41cf41-8bae-44a8-ad0f-eda0ecb63594 tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:47:55.695789 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-de41cf41-8bae-44a8-ad0f-eda0ecb63594 tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:47:55.827730 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-de41cf41-8bae-44a8-ad0f-eda0ecb63594 tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19ccda8f7ce447c490910ffa14165c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ffa9da064c64346b5f227c28a89ea81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:47:55.836522 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-de41cf41-8bae-44a8-ad0f-eda0ecb63594 tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] 10.222.0.20 "GET /compute/v2.1/servers/4895b615-7e9b-4a58-ac74-008e7ba87aad" status: 200 len: 1358 microversion: 2.1 time: 0.154450 Jul 06 13:47:55.837268 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 239/474] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:47:55 2022] GET /compute/v2.1/servers/4895b615-7e9b-4a58-ac74-008e7ba87aad => generated 1358 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:47:55.993485 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-b20aa42e-c7c6-48e7-a560-b7e77d0705aa tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:47:55.994094 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-b20aa42e-c7c6-48e7-a560-b7e77d0705aa tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] [instance: 12bddea9-d545-43f2-9bf7-5e723900c8c6] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:47:56.000080 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-b20aa42e-c7c6-48e7-a560-b7e77d0705aa tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:47:56.000529 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-b20aa42e-c7c6-48e7-a560-b7e77d0705aa tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:47:56.001322 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-b20aa42e-c7c6-48e7-a560-b7e77d0705aa tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:47:56.001757 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-b20aa42e-c7c6-48e7-a560-b7e77d0705aa tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:47:56.130463 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-b20aa42e-c7c6-48e7-a560-b7e77d0705aa tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c83c05bec4f456d8aa7d51732ddc8af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b2a80a004e04da7ae12db9f3f87146f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:47:56.137878 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-b20aa42e-c7c6-48e7-a560-b7e77d0705aa tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] 10.222.0.20 "GET /compute/v2.1/servers/12bddea9-d545-43f2-9bf7-5e723900c8c6" status: 200 len: 1510 microversion: 2.1 time: 0.148270 Jul 06 13:47:56.138428 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 236/475] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:47:55 2022] GET /compute/v2.1/servers/12bddea9-d545-43f2-9bf7-5e723900c8c6 => generated 1510 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:47:56.853051 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-c452451e-f348-443e-9a6a-6ec6ac985c27 tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] Calling method '>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:47:56.853665 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-c452451e-f348-443e-9a6a-6ec6ac985c27 tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] [instance: 4895b615-7e9b-4a58-ac74-008e7ba87aad] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:47:56.860058 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-c452451e-f348-443e-9a6a-6ec6ac985c27 tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:47:56.860502 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-c452451e-f348-443e-9a6a-6ec6ac985c27 tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:47:56.861285 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-c452451e-f348-443e-9a6a-6ec6ac985c27 tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:47:56.861723 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-c452451e-f348-443e-9a6a-6ec6ac985c27 tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:47:56.994138 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-c452451e-f348-443e-9a6a-6ec6ac985c27 tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19ccda8f7ce447c490910ffa14165c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ffa9da064c64346b5f227c28a89ea81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:47:57.001450 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-c452451e-f348-443e-9a6a-6ec6ac985c27 tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] 10.222.0.20 "GET /compute/v2.1/servers/4895b615-7e9b-4a58-ac74-008e7ba87aad" status: 200 len: 1358 microversion: 2.1 time: 0.152185 Jul 06 13:47:57.002016 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 240/476] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:47:56 2022] GET /compute/v2.1/servers/4895b615-7e9b-4a58-ac74-008e7ba87aad => generated 1358 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:47:57.155264 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-03a2c0a1-3f60-46aa-8673-66c171a43307 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:47:57.155928 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-03a2c0a1-3f60-46aa-8673-66c171a43307 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] [instance: 12bddea9-d545-43f2-9bf7-5e723900c8c6] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:47:57.162712 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-03a2c0a1-3f60-46aa-8673-66c171a43307 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:47:57.163159 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-03a2c0a1-3f60-46aa-8673-66c171a43307 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:47:57.163916 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-03a2c0a1-3f60-46aa-8673-66c171a43307 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:47:57.164342 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-03a2c0a1-3f60-46aa-8673-66c171a43307 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:47:57.302742 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-03a2c0a1-3f60-46aa-8673-66c171a43307 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c83c05bec4f456d8aa7d51732ddc8af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b2a80a004e04da7ae12db9f3f87146f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:47:57.311341 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-03a2c0a1-3f60-46aa-8673-66c171a43307 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] 10.222.0.20 "GET /compute/v2.1/servers/12bddea9-d545-43f2-9bf7-5e723900c8c6" status: 200 len: 1510 microversion: 2.1 time: 0.159991 Jul 06 13:47:57.317565 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 237/477] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:47:57 2022] GET /compute/v2.1/servers/12bddea9-d545-43f2-9bf7-5e723900c8c6 => generated 1510 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:47:58.019909 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-06cd4c38-defa-4851-a7ee-9e28a6ba6986 tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] Calling method '>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:47:58.020537 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-06cd4c38-defa-4851-a7ee-9e28a6ba6986 tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] [instance: 4895b615-7e9b-4a58-ac74-008e7ba87aad] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:47:58.027375 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-06cd4c38-defa-4851-a7ee-9e28a6ba6986 tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:47:58.027897 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-06cd4c38-defa-4851-a7ee-9e28a6ba6986 tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:47:58.028738 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-06cd4c38-defa-4851-a7ee-9e28a6ba6986 tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:47:58.029534 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-06cd4c38-defa-4851-a7ee-9e28a6ba6986 tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:47:58.173660 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-06cd4c38-defa-4851-a7ee-9e28a6ba6986 tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19ccda8f7ce447c490910ffa14165c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ffa9da064c64346b5f227c28a89ea81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:47:58.181235 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-06cd4c38-defa-4851-a7ee-9e28a6ba6986 tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] 10.222.0.20 "GET /compute/v2.1/servers/4895b615-7e9b-4a58-ac74-008e7ba87aad" status: 200 len: 1358 microversion: 2.1 time: 0.166363 Jul 06 13:47:58.181803 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 241/478] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:47:58 2022] GET /compute/v2.1/servers/4895b615-7e9b-4a58-ac74-008e7ba87aad => generated 1358 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:47:58.329694 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-c2edf3ff-1d44-41c4-944d-8a5a91954ea4 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:47:58.330295 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-c2edf3ff-1d44-41c4-944d-8a5a91954ea4 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] [instance: 12bddea9-d545-43f2-9bf7-5e723900c8c6] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:47:58.336826 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-c2edf3ff-1d44-41c4-944d-8a5a91954ea4 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:47:58.337337 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-c2edf3ff-1d44-41c4-944d-8a5a91954ea4 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:47:58.338093 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-c2edf3ff-1d44-41c4-944d-8a5a91954ea4 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:47:58.338509 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-c2edf3ff-1d44-41c4-944d-8a5a91954ea4 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:47:58.484650 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-c2edf3ff-1d44-41c4-944d-8a5a91954ea4 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c83c05bec4f456d8aa7d51732ddc8af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b2a80a004e04da7ae12db9f3f87146f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:47:58.493527 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-c2edf3ff-1d44-41c4-944d-8a5a91954ea4 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] 10.222.0.20 "GET /compute/v2.1/servers/12bddea9-d545-43f2-9bf7-5e723900c8c6" status: 200 len: 1510 microversion: 2.1 time: 0.167960 Jul 06 13:47:58.494040 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 238/479] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:47:58 2022] GET /compute/v2.1/servers/12bddea9-d545-43f2-9bf7-5e723900c8c6 => generated 1510 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:47:59.198790 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-7d1cc96a-da5e-4f0d-8c95-8bf726aa8512 tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] Calling method '>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:47:59.199333 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-7d1cc96a-da5e-4f0d-8c95-8bf726aa8512 tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] [instance: 4895b615-7e9b-4a58-ac74-008e7ba87aad] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:47:59.206691 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-7d1cc96a-da5e-4f0d-8c95-8bf726aa8512 tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:47:59.207146 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-7d1cc96a-da5e-4f0d-8c95-8bf726aa8512 tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:47:59.207920 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-7d1cc96a-da5e-4f0d-8c95-8bf726aa8512 tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:47:59.208387 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-7d1cc96a-da5e-4f0d-8c95-8bf726aa8512 tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:47:59.336280 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-7d1cc96a-da5e-4f0d-8c95-8bf726aa8512 tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19ccda8f7ce447c490910ffa14165c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ffa9da064c64346b5f227c28a89ea81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:47:59.343579 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-7d1cc96a-da5e-4f0d-8c95-8bf726aa8512 tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] 10.222.0.20 "GET /compute/v2.1/servers/4895b615-7e9b-4a58-ac74-008e7ba87aad" status: 200 len: 1358 microversion: 2.1 time: 0.148804 Jul 06 13:47:59.344139 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 242/480] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:47:59 2022] GET /compute/v2.1/servers/4895b615-7e9b-4a58-ac74-008e7ba87aad => generated 1358 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:47:59.511023 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-52d940b9-4411-4a6f-a511-d544a03e38ae tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:47:59.511656 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-52d940b9-4411-4a6f-a511-d544a03e38ae tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] [instance: 12bddea9-d545-43f2-9bf7-5e723900c8c6] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:47:59.517645 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-52d940b9-4411-4a6f-a511-d544a03e38ae tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:47:59.518280 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-52d940b9-4411-4a6f-a511-d544a03e38ae tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:47:59.519562 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-52d940b9-4411-4a6f-a511-d544a03e38ae tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:47:59.519995 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-52d940b9-4411-4a6f-a511-d544a03e38ae tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:47:59.652221 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-52d940b9-4411-4a6f-a511-d544a03e38ae tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c83c05bec4f456d8aa7d51732ddc8af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b2a80a004e04da7ae12db9f3f87146f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:47:59.660120 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-52d940b9-4411-4a6f-a511-d544a03e38ae tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] 10.222.0.20 "GET /compute/v2.1/servers/12bddea9-d545-43f2-9bf7-5e723900c8c6" status: 200 len: 1510 microversion: 2.1 time: 0.152880 Jul 06 13:47:59.660693 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 239/481] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:47:59 2022] GET /compute/v2.1/servers/12bddea9-d545-43f2-9bf7-5e723900c8c6 => generated 1510 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:48:00.361197 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-06172268-3436-4053-9ea6-d303946a58b9 tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] Calling method '>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:48:00.362877 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-06172268-3436-4053-9ea6-d303946a58b9 tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] [instance: 4895b615-7e9b-4a58-ac74-008e7ba87aad] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:48:00.364476 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG dbcounter [-] [124368] Writing DB stats nova_cell0:SELECT=2 {{(pid=124368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:48:00.370257 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-06172268-3436-4053-9ea6-d303946a58b9 tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:48:00.370713 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-06172268-3436-4053-9ea6-d303946a58b9 tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:48:00.371483 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-06172268-3436-4053-9ea6-d303946a58b9 tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:48:00.371928 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-06172268-3436-4053-9ea6-d303946a58b9 tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:48:00.502230 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-06172268-3436-4053-9ea6-d303946a58b9 tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19ccda8f7ce447c490910ffa14165c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ffa9da064c64346b5f227c28a89ea81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:48:00.509608 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-06172268-3436-4053-9ea6-d303946a58b9 tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] 10.222.0.20 "GET /compute/v2.1/servers/4895b615-7e9b-4a58-ac74-008e7ba87aad" status: 200 len: 1358 microversion: 2.1 time: 0.152553 Jul 06 13:48:00.510173 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 243/482] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:48:00 2022] GET /compute/v2.1/servers/4895b615-7e9b-4a58-ac74-008e7ba87aad => generated 1358 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:48:00.678328 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-5bdd45d1-9866-45d6-bd39-1de2db561f56 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:48:00.678913 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-5bdd45d1-9866-45d6-bd39-1de2db561f56 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] [instance: 12bddea9-d545-43f2-9bf7-5e723900c8c6] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:48:00.680963 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG dbcounter [-] [124367] Writing DB stats nova_cell0:SELECT=2 {{(pid=124367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:48:00.681710 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG dbcounter [-] [124367] Writing DB stats nova_cell0:SELECT=10 {{(pid=124367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:48:00.687472 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-5bdd45d1-9866-45d6-bd39-1de2db561f56 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:48:00.687918 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-5bdd45d1-9866-45d6-bd39-1de2db561f56 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:48:00.688688 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-5bdd45d1-9866-45d6-bd39-1de2db561f56 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:48:00.689142 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-5bdd45d1-9866-45d6-bd39-1de2db561f56 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:48:00.827620 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-5bdd45d1-9866-45d6-bd39-1de2db561f56 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c83c05bec4f456d8aa7d51732ddc8af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b2a80a004e04da7ae12db9f3f87146f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:48:00.845632 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-5bdd45d1-9866-45d6-bd39-1de2db561f56 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] 10.222.0.20 "GET /compute/v2.1/servers/12bddea9-d545-43f2-9bf7-5e723900c8c6" status: 200 len: 1510 microversion: 2.1 time: 0.172257 Jul 06 13:48:00.847532 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 240/483] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:48:00 2022] GET /compute/v2.1/servers/12bddea9-d545-43f2-9bf7-5e723900c8c6 => generated 1510 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:48:01.526761 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-0d0b3051-5501-4fd6-ab24-f5a11edcfa1d tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] Calling method '>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:48:01.527467 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-0d0b3051-5501-4fd6-ab24-f5a11edcfa1d tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] [instance: 4895b615-7e9b-4a58-ac74-008e7ba87aad] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:48:01.534149 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-0d0b3051-5501-4fd6-ab24-f5a11edcfa1d tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:48:01.534798 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-0d0b3051-5501-4fd6-ab24-f5a11edcfa1d tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:48:01.535583 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-0d0b3051-5501-4fd6-ab24-f5a11edcfa1d tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:48:01.536023 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-0d0b3051-5501-4fd6-ab24-f5a11edcfa1d tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:48:01.680139 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-0d0b3051-5501-4fd6-ab24-f5a11edcfa1d tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19ccda8f7ce447c490910ffa14165c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ffa9da064c64346b5f227c28a89ea81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:48:01.689400 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-0d0b3051-5501-4fd6-ab24-f5a11edcfa1d tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] 10.222.0.20 "GET /compute/v2.1/servers/4895b615-7e9b-4a58-ac74-008e7ba87aad" status: 200 len: 1358 microversion: 2.1 time: 0.166360 Jul 06 13:48:01.699100 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 244/484] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:48:01 2022] GET /compute/v2.1/servers/4895b615-7e9b-4a58-ac74-008e7ba87aad => generated 1358 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:48:01.868061 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-292d57af-a5bc-4c3d-a13e-717d09bc1cc5 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:48:01.868677 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-292d57af-a5bc-4c3d-a13e-717d09bc1cc5 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] [instance: 12bddea9-d545-43f2-9bf7-5e723900c8c6] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:48:01.875372 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-292d57af-a5bc-4c3d-a13e-717d09bc1cc5 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:48:01.875821 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-292d57af-a5bc-4c3d-a13e-717d09bc1cc5 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:48:01.876805 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-292d57af-a5bc-4c3d-a13e-717d09bc1cc5 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:48:01.877775 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-292d57af-a5bc-4c3d-a13e-717d09bc1cc5 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:48:02.006383 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-292d57af-a5bc-4c3d-a13e-717d09bc1cc5 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c83c05bec4f456d8aa7d51732ddc8af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b2a80a004e04da7ae12db9f3f87146f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:48:02.013737 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-292d57af-a5bc-4c3d-a13e-717d09bc1cc5 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] 10.222.0.20 "GET /compute/v2.1/servers/12bddea9-d545-43f2-9bf7-5e723900c8c6" status: 200 len: 1510 microversion: 2.1 time: 0.154195 Jul 06 13:48:02.014290 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 241/485] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:48:01 2022] GET /compute/v2.1/servers/12bddea9-d545-43f2-9bf7-5e723900c8c6 => generated 1510 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:48:02.708141 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-c106a631-6c60-48e8-be9a-147191eb8a53 tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] Calling method '>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:48:02.709490 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-c106a631-6c60-48e8-be9a-147191eb8a53 tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] [instance: 4895b615-7e9b-4a58-ac74-008e7ba87aad] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:48:02.716140 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-c106a631-6c60-48e8-be9a-147191eb8a53 tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:48:02.716583 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-c106a631-6c60-48e8-be9a-147191eb8a53 tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:48:02.717563 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-c106a631-6c60-48e8-be9a-147191eb8a53 tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:48:02.717995 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-c106a631-6c60-48e8-be9a-147191eb8a53 tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:48:02.854919 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-c106a631-6c60-48e8-be9a-147191eb8a53 tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19ccda8f7ce447c490910ffa14165c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ffa9da064c64346b5f227c28a89ea81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:48:02.862583 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-c106a631-6c60-48e8-be9a-147191eb8a53 tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] 10.222.0.20 "GET /compute/v2.1/servers/4895b615-7e9b-4a58-ac74-008e7ba87aad" status: 200 len: 1358 microversion: 2.1 time: 0.159285 Jul 06 13:48:02.863342 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 245/486] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:48:02 2022] GET /compute/v2.1/servers/4895b615-7e9b-4a58-ac74-008e7ba87aad => generated 1358 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:48:03.030920 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-1797f79b-08a2-4918-a7bb-840fce392e70 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:48:03.031532 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-1797f79b-08a2-4918-a7bb-840fce392e70 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] [instance: 12bddea9-d545-43f2-9bf7-5e723900c8c6] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:48:03.038850 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-1797f79b-08a2-4918-a7bb-840fce392e70 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:48:03.039453 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-1797f79b-08a2-4918-a7bb-840fce392e70 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:48:03.040260 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-1797f79b-08a2-4918-a7bb-840fce392e70 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:48:03.040718 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-1797f79b-08a2-4918-a7bb-840fce392e70 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:48:03.185515 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-1797f79b-08a2-4918-a7bb-840fce392e70 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c83c05bec4f456d8aa7d51732ddc8af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b2a80a004e04da7ae12db9f3f87146f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:48:03.193644 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-1797f79b-08a2-4918-a7bb-840fce392e70 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] 10.222.0.20 "GET /compute/v2.1/servers/12bddea9-d545-43f2-9bf7-5e723900c8c6" status: 200 len: 1510 microversion: 2.1 time: 0.166619 Jul 06 13:48:03.194207 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 242/487] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:48:03 2022] GET /compute/v2.1/servers/12bddea9-d545-43f2-9bf7-5e723900c8c6 => generated 1510 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:48:03.879857 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-51025352-d743-4cef-926c-106c7764d4da tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] Calling method '>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:48:03.880463 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-51025352-d743-4cef-926c-106c7764d4da tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] [instance: 4895b615-7e9b-4a58-ac74-008e7ba87aad] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:48:03.886816 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-51025352-d743-4cef-926c-106c7764d4da tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:48:03.887259 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-51025352-d743-4cef-926c-106c7764d4da tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:48:03.888010 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-51025352-d743-4cef-926c-106c7764d4da tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:48:03.888437 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-51025352-d743-4cef-926c-106c7764d4da tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:48:04.019552 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-51025352-d743-4cef-926c-106c7764d4da tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19ccda8f7ce447c490910ffa14165c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ffa9da064c64346b5f227c28a89ea81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:48:04.026763 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-51025352-d743-4cef-926c-106c7764d4da tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] 10.222.0.20 "GET /compute/v2.1/servers/4895b615-7e9b-4a58-ac74-008e7ba87aad" status: 200 len: 1358 microversion: 2.1 time: 0.151341 Jul 06 13:48:04.027392 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 246/488] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:48:03 2022] GET /compute/v2.1/servers/4895b615-7e9b-4a58-ac74-008e7ba87aad => generated 1358 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:48:04.211812 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-43e38f8a-d8a1-4fe0-9185-998108ea3059 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:48:04.212639 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-43e38f8a-d8a1-4fe0-9185-998108ea3059 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] [instance: 12bddea9-d545-43f2-9bf7-5e723900c8c6] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:48:04.218631 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-43e38f8a-d8a1-4fe0-9185-998108ea3059 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:48:04.219060 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-43e38f8a-d8a1-4fe0-9185-998108ea3059 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:48:04.219826 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-43e38f8a-d8a1-4fe0-9185-998108ea3059 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:48:04.220252 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-43e38f8a-d8a1-4fe0-9185-998108ea3059 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:48:04.352069 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-43e38f8a-d8a1-4fe0-9185-998108ea3059 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c83c05bec4f456d8aa7d51732ddc8af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b2a80a004e04da7ae12db9f3f87146f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:48:04.359472 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-43e38f8a-d8a1-4fe0-9185-998108ea3059 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] 10.222.0.20 "GET /compute/v2.1/servers/12bddea9-d545-43f2-9bf7-5e723900c8c6" status: 200 len: 1510 microversion: 2.1 time: 0.151608 Jul 06 13:48:04.360026 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 243/489] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:48:04 2022] GET /compute/v2.1/servers/12bddea9-d545-43f2-9bf7-5e723900c8c6 => generated 1510 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:48:05.044029 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-19ff4e0a-eb15-4dba-9ad3-1664444052e3 tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] Calling method '>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:48:05.044684 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-19ff4e0a-eb15-4dba-9ad3-1664444052e3 tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] [instance: 4895b615-7e9b-4a58-ac74-008e7ba87aad] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:48:05.052234 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-19ff4e0a-eb15-4dba-9ad3-1664444052e3 tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:48:05.052675 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-19ff4e0a-eb15-4dba-9ad3-1664444052e3 tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:48:05.053475 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-19ff4e0a-eb15-4dba-9ad3-1664444052e3 tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:48:05.053907 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-19ff4e0a-eb15-4dba-9ad3-1664444052e3 tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:48:05.188197 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-19ff4e0a-eb15-4dba-9ad3-1664444052e3 tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19ccda8f7ce447c490910ffa14165c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ffa9da064c64346b5f227c28a89ea81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:48:05.196771 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-19ff4e0a-eb15-4dba-9ad3-1664444052e3 tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] 10.222.0.20 "GET /compute/v2.1/servers/4895b615-7e9b-4a58-ac74-008e7ba87aad" status: 200 len: 1358 microversion: 2.1 time: 0.156907 Jul 06 13:48:05.197372 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 247/490] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:48:05 2022] GET /compute/v2.1/servers/4895b615-7e9b-4a58-ac74-008e7ba87aad => generated 1358 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:48:05.378037 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-6e3ee6d1-99fa-49f3-93db-a3afde990d33 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:48:05.378749 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-6e3ee6d1-99fa-49f3-93db-a3afde990d33 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] [instance: 12bddea9-d545-43f2-9bf7-5e723900c8c6] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:48:05.384803 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-6e3ee6d1-99fa-49f3-93db-a3afde990d33 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:48:05.385227 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-6e3ee6d1-99fa-49f3-93db-a3afde990d33 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:48:05.385982 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-6e3ee6d1-99fa-49f3-93db-a3afde990d33 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:48:05.386407 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-6e3ee6d1-99fa-49f3-93db-a3afde990d33 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:48:05.523595 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-6e3ee6d1-99fa-49f3-93db-a3afde990d33 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c83c05bec4f456d8aa7d51732ddc8af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b2a80a004e04da7ae12db9f3f87146f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:48:05.531302 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-6e3ee6d1-99fa-49f3-93db-a3afde990d33 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] 10.222.0.20 "GET /compute/v2.1/servers/12bddea9-d545-43f2-9bf7-5e723900c8c6" status: 200 len: 1510 microversion: 2.1 time: 0.157706 Jul 06 13:48:05.531882 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 244/491] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:48:05 2022] GET /compute/v2.1/servers/12bddea9-d545-43f2-9bf7-5e723900c8c6 => generated 1510 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:48:06.212985 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-74cc97b9-7848-4b81-ab2e-c53d00f302b0 tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] Calling method '>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:48:06.213670 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-74cc97b9-7848-4b81-ab2e-c53d00f302b0 tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] [instance: 4895b615-7e9b-4a58-ac74-008e7ba87aad] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:48:06.220120 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-74cc97b9-7848-4b81-ab2e-c53d00f302b0 tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:48:06.220577 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-74cc97b9-7848-4b81-ab2e-c53d00f302b0 tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:48:06.221562 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-74cc97b9-7848-4b81-ab2e-c53d00f302b0 tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:48:06.222204 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-74cc97b9-7848-4b81-ab2e-c53d00f302b0 tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:48:06.372045 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-74cc97b9-7848-4b81-ab2e-c53d00f302b0 tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19ccda8f7ce447c490910ffa14165c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ffa9da064c64346b5f227c28a89ea81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:48:06.380378 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-74cc97b9-7848-4b81-ab2e-c53d00f302b0 tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] 10.222.0.20 "GET /compute/v2.1/servers/4895b615-7e9b-4a58-ac74-008e7ba87aad" status: 200 len: 1358 microversion: 2.1 time: 0.171368 Jul 06 13:48:06.380945 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 248/492] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:48:06 2022] GET /compute/v2.1/servers/4895b615-7e9b-4a58-ac74-008e7ba87aad => generated 1358 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:48:06.551053 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-6834ffb2-1f8b-4a95-b755-de26d23b6542 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:48:06.551737 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-6834ffb2-1f8b-4a95-b755-de26d23b6542 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] [instance: 12bddea9-d545-43f2-9bf7-5e723900c8c6] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:48:06.565509 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-6834ffb2-1f8b-4a95-b755-de26d23b6542 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:48:06.566072 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-6834ffb2-1f8b-4a95-b755-de26d23b6542 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:48:06.569975 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-6834ffb2-1f8b-4a95-b755-de26d23b6542 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:48:06.570416 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-6834ffb2-1f8b-4a95-b755-de26d23b6542 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:48:06.719399 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-6834ffb2-1f8b-4a95-b755-de26d23b6542 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c83c05bec4f456d8aa7d51732ddc8af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b2a80a004e04da7ae12db9f3f87146f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:48:06.730296 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-6834ffb2-1f8b-4a95-b755-de26d23b6542 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] 10.222.0.20 "GET /compute/v2.1/servers/12bddea9-d545-43f2-9bf7-5e723900c8c6" status: 200 len: 1510 microversion: 2.1 time: 0.184069 Jul 06 13:48:06.730884 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 245/493] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:48:06 2022] GET /compute/v2.1/servers/12bddea9-d545-43f2-9bf7-5e723900c8c6 => generated 1510 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:48:07.397464 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-e5e8891a-c271-4fa8-a4f8-f9de6df585d2 tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] Calling method '>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:48:07.398119 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-e5e8891a-c271-4fa8-a4f8-f9de6df585d2 tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] [instance: 4895b615-7e9b-4a58-ac74-008e7ba87aad] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:48:07.405049 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-e5e8891a-c271-4fa8-a4f8-f9de6df585d2 tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:48:07.405502 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-e5e8891a-c271-4fa8-a4f8-f9de6df585d2 tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:48:07.406319 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-e5e8891a-c271-4fa8-a4f8-f9de6df585d2 tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:48:07.406751 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-e5e8891a-c271-4fa8-a4f8-f9de6df585d2 tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:48:07.412272 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG dbcounter [-] [124368] Writing DB stats nova_cell1:SELECT=100 {{(pid=124368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:48:07.539454 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-e5e8891a-c271-4fa8-a4f8-f9de6df585d2 tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19ccda8f7ce447c490910ffa14165c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ffa9da064c64346b5f227c28a89ea81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:48:07.547119 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-e5e8891a-c271-4fa8-a4f8-f9de6df585d2 tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] 10.222.0.20 "GET /compute/v2.1/servers/4895b615-7e9b-4a58-ac74-008e7ba87aad" status: 200 len: 1358 microversion: 2.1 time: 0.154485 Jul 06 13:48:07.547694 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 249/494] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:48:07 2022] GET /compute/v2.1/servers/4895b615-7e9b-4a58-ac74-008e7ba87aad => generated 1358 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:48:07.747712 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-bec61577-1d17-43ac-8bb8-7b5b3a10fbf0 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:48:07.748388 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-bec61577-1d17-43ac-8bb8-7b5b3a10fbf0 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] [instance: 12bddea9-d545-43f2-9bf7-5e723900c8c6] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:48:07.757146 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-bec61577-1d17-43ac-8bb8-7b5b3a10fbf0 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:48:07.757953 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-bec61577-1d17-43ac-8bb8-7b5b3a10fbf0 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:48:07.758973 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-bec61577-1d17-43ac-8bb8-7b5b3a10fbf0 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:48:07.759926 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-bec61577-1d17-43ac-8bb8-7b5b3a10fbf0 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:48:08.000056 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-bec61577-1d17-43ac-8bb8-7b5b3a10fbf0 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c83c05bec4f456d8aa7d51732ddc8af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b2a80a004e04da7ae12db9f3f87146f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:48:08.010338 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-bec61577-1d17-43ac-8bb8-7b5b3a10fbf0 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] 10.222.0.20 "GET /compute/v2.1/servers/12bddea9-d545-43f2-9bf7-5e723900c8c6" status: 200 len: 1510 microversion: 2.1 time: 0.266467 Jul 06 13:48:08.011795 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 246/495] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:48:07 2022] GET /compute/v2.1/servers/12bddea9-d545-43f2-9bf7-5e723900c8c6 => generated 1510 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:48:08.566168 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-73444637-f282-4cb4-93f5-4c1ad0a215e4 tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] Calling method '>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:48:08.567507 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-73444637-f282-4cb4-93f5-4c1ad0a215e4 tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] [instance: 4895b615-7e9b-4a58-ac74-008e7ba87aad] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:48:08.579686 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-73444637-f282-4cb4-93f5-4c1ad0a215e4 tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:48:08.581950 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-73444637-f282-4cb4-93f5-4c1ad0a215e4 tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:48:08.586018 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-73444637-f282-4cb4-93f5-4c1ad0a215e4 tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:48:08.586504 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-73444637-f282-4cb4-93f5-4c1ad0a215e4 tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:48:08.832672 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-73444637-f282-4cb4-93f5-4c1ad0a215e4 tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19ccda8f7ce447c490910ffa14165c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ffa9da064c64346b5f227c28a89ea81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:48:08.842934 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-73444637-f282-4cb4-93f5-4c1ad0a215e4 tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] 10.222.0.20 "GET /compute/v2.1/servers/4895b615-7e9b-4a58-ac74-008e7ba87aad" status: 200 len: 1358 microversion: 2.1 time: 0.281423 Jul 06 13:48:08.843816 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 250/496] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:48:08 2022] GET /compute/v2.1/servers/4895b615-7e9b-4a58-ac74-008e7ba87aad => generated 1358 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:48:09.030108 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-81f9ccbc-ce30-4472-823a-9e972416afb0 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:48:09.030958 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-81f9ccbc-ce30-4472-823a-9e972416afb0 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] [instance: 12bddea9-d545-43f2-9bf7-5e723900c8c6] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:48:09.046750 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-81f9ccbc-ce30-4472-823a-9e972416afb0 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:48:09.047489 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-81f9ccbc-ce30-4472-823a-9e972416afb0 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:48:09.048441 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-81f9ccbc-ce30-4472-823a-9e972416afb0 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:48:09.050133 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-81f9ccbc-ce30-4472-823a-9e972416afb0 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:48:09.441587 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-81f9ccbc-ce30-4472-823a-9e972416afb0 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c83c05bec4f456d8aa7d51732ddc8af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b2a80a004e04da7ae12db9f3f87146f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:48:09.448468 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-81f9ccbc-ce30-4472-823a-9e972416afb0 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] 10.222.0.20 "GET /compute/v2.1/servers/12bddea9-d545-43f2-9bf7-5e723900c8c6" status: 200 len: 1510 microversion: 2.1 time: 0.422531 Jul 06 13:48:09.450479 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 247/497] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:48:09 2022] GET /compute/v2.1/servers/12bddea9-d545-43f2-9bf7-5e723900c8c6 => generated 1510 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:48:09.860521 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-474017de-7502-4677-bef7-3e5f8f87fa65 tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] Calling method '>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:48:09.861276 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-474017de-7502-4677-bef7-3e5f8f87fa65 tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] [instance: 4895b615-7e9b-4a58-ac74-008e7ba87aad] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:48:09.874515 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-474017de-7502-4677-bef7-3e5f8f87fa65 tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:48:09.875376 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-474017de-7502-4677-bef7-3e5f8f87fa65 tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:48:09.876456 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-474017de-7502-4677-bef7-3e5f8f87fa65 tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:48:09.877995 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-474017de-7502-4677-bef7-3e5f8f87fa65 tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:48:10.162048 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-474017de-7502-4677-bef7-3e5f8f87fa65 tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19ccda8f7ce447c490910ffa14165c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ffa9da064c64346b5f227c28a89ea81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:48:10.171479 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-474017de-7502-4677-bef7-3e5f8f87fa65 tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] 10.222.0.20 "GET /compute/v2.1/servers/4895b615-7e9b-4a58-ac74-008e7ba87aad" status: 200 len: 1358 microversion: 2.1 time: 0.314869 Jul 06 13:48:10.177050 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 251/498] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:48:09 2022] GET /compute/v2.1/servers/4895b615-7e9b-4a58-ac74-008e7ba87aad => generated 1358 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:48:10.473563 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-09e21de0-dda2-4d27-8e78-f72018f1b5a9 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:48:10.474954 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-09e21de0-dda2-4d27-8e78-f72018f1b5a9 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] [instance: 12bddea9-d545-43f2-9bf7-5e723900c8c6] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:48:10.499976 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-09e21de0-dda2-4d27-8e78-f72018f1b5a9 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:48:10.499976 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-09e21de0-dda2-4d27-8e78-f72018f1b5a9 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:48:10.499976 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-09e21de0-dda2-4d27-8e78-f72018f1b5a9 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:48:10.499976 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-09e21de0-dda2-4d27-8e78-f72018f1b5a9 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:48:10.781801 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-09e21de0-dda2-4d27-8e78-f72018f1b5a9 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c83c05bec4f456d8aa7d51732ddc8af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b2a80a004e04da7ae12db9f3f87146f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:48:10.784576 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG dbcounter [-] [124367] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:48:10.798081 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-09e21de0-dda2-4d27-8e78-f72018f1b5a9 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] 10.222.0.20 "GET /compute/v2.1/servers/12bddea9-d545-43f2-9bf7-5e723900c8c6" status: 200 len: 1510 microversion: 2.1 time: 0.328316 Jul 06 13:48:10.804321 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 248/499] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:48:10 2022] GET /compute/v2.1/servers/12bddea9-d545-43f2-9bf7-5e723900c8c6 => generated 1510 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:48:11.193604 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-b8b3a3a4-3b44-4b6f-b264-7effa3fd9c5f tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] Calling method '>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:48:11.196486 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-b8b3a3a4-3b44-4b6f-b264-7effa3fd9c5f tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] [instance: 4895b615-7e9b-4a58-ac74-008e7ba87aad] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:48:11.202456 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-b8b3a3a4-3b44-4b6f-b264-7effa3fd9c5f tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:48:11.206236 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-b8b3a3a4-3b44-4b6f-b264-7effa3fd9c5f tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:48:11.207350 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-b8b3a3a4-3b44-4b6f-b264-7effa3fd9c5f tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:48:11.210911 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-b8b3a3a4-3b44-4b6f-b264-7effa3fd9c5f tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:48:11.442057 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-b8b3a3a4-3b44-4b6f-b264-7effa3fd9c5f tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19ccda8f7ce447c490910ffa14165c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ffa9da064c64346b5f227c28a89ea81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:48:11.455452 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-b8b3a3a4-3b44-4b6f-b264-7effa3fd9c5f tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] 10.222.0.20 "GET /compute/v2.1/servers/4895b615-7e9b-4a58-ac74-008e7ba87aad" status: 200 len: 1358 microversion: 2.1 time: 0.264817 Jul 06 13:48:11.456630 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 252/500] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:48:11 2022] GET /compute/v2.1/servers/4895b615-7e9b-4a58-ac74-008e7ba87aad => generated 1358 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:48:11.818933 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-1924fec7-24b8-4edb-babd-d0b6a4bf21dc tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:48:11.819565 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-1924fec7-24b8-4edb-babd-d0b6a4bf21dc tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] [instance: 12bddea9-d545-43f2-9bf7-5e723900c8c6] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:48:11.829615 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-1924fec7-24b8-4edb-babd-d0b6a4bf21dc tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:48:11.831027 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-1924fec7-24b8-4edb-babd-d0b6a4bf21dc tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:48:11.831987 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-1924fec7-24b8-4edb-babd-d0b6a4bf21dc tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:48:11.832677 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-1924fec7-24b8-4edb-babd-d0b6a4bf21dc tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:48:12.056912 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-1924fec7-24b8-4edb-babd-d0b6a4bf21dc tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c83c05bec4f456d8aa7d51732ddc8af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b2a80a004e04da7ae12db9f3f87146f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:48:12.068848 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-1924fec7-24b8-4edb-babd-d0b6a4bf21dc tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] 10.222.0.20 "GET /compute/v2.1/servers/12bddea9-d545-43f2-9bf7-5e723900c8c6" status: 200 len: 1510 microversion: 2.1 time: 0.254112 Jul 06 13:48:12.073084 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 249/501] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:48:11 2022] GET /compute/v2.1/servers/12bddea9-d545-43f2-9bf7-5e723900c8c6 => generated 1510 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:48:12.475565 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-8569abd7-e18b-417c-a3c5-7910cfc46383 tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] Calling method '>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:48:12.477975 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-8569abd7-e18b-417c-a3c5-7910cfc46383 tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] [instance: 4895b615-7e9b-4a58-ac74-008e7ba87aad] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:48:12.498481 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-8569abd7-e18b-417c-a3c5-7910cfc46383 tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:48:12.500269 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-8569abd7-e18b-417c-a3c5-7910cfc46383 tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:48:12.501425 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-8569abd7-e18b-417c-a3c5-7910cfc46383 tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:48:12.503182 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-8569abd7-e18b-417c-a3c5-7910cfc46383 tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:48:12.703971 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-8569abd7-e18b-417c-a3c5-7910cfc46383 tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19ccda8f7ce447c490910ffa14165c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ffa9da064c64346b5f227c28a89ea81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:48:12.719168 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-8569abd7-e18b-417c-a3c5-7910cfc46383 tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] 10.222.0.20 "GET /compute/v2.1/servers/4895b615-7e9b-4a58-ac74-008e7ba87aad" status: 200 len: 1358 microversion: 2.1 time: 0.249880 Jul 06 13:48:12.730637 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 253/502] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:48:12 2022] GET /compute/v2.1/servers/4895b615-7e9b-4a58-ac74-008e7ba87aad => generated 1358 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:48:13.092282 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-4e385751-f496-400d-b288-9aef10431ad0 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:48:13.093029 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-4e385751-f496-400d-b288-9aef10431ad0 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] [instance: 12bddea9-d545-43f2-9bf7-5e723900c8c6] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:48:13.099563 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-4e385751-f496-400d-b288-9aef10431ad0 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:48:13.100038 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-4e385751-f496-400d-b288-9aef10431ad0 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:48:13.102370 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-4e385751-f496-400d-b288-9aef10431ad0 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:48:13.103011 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-4e385751-f496-400d-b288-9aef10431ad0 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:48:13.307047 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-4e385751-f496-400d-b288-9aef10431ad0 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c83c05bec4f456d8aa7d51732ddc8af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b2a80a004e04da7ae12db9f3f87146f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:48:13.319558 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-4e385751-f496-400d-b288-9aef10431ad0 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] 10.222.0.20 "GET /compute/v2.1/servers/12bddea9-d545-43f2-9bf7-5e723900c8c6" status: 200 len: 1510 microversion: 2.1 time: 0.231654 Jul 06 13:48:13.320768 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 250/503] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:48:13 2022] GET /compute/v2.1/servers/12bddea9-d545-43f2-9bf7-5e723900c8c6 => generated 1510 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 06 13:48:13.737327 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-358e7c33-0377-42cb-9109-d5f5d443db9c tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] Calling method '>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:48:13.741221 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-358e7c33-0377-42cb-9109-d5f5d443db9c tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] [instance: 4895b615-7e9b-4a58-ac74-008e7ba87aad] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:48:13.757392 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-358e7c33-0377-42cb-9109-d5f5d443db9c tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:48:13.758301 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-358e7c33-0377-42cb-9109-d5f5d443db9c tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:48:13.760012 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-358e7c33-0377-42cb-9109-d5f5d443db9c tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:48:13.760600 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-358e7c33-0377-42cb-9109-d5f5d443db9c tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:48:13.962666 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-358e7c33-0377-42cb-9109-d5f5d443db9c tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19ccda8f7ce447c490910ffa14165c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ffa9da064c64346b5f227c28a89ea81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:48:13.972525 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-358e7c33-0377-42cb-9109-d5f5d443db9c tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] 10.222.0.20 "GET /compute/v2.1/servers/4895b615-7e9b-4a58-ac74-008e7ba87aad" status: 200 len: 1358 microversion: 2.1 time: 0.239697 Jul 06 13:48:13.985395 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 254/504] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:48:13 2022] GET /compute/v2.1/servers/4895b615-7e9b-4a58-ac74-008e7ba87aad => generated 1358 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:48:14.341575 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-1c184944-2615-48e7-8216-1e2b3fcd83db tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:48:14.342999 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-1c184944-2615-48e7-8216-1e2b3fcd83db tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] [instance: 12bddea9-d545-43f2-9bf7-5e723900c8c6] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:48:14.353497 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-1c184944-2615-48e7-8216-1e2b3fcd83db tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:48:14.353826 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-1c184944-2615-48e7-8216-1e2b3fcd83db tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:48:14.356713 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-1c184944-2615-48e7-8216-1e2b3fcd83db tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:48:14.357641 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-1c184944-2615-48e7-8216-1e2b3fcd83db tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:48:14.648844 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-1c184944-2615-48e7-8216-1e2b3fcd83db tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c83c05bec4f456d8aa7d51732ddc8af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b2a80a004e04da7ae12db9f3f87146f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:48:14.659557 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-1c184944-2615-48e7-8216-1e2b3fcd83db tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] 10.222.0.20 "GET /compute/v2.1/servers/12bddea9-d545-43f2-9bf7-5e723900c8c6" status: 200 len: 1510 microversion: 2.1 time: 0.322753 Jul 06 13:48:14.661063 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 251/505] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:48:14 2022] GET /compute/v2.1/servers/12bddea9-d545-43f2-9bf7-5e723900c8c6 => generated 1510 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 06 13:48:14.990396 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-81c854bd-27c3-43a8-9ff2-ea6c5ac7e534 tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] Calling method '>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:48:14.991136 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-81c854bd-27c3-43a8-9ff2-ea6c5ac7e534 tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] [instance: 4895b615-7e9b-4a58-ac74-008e7ba87aad] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:48:14.998535 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-81c854bd-27c3-43a8-9ff2-ea6c5ac7e534 tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:48:14.999357 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-81c854bd-27c3-43a8-9ff2-ea6c5ac7e534 tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:48:15.000598 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-81c854bd-27c3-43a8-9ff2-ea6c5ac7e534 tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:48:15.001260 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-81c854bd-27c3-43a8-9ff2-ea6c5ac7e534 tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:48:15.173335 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-81c854bd-27c3-43a8-9ff2-ea6c5ac7e534 tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19ccda8f7ce447c490910ffa14165c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ffa9da064c64346b5f227c28a89ea81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:48:15.183708 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-81c854bd-27c3-43a8-9ff2-ea6c5ac7e534 tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] 10.222.0.20 "GET /compute/v2.1/servers/4895b615-7e9b-4a58-ac74-008e7ba87aad" status: 200 len: 1358 microversion: 2.1 time: 0.197916 Jul 06 13:48:15.184813 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 255/506] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:48:14 2022] GET /compute/v2.1/servers/4895b615-7e9b-4a58-ac74-008e7ba87aad => generated 1358 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 06 13:48:15.679195 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-d3ca9d1a-2678-4703-87e0-2651ddd69451 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:48:15.680563 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-d3ca9d1a-2678-4703-87e0-2651ddd69451 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] [instance: 12bddea9-d545-43f2-9bf7-5e723900c8c6] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:48:15.688323 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-d3ca9d1a-2678-4703-87e0-2651ddd69451 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:48:15.688780 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-d3ca9d1a-2678-4703-87e0-2651ddd69451 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:48:15.689938 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-d3ca9d1a-2678-4703-87e0-2651ddd69451 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:48:15.690566 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-d3ca9d1a-2678-4703-87e0-2651ddd69451 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:48:15.837826 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-d3ca9d1a-2678-4703-87e0-2651ddd69451 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c83c05bec4f456d8aa7d51732ddc8af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b2a80a004e04da7ae12db9f3f87146f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:48:15.852951 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-d3ca9d1a-2678-4703-87e0-2651ddd69451 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] 10.222.0.20 "GET /compute/v2.1/servers/12bddea9-d545-43f2-9bf7-5e723900c8c6" status: 200 len: 1510 microversion: 2.1 time: 0.178735 Jul 06 13:48:15.853941 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 252/507] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:48:15 2022] GET /compute/v2.1/servers/12bddea9-d545-43f2-9bf7-5e723900c8c6 => generated 1510 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:48:16.201433 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-cd5d6838-cb5c-4d50-bac1-64c6aa8d9495 tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] Calling method '>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:48:16.202938 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-cd5d6838-cb5c-4d50-bac1-64c6aa8d9495 tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] [instance: 4895b615-7e9b-4a58-ac74-008e7ba87aad] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:48:16.210151 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-cd5d6838-cb5c-4d50-bac1-64c6aa8d9495 tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:48:16.210891 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-cd5d6838-cb5c-4d50-bac1-64c6aa8d9495 tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:48:16.211974 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-cd5d6838-cb5c-4d50-bac1-64c6aa8d9495 tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:48:16.212401 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-cd5d6838-cb5c-4d50-bac1-64c6aa8d9495 tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:48:16.362472 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-cd5d6838-cb5c-4d50-bac1-64c6aa8d9495 tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19ccda8f7ce447c490910ffa14165c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ffa9da064c64346b5f227c28a89ea81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:48:16.370679 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-cd5d6838-cb5c-4d50-bac1-64c6aa8d9495 tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] 10.222.0.20 "GET /compute/v2.1/servers/4895b615-7e9b-4a58-ac74-008e7ba87aad" status: 200 len: 1358 microversion: 2.1 time: 0.173097 Jul 06 13:48:16.381645 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 256/508] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:48:16 2022] GET /compute/v2.1/servers/4895b615-7e9b-4a58-ac74-008e7ba87aad => generated 1358 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:48:16.875006 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-9aeb66a8-4038-4050-8daf-98673e8ecc05 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:48:16.875588 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-9aeb66a8-4038-4050-8daf-98673e8ecc05 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] [instance: 12bddea9-d545-43f2-9bf7-5e723900c8c6] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:48:16.883582 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-9aeb66a8-4038-4050-8daf-98673e8ecc05 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:48:16.884031 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-9aeb66a8-4038-4050-8daf-98673e8ecc05 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:48:16.885126 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-9aeb66a8-4038-4050-8daf-98673e8ecc05 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:48:16.885450 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-9aeb66a8-4038-4050-8daf-98673e8ecc05 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:48:17.059804 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-9aeb66a8-4038-4050-8daf-98673e8ecc05 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c83c05bec4f456d8aa7d51732ddc8af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b2a80a004e04da7ae12db9f3f87146f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:48:17.068957 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-9aeb66a8-4038-4050-8daf-98673e8ecc05 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] 10.222.0.20 "GET /compute/v2.1/servers/12bddea9-d545-43f2-9bf7-5e723900c8c6" status: 200 len: 1510 microversion: 2.1 time: 0.198366 Jul 06 13:48:17.069665 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 253/509] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:48:16 2022] GET /compute/v2.1/servers/12bddea9-d545-43f2-9bf7-5e723900c8c6 => generated 1510 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:48:17.388446 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-4afbc730-9f0d-4ca1-9d96-b713aec2c6df tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] Calling method '>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:48:17.389098 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-4afbc730-9f0d-4ca1-9d96-b713aec2c6df tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] [instance: 4895b615-7e9b-4a58-ac74-008e7ba87aad] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:48:17.398420 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-4afbc730-9f0d-4ca1-9d96-b713aec2c6df tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:48:17.398877 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-4afbc730-9f0d-4ca1-9d96-b713aec2c6df tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:48:17.399649 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-4afbc730-9f0d-4ca1-9d96-b713aec2c6df tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:48:17.400092 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-4afbc730-9f0d-4ca1-9d96-b713aec2c6df tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:48:17.566982 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-4afbc730-9f0d-4ca1-9d96-b713aec2c6df tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19ccda8f7ce447c490910ffa14165c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ffa9da064c64346b5f227c28a89ea81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:48:17.576737 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-4afbc730-9f0d-4ca1-9d96-b713aec2c6df tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] 10.222.0.20 "GET /compute/v2.1/servers/4895b615-7e9b-4a58-ac74-008e7ba87aad" status: 200 len: 1358 microversion: 2.1 time: 0.192011 Jul 06 13:48:17.587962 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 257/510] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:48:17 2022] GET /compute/v2.1/servers/4895b615-7e9b-4a58-ac74-008e7ba87aad => generated 1358 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:48:18.086891 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-a9a97714-d92e-45fc-a238-95d51df17d61 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:48:18.087560 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-a9a97714-d92e-45fc-a238-95d51df17d61 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] [instance: 12bddea9-d545-43f2-9bf7-5e723900c8c6] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:48:18.095494 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-a9a97714-d92e-45fc-a238-95d51df17d61 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:48:18.096737 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-a9a97714-d92e-45fc-a238-95d51df17d61 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:48:18.097858 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-a9a97714-d92e-45fc-a238-95d51df17d61 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:48:18.098482 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-a9a97714-d92e-45fc-a238-95d51df17d61 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:48:18.261040 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-a9a97714-d92e-45fc-a238-95d51df17d61 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c83c05bec4f456d8aa7d51732ddc8af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b2a80a004e04da7ae12db9f3f87146f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:48:18.273147 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-a9a97714-d92e-45fc-a238-95d51df17d61 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] 10.222.0.20 "GET /compute/v2.1/servers/12bddea9-d545-43f2-9bf7-5e723900c8c6" status: 200 len: 1510 microversion: 2.1 time: 0.190151 Jul 06 13:48:18.274795 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 254/511] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:48:18 2022] GET /compute/v2.1/servers/12bddea9-d545-43f2-9bf7-5e723900c8c6 => generated 1510 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:48:18.596284 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-24c0b900-8c36-4298-aee4-0ebd7d41b81d tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] Calling method '>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:48:18.596900 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-24c0b900-8c36-4298-aee4-0ebd7d41b81d tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] [instance: 4895b615-7e9b-4a58-ac74-008e7ba87aad] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:48:18.607194 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-24c0b900-8c36-4298-aee4-0ebd7d41b81d tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:48:18.607643 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-24c0b900-8c36-4298-aee4-0ebd7d41b81d tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:48:18.608597 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-24c0b900-8c36-4298-aee4-0ebd7d41b81d tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:48:18.609049 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-24c0b900-8c36-4298-aee4-0ebd7d41b81d tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:48:18.749416 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-24c0b900-8c36-4298-aee4-0ebd7d41b81d tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19ccda8f7ce447c490910ffa14165c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ffa9da064c64346b5f227c28a89ea81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:48:18.760728 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-24c0b900-8c36-4298-aee4-0ebd7d41b81d tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] 10.222.0.20 "GET /compute/v2.1/servers/4895b615-7e9b-4a58-ac74-008e7ba87aad" status: 200 len: 1358 microversion: 2.1 time: 0.169460 Jul 06 13:48:18.770664 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 258/512] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:48:18 2022] GET /compute/v2.1/servers/4895b615-7e9b-4a58-ac74-008e7ba87aad => generated 1358 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:48:19.302323 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-38d276ad-271e-4e4b-8b35-334daed438a0 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:48:19.306119 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-38d276ad-271e-4e4b-8b35-334daed438a0 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] [instance: 12bddea9-d545-43f2-9bf7-5e723900c8c6] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:48:19.312525 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-38d276ad-271e-4e4b-8b35-334daed438a0 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:48:19.313121 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-38d276ad-271e-4e4b-8b35-334daed438a0 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:48:19.314010 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-38d276ad-271e-4e4b-8b35-334daed438a0 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:48:19.315336 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-38d276ad-271e-4e4b-8b35-334daed438a0 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:48:19.448561 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-38d276ad-271e-4e4b-8b35-334daed438a0 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c83c05bec4f456d8aa7d51732ddc8af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b2a80a004e04da7ae12db9f3f87146f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:48:19.457650 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-38d276ad-271e-4e4b-8b35-334daed438a0 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] 10.222.0.20 "GET /compute/v2.1/servers/12bddea9-d545-43f2-9bf7-5e723900c8c6" status: 200 len: 1510 microversion: 2.1 time: 0.161244 Jul 06 13:48:19.461832 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 255/513] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:48:19 2022] GET /compute/v2.1/servers/12bddea9-d545-43f2-9bf7-5e723900c8c6 => generated 1510 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:48:19.779422 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-6c4f4222-aaa1-444d-a079-6734e7e7757d tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] Calling method '>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:48:19.780755 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-6c4f4222-aaa1-444d-a079-6734e7e7757d tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] [instance: 4895b615-7e9b-4a58-ac74-008e7ba87aad] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:48:19.787995 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG dbcounter [-] [124368] Writing DB stats nova_api:SELECT=64 {{(pid=124368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:48:19.790284 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-6c4f4222-aaa1-444d-a079-6734e7e7757d tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:48:19.791132 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-6c4f4222-aaa1-444d-a079-6734e7e7757d tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:48:19.792082 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-6c4f4222-aaa1-444d-a079-6734e7e7757d tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:48:19.792706 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-6c4f4222-aaa1-444d-a079-6734e7e7757d tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:48:19.953676 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-6c4f4222-aaa1-444d-a079-6734e7e7757d tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19ccda8f7ce447c490910ffa14165c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ffa9da064c64346b5f227c28a89ea81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:48:19.962006 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-6c4f4222-aaa1-444d-a079-6734e7e7757d tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] 10.222.0.20 "GET /compute/v2.1/servers/4895b615-7e9b-4a58-ac74-008e7ba87aad" status: 200 len: 1358 microversion: 2.1 time: 0.187215 Jul 06 13:48:19.962733 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 259/514] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:48:19 2022] GET /compute/v2.1/servers/4895b615-7e9b-4a58-ac74-008e7ba87aad => generated 1358 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:48:20.475617 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-c65b9bb3-d509-44d8-a40b-4cb736170190 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:48:20.476494 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-c65b9bb3-d509-44d8-a40b-4cb736170190 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] [instance: 12bddea9-d545-43f2-9bf7-5e723900c8c6] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:48:20.487435 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-c65b9bb3-d509-44d8-a40b-4cb736170190 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:48:20.488324 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-c65b9bb3-d509-44d8-a40b-4cb736170190 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:48:20.489146 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-c65b9bb3-d509-44d8-a40b-4cb736170190 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:48:20.489731 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-c65b9bb3-d509-44d8-a40b-4cb736170190 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:48:20.701099 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-c65b9bb3-d509-44d8-a40b-4cb736170190 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c83c05bec4f456d8aa7d51732ddc8af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b2a80a004e04da7ae12db9f3f87146f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:48:20.712792 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-c65b9bb3-d509-44d8-a40b-4cb736170190 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] 10.222.0.20 "GET /compute/v2.1/servers/12bddea9-d545-43f2-9bf7-5e723900c8c6" status: 200 len: 1516 microversion: 2.1 time: 0.241050 Jul 06 13:48:20.713557 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 256/515] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:48:20 2022] GET /compute/v2.1/servers/12bddea9-d545-43f2-9bf7-5e723900c8c6 => generated 1516 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:48:20.982745 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-502aae09-449b-41ee-884a-4967f75db9f9 tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] Calling method '>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:48:20.983466 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-502aae09-449b-41ee-884a-4967f75db9f9 tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] [instance: 4895b615-7e9b-4a58-ac74-008e7ba87aad] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:48:20.999992 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-502aae09-449b-41ee-884a-4967f75db9f9 tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:48:21.000325 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-502aae09-449b-41ee-884a-4967f75db9f9 tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:48:21.003696 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-502aae09-449b-41ee-884a-4967f75db9f9 tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:48:21.004166 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-502aae09-449b-41ee-884a-4967f75db9f9 tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:48:21.182416 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-502aae09-449b-41ee-884a-4967f75db9f9 tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19ccda8f7ce447c490910ffa14165c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ffa9da064c64346b5f227c28a89ea81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:48:21.191616 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-502aae09-449b-41ee-884a-4967f75db9f9 tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] 10.222.0.20 "GET /compute/v2.1/servers/4895b615-7e9b-4a58-ac74-008e7ba87aad" status: 200 len: 1358 microversion: 2.1 time: 0.213311 Jul 06 13:48:21.192177 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 260/516] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:48:20 2022] GET /compute/v2.1/servers/4895b615-7e9b-4a58-ac74-008e7ba87aad => generated 1358 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:48:22.123973 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-7682c8ba-229a-45a7-bfc6-d5ed9c8b3fdb tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Action: 'create', calling method: .version_select at 0x7ffbc43b88b0>, body: {"keypair": {"name": "tempest-keypair-335900744", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDR2nJEmVQ5Rq4Ed+BWKUC4LAU66doE0D2TnW0hai4XJBTRk+vLC3osk3ijZx0kY9AzTeAQ+aPcjqUzfHV3G5OxAfb9j4G7C/AHUeVE6J2PQ1izZ6tWCSYnu98MeD71zzQ=="}} {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 06 13:48:22.145548 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.quota [None req-7682c8ba-229a-45a7-bfc6-d5ed9c8b3fdb tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Getting quotas for project 3b2a80a004e04da7ae12db9f3f87146f. Resources: {'key_pairs'} {{(pid=124367) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 06 13:48:22.150677 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.quota [None req-7682c8ba-229a-45a7-bfc6-d5ed9c8b3fdb tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Getting quotas for user 0c83c05bec4f456d8aa7d51732ddc8af and project 3b2a80a004e04da7ae12db9f3f87146f. Resources: {'key_pairs'} {{(pid=124367) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 06 13:48:22.193041 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-7682c8ba-229a-45a7-bfc6-d5ed9c8b3fdb tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.075000 Jul 06 13:48:22.194366 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 257/517] 10.222.0.20 () {60 vars in 1158 bytes} [Wed Jul 6 13:48:22 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 06 13:48:22.213057 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-97f18769-20b0-4bb7-92f0-220cbc1daee8 tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] Calling method '>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:48:22.214141 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-97f18769-20b0-4bb7-92f0-220cbc1daee8 tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] [instance: 4895b615-7e9b-4a58-ac74-008e7ba87aad] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:48:22.227432 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-97f18769-20b0-4bb7-92f0-220cbc1daee8 tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:48:22.228868 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-97f18769-20b0-4bb7-92f0-220cbc1daee8 tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:48:22.233929 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-97f18769-20b0-4bb7-92f0-220cbc1daee8 tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:48:22.234507 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-97f18769-20b0-4bb7-92f0-220cbc1daee8 tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:48:22.536416 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-97f18769-20b0-4bb7-92f0-220cbc1daee8 tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19ccda8f7ce447c490910ffa14165c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ffa9da064c64346b5f227c28a89ea81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:48:22.558808 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-97f18769-20b0-4bb7-92f0-220cbc1daee8 tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] 10.222.0.20 "GET /compute/v2.1/servers/4895b615-7e9b-4a58-ac74-008e7ba87aad" status: 200 len: 1358 microversion: 2.1 time: 0.352686 Jul 06 13:48:22.565584 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 261/518] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:48:22 2022] GET /compute/v2.1/servers/4895b615-7e9b-4a58-ac74-008e7ba87aad => generated 1358 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:48:23.588008 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-b57c6e74-a52f-4b32-afc1-affe3372f552 tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:48:23.588871 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-b57c6e74-a52f-4b32-afc1-affe3372f552 tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] [instance: 4895b615-7e9b-4a58-ac74-008e7ba87aad] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:48:23.590818 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG dbcounter [-] [124367] Writing DB stats nova_api:SELECT=63,nova_api:INSERT=1 {{(pid=124367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:48:23.603116 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-b57c6e74-a52f-4b32-afc1-affe3372f552 tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:48:23.606606 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-b57c6e74-a52f-4b32-afc1-affe3372f552 tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:48:23.607923 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-b57c6e74-a52f-4b32-afc1-affe3372f552 tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:48:23.608547 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-b57c6e74-a52f-4b32-afc1-affe3372f552 tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:48:23.806790 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [req-f8622bc8-79a6-42cc-86d4-9f0846e2dcbd req-102fdda0-dd07-4fc7-a8c4-3ef65a79974c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4895b615-7e9b-4a58-ac74-008e7ba87aad", "name": "network-vif-plugged", "status": "completed", "tag": "41ac049c-27f7-4531-b7d5-cc2e3f0f8c79"}]} {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 06 13:48:23.856179 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [req-f8622bc8-79a6-42cc-86d4-9f0846e2dcbd req-102fdda0-dd07-4fc7-a8c4-3ef65a79974c service nova] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:48:23.859288 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [req-f8622bc8-79a6-42cc-86d4-9f0846e2dcbd req-102fdda0-dd07-4fc7-a8c4-3ef65a79974c service nova] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:48:23.890670 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.compute.server_external_events [req-f8622bc8-79a6-42cc-86d4-9f0846e2dcbd req-102fdda0-dd07-4fc7-a8c4-3ef65a79974c service nova] Creating event network-vif-plugged:41ac049c-27f7-4531-b7d5-cc2e3f0f8c79 for instance 4895b615-7e9b-4a58-ac74-008e7ba87aad on hv-cinder-81914 Jul 06 13:48:23.911929 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [req-f8622bc8-79a6-42cc-86d4-9f0846e2dcbd req-102fdda0-dd07-4fc7-a8c4-3ef65a79974c service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.120225 Jul 06 13:48:23.913154 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 262/519] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 6 13:48:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 06 13:48:23.918681 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-b57c6e74-a52f-4b32-afc1-affe3372f552 tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19ccda8f7ce447c490910ffa14165c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ffa9da064c64346b5f227c28a89ea81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:48:23.929913 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-b57c6e74-a52f-4b32-afc1-affe3372f552 tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] 10.222.0.20 "GET /compute/v2.1/servers/4895b615-7e9b-4a58-ac74-008e7ba87aad" status: 200 len: 1358 microversion: 2.1 time: 0.347511 Jul 06 13:48:23.934176 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 258/520] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:48:23 2022] GET /compute/v2.1/servers/4895b615-7e9b-4a58-ac74-008e7ba87aad => generated 1358 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:48:24.729228 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-76eb3082-74a0-411d-b929-75dbb7932a9a tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-332254134", "imageRef": "b08481d9-1e39-41e8-97bd-b05a9c35b377", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "f1ea0748-7e5f-4bd2-b8bf-076ecf50758f"}], "security_groups": [{"name": "tempest-securitygroup--1229174788"}], "key_name": "tempest-keypair-335900744", "user_data": "}} {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 06 13:48:24.904052 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.network.neutron [None req-76eb3082-74a0-411d-b929-75dbb7932a9a tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] validate_networks() for [('f1ea0748-7e5f-4bd2-b8bf-076ecf50758f', None, None, None, None, None)] {{(pid=124368) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 06 13:48:24.946963 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-f6527dba-912f-4a82-ae0f-00d52e60aaa6 tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:48:24.947570 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-f6527dba-912f-4a82-ae0f-00d52e60aaa6 tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] [instance: 4895b615-7e9b-4a58-ac74-008e7ba87aad] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:48:24.959796 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-f6527dba-912f-4a82-ae0f-00d52e60aaa6 tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:48:24.960267 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-f6527dba-912f-4a82-ae0f-00d52e60aaa6 tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:48:24.963620 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-f6527dba-912f-4a82-ae0f-00d52e60aaa6 tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:48:24.964066 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-f6527dba-912f-4a82-ae0f-00d52e60aaa6 tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:48:25.245446 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-f6527dba-912f-4a82-ae0f-00d52e60aaa6 tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19ccda8f7ce447c490910ffa14165c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ffa9da064c64346b5f227c28a89ea81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:48:25.263032 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-f6527dba-912f-4a82-ae0f-00d52e60aaa6 tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] 10.222.0.20 "GET /compute/v2.1/servers/4895b615-7e9b-4a58-ac74-008e7ba87aad" status: 200 len: 1358 microversion: 2.1 time: 0.319639 Jul 06 13:48:25.265652 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 259/521] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:48:24 2022] GET /compute/v2.1/servers/4895b615-7e9b-4a58-ac74-008e7ba87aad => generated 1358 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 06 13:48:25.649828 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.virt.hardware [None req-76eb3082-74a0-411d-b929-75dbb7932a9a tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Flavor limits 0:0:0 {{(pid=124368) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 06 13:48:25.651391 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.virt.hardware [None req-76eb3082-74a0-411d-b929-75dbb7932a9a tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Image limits 0:0:0 {{(pid=124368) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 06 13:48:25.652224 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.virt.hardware [None req-76eb3082-74a0-411d-b929-75dbb7932a9a tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Flavor pref 0:0:0 {{(pid=124368) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 06 13:48:25.653141 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.virt.hardware [None req-76eb3082-74a0-411d-b929-75dbb7932a9a tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Image pref 0:0:0 {{(pid=124368) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 06 13:48:25.653807 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.virt.hardware [None req-76eb3082-74a0-411d-b929-75dbb7932a9a tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124368) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 06 13:48:25.671080 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-76eb3082-74a0-411d-b929-75dbb7932a9a tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:48:25.672281 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-76eb3082-74a0-411d-b929-75dbb7932a9a tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:48:25.674781 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-76eb3082-74a0-411d-b929-75dbb7932a9a tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:48:25.675872 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-76eb3082-74a0-411d-b929-75dbb7932a9a tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:48:25.698812 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.quota [None req-76eb3082-74a0-411d-b929-75dbb7932a9a tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Getting quotas for project 3b2a80a004e04da7ae12db9f3f87146f. Resources: {'instances', 'cores', 'ram'} {{(pid=124368) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 06 13:48:25.703402 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.quota [None req-76eb3082-74a0-411d-b929-75dbb7932a9a tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Getting quotas for user 0c83c05bec4f456d8aa7d51732ddc8af and project 3b2a80a004e04da7ae12db9f3f87146f. Resources: {'instances', 'cores', 'ram'} {{(pid=124368) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 06 13:48:25.715407 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-76eb3082-74a0-411d-b929-75dbb7932a9a tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Going to run 1 instances... {{(pid=124368) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 06 13:48:25.717812 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-76eb3082-74a0-411d-b929-75dbb7932a9a tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] [instance: 74a59be2-69eb-4bdc-865c-570f5a2019df] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b08481d9-1e39-41e8-97bd-b05a9c35b377',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124368) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 06 13:48:25.791649 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-76eb3082-74a0-411d-b929-75dbb7932a9a tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 1.067786 Jul 06 13:48:25.795433 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 263/522] 10.222.0.20 () {60 vars in 1146 bytes} [Wed Jul 6 13:48:24 2022] POST /compute/v2.1/servers => generated 409 bytes in 1072 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 06 13:48:25.817268 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-7a0468ea-50cc-459e-9f22-0b0d4457743b tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:48:25.817479 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-7a0468ea-50cc-459e-9f22-0b0d4457743b tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] [instance: 74a59be2-69eb-4bdc-865c-570f5a2019df] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:48:25.972495 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-7a0468ea-50cc-459e-9f22-0b0d4457743b tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c83c05bec4f456d8aa7d51732ddc8af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b2a80a004e04da7ae12db9f3f87146f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:48:25.981541 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-7a0468ea-50cc-459e-9f22-0b0d4457743b tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] 10.222.0.20 "GET /compute/v2.1/servers/74a59be2-69eb-4bdc-865c-570f5a2019df" status: 200 len: 1244 microversion: 2.1 time: 0.180662 Jul 06 13:48:25.982983 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 260/523] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:48:25 2022] GET /compute/v2.1/servers/74a59be2-69eb-4bdc-865c-570f5a2019df => generated 1244 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:48:26.286231 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-16452552-6f3f-422e-a863-cbb64157ccbf tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] Calling method '>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:48:26.289335 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-16452552-6f3f-422e-a863-cbb64157ccbf tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] [instance: 4895b615-7e9b-4a58-ac74-008e7ba87aad] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:48:26.305783 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-16452552-6f3f-422e-a863-cbb64157ccbf tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:48:26.307486 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-16452552-6f3f-422e-a863-cbb64157ccbf tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:48:26.308410 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-16452552-6f3f-422e-a863-cbb64157ccbf tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:48:26.308884 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-16452552-6f3f-422e-a863-cbb64157ccbf tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:48:26.510625 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-16452552-6f3f-422e-a863-cbb64157ccbf tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19ccda8f7ce447c490910ffa14165c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ffa9da064c64346b5f227c28a89ea81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:48:26.519096 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-16452552-6f3f-422e-a863-cbb64157ccbf tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] 10.222.0.20 "GET /compute/v2.1/servers/4895b615-7e9b-4a58-ac74-008e7ba87aad" status: 200 len: 1546 microversion: 2.1 time: 0.240171 Jul 06 13:48:26.531151 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 264/524] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:48:26 2022] GET /compute/v2.1/servers/4895b615-7e9b-4a58-ac74-008e7ba87aad => generated 1546 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:48:26.541743 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-ff982274-3e07-4009-92a8-b4f739bcd4b7 tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:48:26.543121 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-ff982274-3e07-4009-92a8-b4f739bcd4b7 tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] [instance: 4895b615-7e9b-4a58-ac74-008e7ba87aad] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:48:26.550973 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-ff982274-3e07-4009-92a8-b4f739bcd4b7 tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:48:26.551420 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-ff982274-3e07-4009-92a8-b4f739bcd4b7 tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:48:26.552501 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-ff982274-3e07-4009-92a8-b4f739bcd4b7 tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:48:26.553273 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-ff982274-3e07-4009-92a8-b4f739bcd4b7 tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:48:26.748821 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-ff982274-3e07-4009-92a8-b4f739bcd4b7 tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19ccda8f7ce447c490910ffa14165c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ffa9da064c64346b5f227c28a89ea81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:48:26.757659 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-ff982274-3e07-4009-92a8-b4f739bcd4b7 tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] 10.222.0.20 "GET /compute/v2.1/servers/4895b615-7e9b-4a58-ac74-008e7ba87aad" status: 200 len: 1546 microversion: 2.1 time: 0.221698 Jul 06 13:48:26.758235 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 261/525] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:48:26 2022] GET /compute/v2.1/servers/4895b615-7e9b-4a58-ac74-008e7ba87aad => generated 1546 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:48:26.774404 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-8b95b4ee-d561-4425-8c4e-875b005e15da tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] Calling method '>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:48:26.778009 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-8b95b4ee-d561-4425-8c4e-875b005e15da tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '19ccda8f7ce447c490910ffa14165c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ffa9da064c64346b5f227c28a89ea81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:48:26.778777 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-8b95b4ee-d561-4425-8c4e-875b005e15da tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] Searching by: {'deleted': False, 'project_id': '3ffa9da064c64346b5f227c28a89ea81'} {{(pid=124368) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 06 13:48:26.786219 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-8b95b4ee-d561-4425-8c4e-875b005e15da tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:48:26.786675 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-8b95b4ee-d561-4425-8c4e-875b005e15da tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:48:26.787468 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-8b95b4ee-d561-4425-8c4e-875b005e15da tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:48:26.787903 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-8b95b4ee-d561-4425-8c4e-875b005e15da tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:48:26.878568 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.multi_cell_list [None req-8b95b4ee-d561-4425-8c4e-875b005e15da tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=124368) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 06 13:48:26.976984 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-8b95b4ee-d561-4425-8c4e-875b005e15da tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] 10.222.0.20 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.206501 Jul 06 13:48:26.977594 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 265/526] 10.222.0.20 () {58 vars in 1124 bytes} [Wed Jul 6 13:48:26 2022] GET /compute/v2.1/servers => generated 342 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 06 13:48:26.988064 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-1af19883-749b-4f85-8882-846774604eb7 tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:48:26.988786 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-1af19883-749b-4f85-8882-846774604eb7 tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] [instance: 4895b615-7e9b-4a58-ac74-008e7ba87aad] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:48:26.995285 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-1af19883-749b-4f85-8882-846774604eb7 tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:48:26.995933 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-1af19883-749b-4f85-8882-846774604eb7 tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:48:26.996710 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-1af19883-749b-4f85-8882-846774604eb7 tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:48:26.997182 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-1af19883-749b-4f85-8882-846774604eb7 tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:48:27.000545 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-6306976f-9bb5-4c86-9794-f1cf06e81cb8 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Calling method '>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:48:27.001223 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-6306976f-9bb5-4c86-9794-f1cf06e81cb8 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] [instance: 74a59be2-69eb-4bdc-865c-570f5a2019df] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:48:27.008097 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-6306976f-9bb5-4c86-9794-f1cf06e81cb8 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:48:27.008605 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-6306976f-9bb5-4c86-9794-f1cf06e81cb8 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:48:27.009669 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-6306976f-9bb5-4c86-9794-f1cf06e81cb8 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:48:27.010127 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-6306976f-9bb5-4c86-9794-f1cf06e81cb8 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:48:27.094235 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-6306976f-9bb5-4c86-9794-f1cf06e81cb8 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c83c05bec4f456d8aa7d51732ddc8af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b2a80a004e04da7ae12db9f3f87146f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:48:27.102252 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG dbcounter [-] [124368] Writing DB stats nova_cell1:SELECT=100 {{(pid=124368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:48:27.105429 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-6306976f-9bb5-4c86-9794-f1cf06e81cb8 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] 10.222.0.20 "GET /compute/v2.1/servers/74a59be2-69eb-4bdc-865c-570f5a2019df" status: 200 len: 1240 microversion: 2.1 time: 0.107713 Jul 06 13:48:27.106204 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 266/527] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:48:26 2022] GET /compute/v2.1/servers/74a59be2-69eb-4bdc-865c-570f5a2019df => generated 1240 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:48:27.186434 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-1af19883-749b-4f85-8882-846774604eb7 tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19ccda8f7ce447c490910ffa14165c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ffa9da064c64346b5f227c28a89ea81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:48:27.194436 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-1af19883-749b-4f85-8882-846774604eb7 tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] 10.222.0.20 "GET /compute/v2.1/servers/4895b615-7e9b-4a58-ac74-008e7ba87aad" status: 200 len: 1546 microversion: 2.1 time: 0.210413 Jul 06 13:48:27.195016 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 262/528] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:48:26 2022] GET /compute/v2.1/servers/4895b615-7e9b-4a58-ac74-008e7ba87aad => generated 1546 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:48:28.123525 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-cb46e7d1-e929-4c08-93a4-3bcacfd2a92f tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Calling method '>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:48:28.124819 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-cb46e7d1-e929-4c08-93a4-3bcacfd2a92f tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] [instance: 74a59be2-69eb-4bdc-865c-570f5a2019df] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:48:28.132363 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-cb46e7d1-e929-4c08-93a4-3bcacfd2a92f tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:48:28.133194 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-cb46e7d1-e929-4c08-93a4-3bcacfd2a92f tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:48:28.134036 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-cb46e7d1-e929-4c08-93a4-3bcacfd2a92f tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:48:28.134545 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-cb46e7d1-e929-4c08-93a4-3bcacfd2a92f tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:48:28.214638 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-cb46e7d1-e929-4c08-93a4-3bcacfd2a92f tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c83c05bec4f456d8aa7d51732ddc8af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b2a80a004e04da7ae12db9f3f87146f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:48:28.233174 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-cb46e7d1-e929-4c08-93a4-3bcacfd2a92f tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] 10.222.0.20 "GET /compute/v2.1/servers/74a59be2-69eb-4bdc-865c-570f5a2019df" status: 200 len: 1296 microversion: 2.1 time: 0.114326 Jul 06 13:48:28.244430 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 267/529] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:48:28 2022] GET /compute/v2.1/servers/74a59be2-69eb-4bdc-865c-570f5a2019df => generated 1296 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:48:28.760385 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-dc9263a8-b7ce-4de7-8085-d6788d3d7e36 tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "49d30f07-dd29-4b18-9c55-772059fc7a2d"}} {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 06 13:48:28.762226 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-dc9263a8-b7ce-4de7-8085-d6788d3d7e36 tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] [instance: 4895b615-7e9b-4a58-ac74-008e7ba87aad] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:48:28.771250 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-dc9263a8-b7ce-4de7-8085-d6788d3d7e36 tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:48:28.771703 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-dc9263a8-b7ce-4de7-8085-d6788d3d7e36 tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:48:28.772480 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-dc9263a8-b7ce-4de7-8085-d6788d3d7e36 tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:48:28.773118 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-dc9263a8-b7ce-4de7-8085-d6788d3d7e36 tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:48:29.102290 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-dc9263a8-b7ce-4de7-8085-d6788d3d7e36 tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] 10.222.0.20 "POST /compute/v2.1/servers/4895b615-7e9b-4a58-ac74-008e7ba87aad/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.346115 Jul 06 13:48:29.103206 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 263/530] 10.222.0.20 () {60 vars in 1322 bytes} [Wed Jul 6 13:48:28 2022] POST /compute/v2.1/servers/4895b615-7e9b-4a58-ac74-008e7ba87aad/os-volume_attachments => generated 194 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 06 13:48:29.253384 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-78898a6e-aaf5-43f8-adf0-7c2d0fcbca1b tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Calling method '>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:48:29.254664 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-78898a6e-aaf5-43f8-adf0-7c2d0fcbca1b tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] [instance: 74a59be2-69eb-4bdc-865c-570f5a2019df] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:48:29.260686 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-78898a6e-aaf5-43f8-adf0-7c2d0fcbca1b tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:48:29.261179 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-78898a6e-aaf5-43f8-adf0-7c2d0fcbca1b tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:48:29.261959 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-78898a6e-aaf5-43f8-adf0-7c2d0fcbca1b tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:48:29.262594 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-78898a6e-aaf5-43f8-adf0-7c2d0fcbca1b tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:48:29.489452 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-78898a6e-aaf5-43f8-adf0-7c2d0fcbca1b tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c83c05bec4f456d8aa7d51732ddc8af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b2a80a004e04da7ae12db9f3f87146f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:48:29.497567 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-78898a6e-aaf5-43f8-adf0-7c2d0fcbca1b tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] 10.222.0.20 "GET /compute/v2.1/servers/74a59be2-69eb-4bdc-865c-570f5a2019df" status: 200 len: 1370 microversion: 2.1 time: 0.248503 Jul 06 13:48:29.498234 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 268/531] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:48:29 2022] GET /compute/v2.1/servers/74a59be2-69eb-4bdc-865c-570f5a2019df => generated 1370 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:48:30.108610 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [req-1bdc59e8-36e0-497c-9182-4eda088050ea req-ff0dab2a-13c6-4cfd-8b9a-79b66f48dd17 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "74a59be2-69eb-4bdc-865c-570f5a2019df", "tag": "d9803c72-57aa-4aaf-b69c-e5ca48b8a2ca"}]} {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 06 13:48:30.122608 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [req-1bdc59e8-36e0-497c-9182-4eda088050ea req-ff0dab2a-13c6-4cfd-8b9a-79b66f48dd17 service nova] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:48:30.123615 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [req-1bdc59e8-36e0-497c-9182-4eda088050ea req-ff0dab2a-13c6-4cfd-8b9a-79b66f48dd17 service nova] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:48:30.151602 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.compute.server_external_events [req-1bdc59e8-36e0-497c-9182-4eda088050ea req-ff0dab2a-13c6-4cfd-8b9a-79b66f48dd17 service nova] Creating event network-changed:d9803c72-57aa-4aaf-b69c-e5ca48b8a2ca for instance 74a59be2-69eb-4bdc-865c-570f5a2019df on hv-cinder-81914 Jul 06 13:48:30.162590 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [req-1bdc59e8-36e0-497c-9182-4eda088050ea req-ff0dab2a-13c6-4cfd-8b9a-79b66f48dd17 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059060 Jul 06 13:48:30.163503 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 264/532] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 6 13:48:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 06 13:48:30.514590 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-3122d944-abba-46bc-9699-69384d8a291c tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Calling method '>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:48:30.515291 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-3122d944-abba-46bc-9699-69384d8a291c tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] [instance: 74a59be2-69eb-4bdc-865c-570f5a2019df] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:48:30.522030 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-3122d944-abba-46bc-9699-69384d8a291c tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:48:30.522560 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-3122d944-abba-46bc-9699-69384d8a291c tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:48:30.523403 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-3122d944-abba-46bc-9699-69384d8a291c tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:48:30.523915 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-3122d944-abba-46bc-9699-69384d8a291c tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:48:30.809269 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-3122d944-abba-46bc-9699-69384d8a291c tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c83c05bec4f456d8aa7d51732ddc8af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b2a80a004e04da7ae12db9f3f87146f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:48:30.819041 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-3122d944-abba-46bc-9699-69384d8a291c tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] 10.222.0.20 "GET /compute/v2.1/servers/74a59be2-69eb-4bdc-865c-570f5a2019df" status: 200 len: 1370 microversion: 2.1 time: 0.308262 Jul 06 13:48:30.821478 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 269/533] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:48:30 2022] GET /compute/v2.1/servers/74a59be2-69eb-4bdc-865c-570f5a2019df => generated 1370 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:48:31.837621 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-bc9e38e7-41e5-47fb-93e5-11cbae79d143 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:48:31.838305 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-bc9e38e7-41e5-47fb-93e5-11cbae79d143 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] [instance: 74a59be2-69eb-4bdc-865c-570f5a2019df] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:48:31.844606 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-bc9e38e7-41e5-47fb-93e5-11cbae79d143 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:48:31.845754 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-bc9e38e7-41e5-47fb-93e5-11cbae79d143 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:48:31.847027 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-bc9e38e7-41e5-47fb-93e5-11cbae79d143 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:48:31.847453 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-bc9e38e7-41e5-47fb-93e5-11cbae79d143 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:48:31.997021 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-bc9e38e7-41e5-47fb-93e5-11cbae79d143 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c83c05bec4f456d8aa7d51732ddc8af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b2a80a004e04da7ae12db9f3f87146f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:48:32.004446 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-bc9e38e7-41e5-47fb-93e5-11cbae79d143 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] 10.222.0.20 "GET /compute/v2.1/servers/74a59be2-69eb-4bdc-865c-570f5a2019df" status: 200 len: 1370 microversion: 2.1 time: 0.171562 Jul 06 13:48:32.005035 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 265/534] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:48:31 2022] GET /compute/v2.1/servers/74a59be2-69eb-4bdc-865c-570f5a2019df => generated 1370 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 06 13:48:33.021335 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-483adc1c-ee20-4351-8113-7028cee00f61 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Calling method '>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:48:33.021933 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-483adc1c-ee20-4351-8113-7028cee00f61 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] [instance: 74a59be2-69eb-4bdc-865c-570f5a2019df] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:48:33.028392 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-483adc1c-ee20-4351-8113-7028cee00f61 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:48:33.028842 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-483adc1c-ee20-4351-8113-7028cee00f61 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:48:33.029725 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-483adc1c-ee20-4351-8113-7028cee00f61 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:48:33.030234 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-483adc1c-ee20-4351-8113-7028cee00f61 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:48:33.169139 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-483adc1c-ee20-4351-8113-7028cee00f61 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c83c05bec4f456d8aa7d51732ddc8af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b2a80a004e04da7ae12db9f3f87146f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:48:33.177088 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-483adc1c-ee20-4351-8113-7028cee00f61 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] 10.222.0.20 "GET /compute/v2.1/servers/74a59be2-69eb-4bdc-865c-570f5a2019df" status: 200 len: 1370 microversion: 2.1 time: 0.160232 Jul 06 13:48:33.177684 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 270/535] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:48:33 2022] GET /compute/v2.1/servers/74a59be2-69eb-4bdc-865c-570f5a2019df => generated 1370 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:48:34.194912 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-ddf12ee5-e2de-4ef6-823e-0457c9e134d0 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:48:34.195560 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-ddf12ee5-e2de-4ef6-823e-0457c9e134d0 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] [instance: 74a59be2-69eb-4bdc-865c-570f5a2019df] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:48:34.202077 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-ddf12ee5-e2de-4ef6-823e-0457c9e134d0 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:48:34.202534 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-ddf12ee5-e2de-4ef6-823e-0457c9e134d0 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:48:34.203317 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-ddf12ee5-e2de-4ef6-823e-0457c9e134d0 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:48:34.203748 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-ddf12ee5-e2de-4ef6-823e-0457c9e134d0 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:48:34.348978 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-ddf12ee5-e2de-4ef6-823e-0457c9e134d0 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c83c05bec4f456d8aa7d51732ddc8af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b2a80a004e04da7ae12db9f3f87146f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:48:34.351439 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG dbcounter [-] [124367] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:48:34.358811 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-ddf12ee5-e2de-4ef6-823e-0457c9e134d0 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] 10.222.0.20 "GET /compute/v2.1/servers/74a59be2-69eb-4bdc-865c-570f5a2019df" status: 200 len: 1370 microversion: 2.1 time: 0.168159 Jul 06 13:48:34.359379 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 266/536] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:48:34 2022] GET /compute/v2.1/servers/74a59be2-69eb-4bdc-865c-570f5a2019df => generated 1370 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:48:35.376166 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-7df2aa8f-6ceb-40ef-a7c9-ef5435c9aaee tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Calling method '>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:48:35.376874 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-7df2aa8f-6ceb-40ef-a7c9-ef5435c9aaee tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] [instance: 74a59be2-69eb-4bdc-865c-570f5a2019df] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:48:35.384156 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-7df2aa8f-6ceb-40ef-a7c9-ef5435c9aaee tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:48:35.384639 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-7df2aa8f-6ceb-40ef-a7c9-ef5435c9aaee tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:48:35.385445 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-7df2aa8f-6ceb-40ef-a7c9-ef5435c9aaee tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:48:35.385883 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-7df2aa8f-6ceb-40ef-a7c9-ef5435c9aaee tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:48:35.516662 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-7df2aa8f-6ceb-40ef-a7c9-ef5435c9aaee tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c83c05bec4f456d8aa7d51732ddc8af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b2a80a004e04da7ae12db9f3f87146f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:48:35.524441 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-7df2aa8f-6ceb-40ef-a7c9-ef5435c9aaee tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] 10.222.0.20 "GET /compute/v2.1/servers/74a59be2-69eb-4bdc-865c-570f5a2019df" status: 200 len: 1370 microversion: 2.1 time: 0.152066 Jul 06 13:48:35.525051 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 271/537] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:48:35 2022] GET /compute/v2.1/servers/74a59be2-69eb-4bdc-865c-570f5a2019df => generated 1370 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:48:36.545176 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-f640e471-148b-4e76-98f1-a1d2a5aebe3e tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:48:36.546613 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-f640e471-148b-4e76-98f1-a1d2a5aebe3e tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] [instance: 74a59be2-69eb-4bdc-865c-570f5a2019df] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:48:36.550865 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG dbcounter [-] [124367] Writing DB stats nova_cell0:SELECT=6 {{(pid=124367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:48:36.557830 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-f640e471-148b-4e76-98f1-a1d2a5aebe3e tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:48:36.558606 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-f640e471-148b-4e76-98f1-a1d2a5aebe3e tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:48:36.559609 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-f640e471-148b-4e76-98f1-a1d2a5aebe3e tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:48:36.560410 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-f640e471-148b-4e76-98f1-a1d2a5aebe3e tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:48:36.751214 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-f640e471-148b-4e76-98f1-a1d2a5aebe3e tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c83c05bec4f456d8aa7d51732ddc8af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b2a80a004e04da7ae12db9f3f87146f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:48:36.760185 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-f640e471-148b-4e76-98f1-a1d2a5aebe3e tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] 10.222.0.20 "GET /compute/v2.1/servers/74a59be2-69eb-4bdc-865c-570f5a2019df" status: 200 len: 1370 microversion: 2.1 time: 0.222133 Jul 06 13:48:36.761138 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 267/538] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:48:36 2022] GET /compute/v2.1/servers/74a59be2-69eb-4bdc-865c-570f5a2019df => generated 1370 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:48:37.760189 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-4803bdca-b958-4374-905b-b5edc54001b8 tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] Calling method '>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:48:37.760811 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-4803bdca-b958-4374-905b-b5edc54001b8 tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] [instance: 4895b615-7e9b-4a58-ac74-008e7ba87aad] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:48:37.762672 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG dbcounter [-] [124368] Writing DB stats nova_cell0:SELECT=6 {{(pid=124368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:48:37.764086 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG dbcounter [-] [124368] Writing DB stats nova_cell0:SELECT=4 {{(pid=124368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:48:37.771006 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-4803bdca-b958-4374-905b-b5edc54001b8 tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:48:37.771459 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-4803bdca-b958-4374-905b-b5edc54001b8 tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:48:37.772234 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-4803bdca-b958-4374-905b-b5edc54001b8 tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:48:37.772678 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-4803bdca-b958-4374-905b-b5edc54001b8 tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:48:37.778530 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-90253f99-6d2b-4198-8732-e112e76e877b tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:48:37.779136 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-90253f99-6d2b-4198-8732-e112e76e877b tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] [instance: 74a59be2-69eb-4bdc-865c-570f5a2019df] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:48:37.785877 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-90253f99-6d2b-4198-8732-e112e76e877b tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:48:37.786326 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-90253f99-6d2b-4198-8732-e112e76e877b tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:48:37.787096 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-90253f99-6d2b-4198-8732-e112e76e877b tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:48:37.787766 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-90253f99-6d2b-4198-8732-e112e76e877b tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:48:37.929351 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-4803bdca-b958-4374-905b-b5edc54001b8 tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19ccda8f7ce447c490910ffa14165c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ffa9da064c64346b5f227c28a89ea81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:48:37.937688 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-4803bdca-b958-4374-905b-b5edc54001b8 tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] 10.222.0.20 "GET /compute/v2.1/servers/4895b615-7e9b-4a58-ac74-008e7ba87aad" status: 200 len: 1592 microversion: 2.1 time: 0.181390 Jul 06 13:48:37.938269 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 272/539] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:48:37 2022] GET /compute/v2.1/servers/4895b615-7e9b-4a58-ac74-008e7ba87aad => generated 1592 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:48:37.943915 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-90253f99-6d2b-4198-8732-e112e76e877b tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c83c05bec4f456d8aa7d51732ddc8af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b2a80a004e04da7ae12db9f3f87146f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:48:37.951311 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-90253f99-6d2b-4198-8732-e112e76e877b tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] 10.222.0.20 "GET /compute/v2.1/servers/74a59be2-69eb-4bdc-865c-570f5a2019df" status: 200 len: 1370 microversion: 2.1 time: 0.176578 Jul 06 13:48:37.951870 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 268/540] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:48:37 2022] GET /compute/v2.1/servers/74a59be2-69eb-4bdc-865c-570f5a2019df => generated 1370 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 06 13:48:38.399394 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [req-cd069bfc-dfa7-49d5-9cd2-ea9f734aa7ac req-0d68f2d6-5d73-4ed8-ac19-0f5c37395142 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "74a59be2-69eb-4bdc-865c-570f5a2019df", "name": "network-vif-plugged", "status": "completed", "tag": "d9803c72-57aa-4aaf-b69c-e5ca48b8a2ca"}]} {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 06 13:48:38.408268 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [req-cd069bfc-dfa7-49d5-9cd2-ea9f734aa7ac req-0d68f2d6-5d73-4ed8-ac19-0f5c37395142 service nova] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:48:38.409140 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [req-cd069bfc-dfa7-49d5-9cd2-ea9f734aa7ac req-0d68f2d6-5d73-4ed8-ac19-0f5c37395142 service nova] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:48:38.450017 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.compute.server_external_events [req-cd069bfc-dfa7-49d5-9cd2-ea9f734aa7ac req-0d68f2d6-5d73-4ed8-ac19-0f5c37395142 service nova] Creating event network-vif-plugged:d9803c72-57aa-4aaf-b69c-e5ca48b8a2ca for instance 74a59be2-69eb-4bdc-865c-570f5a2019df on hv-cinder-81914 Jul 06 13:48:38.456393 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [req-cd069bfc-dfa7-49d5-9cd2-ea9f734aa7ac req-0d68f2d6-5d73-4ed8-ac19-0f5c37395142 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060704 Jul 06 13:48:38.457616 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 273/541] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 6 13:48:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 06 13:48:38.967817 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-722775f2-a421-4dd2-a884-93139dbbe951 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:48:38.968428 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-722775f2-a421-4dd2-a884-93139dbbe951 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] [instance: 74a59be2-69eb-4bdc-865c-570f5a2019df] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:48:38.976032 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-722775f2-a421-4dd2-a884-93139dbbe951 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:48:38.976492 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-722775f2-a421-4dd2-a884-93139dbbe951 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:48:38.977485 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-722775f2-a421-4dd2-a884-93139dbbe951 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:48:38.977716 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-722775f2-a421-4dd2-a884-93139dbbe951 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:48:39.180515 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-722775f2-a421-4dd2-a884-93139dbbe951 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c83c05bec4f456d8aa7d51732ddc8af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b2a80a004e04da7ae12db9f3f87146f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:48:39.187897 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-722775f2-a421-4dd2-a884-93139dbbe951 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] 10.222.0.20 "GET /compute/v2.1/servers/74a59be2-69eb-4bdc-865c-570f5a2019df" status: 200 len: 1370 microversion: 2.1 time: 0.223915 Jul 06 13:48:39.188540 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 269/542] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:48:38 2022] GET /compute/v2.1/servers/74a59be2-69eb-4bdc-865c-570f5a2019df => generated 1370 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:48:39.887374 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [req-8b4fd240-9cf0-488a-91cd-07039dad3af8 req-66f0fe87-f4cf-423c-8755-d8fdcc22b247 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4895b615-7e9b-4a58-ac74-008e7ba87aad", "tag": "41ac049c-27f7-4531-b7d5-cc2e3f0f8c79"}]} {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 06 13:48:39.898860 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [req-8b4fd240-9cf0-488a-91cd-07039dad3af8 req-66f0fe87-f4cf-423c-8755-d8fdcc22b247 service nova] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:48:39.899352 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [req-8b4fd240-9cf0-488a-91cd-07039dad3af8 req-66f0fe87-f4cf-423c-8755-d8fdcc22b247 service nova] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:48:39.912776 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.compute.server_external_events [req-8b4fd240-9cf0-488a-91cd-07039dad3af8 req-66f0fe87-f4cf-423c-8755-d8fdcc22b247 service nova] Creating event network-changed:41ac049c-27f7-4531-b7d5-cc2e3f0f8c79 for instance 4895b615-7e9b-4a58-ac74-008e7ba87aad on hv-cinder-81914 Jul 06 13:48:39.917776 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [req-8b4fd240-9cf0-488a-91cd-07039dad3af8 req-66f0fe87-f4cf-423c-8755-d8fdcc22b247 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035062 Jul 06 13:48:39.918382 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 274/543] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 6 13:48:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 06 13:48:40.207807 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-5d212c52-2593-4bc1-90de-86cdf55212bf tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:48:40.208484 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-5d212c52-2593-4bc1-90de-86cdf55212bf tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] [instance: 74a59be2-69eb-4bdc-865c-570f5a2019df] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:48:40.214810 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-5d212c52-2593-4bc1-90de-86cdf55212bf tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:48:40.215266 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-5d212c52-2593-4bc1-90de-86cdf55212bf tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:48:40.216045 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-5d212c52-2593-4bc1-90de-86cdf55212bf tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:48:40.216655 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-5d212c52-2593-4bc1-90de-86cdf55212bf tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:48:40.410161 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-5d212c52-2593-4bc1-90de-86cdf55212bf tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c83c05bec4f456d8aa7d51732ddc8af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b2a80a004e04da7ae12db9f3f87146f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:48:40.421613 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-5d212c52-2593-4bc1-90de-86cdf55212bf tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] 10.222.0.20 "GET /compute/v2.1/servers/74a59be2-69eb-4bdc-865c-570f5a2019df" status: 200 len: 1370 microversion: 2.1 time: 0.220628 Jul 06 13:48:40.422501 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 270/544] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:48:40 2022] GET /compute/v2.1/servers/74a59be2-69eb-4bdc-865c-570f5a2019df => generated 1370 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:48:40.979544 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-63e52df5-5c07-45f1-a151-f2ddf12e6f7c tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-45974178"}} {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 06 13:48:40.980275 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-63e52df5-5c07-45f1-a151-f2ddf12e6f7c tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] [instance: 4895b615-7e9b-4a58-ac74-008e7ba87aad] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:48:40.987808 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-63e52df5-5c07-45f1-a151-f2ddf12e6f7c tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:48:40.988382 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-63e52df5-5c07-45f1-a151-f2ddf12e6f7c tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:48:40.989269 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-63e52df5-5c07-45f1-a151-f2ddf12e6f7c tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:48:40.989806 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-63e52df5-5c07-45f1-a151-f2ddf12e6f7c tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:48:41.137645 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.network.security_group_api [None req-63e52df5-5c07-45f1-a151-f2ddf12e6f7c tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] Adding security group 911fd285-b97a-4259-b460-245e9ba659eb to port 41ac049c-27f7-4531-b7d5-cc2e3f0f8c79 Jul 06 13:48:41.440496 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-3dd09b69-8200-4e06-b99f-bd67942937fd tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:48:41.441090 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-3dd09b69-8200-4e06-b99f-bd67942937fd tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] [instance: 74a59be2-69eb-4bdc-865c-570f5a2019df] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:48:41.447447 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-3dd09b69-8200-4e06-b99f-bd67942937fd tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:48:41.448151 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-3dd09b69-8200-4e06-b99f-bd67942937fd tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:48:41.449132 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-3dd09b69-8200-4e06-b99f-bd67942937fd tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:48:41.449738 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-3dd09b69-8200-4e06-b99f-bd67942937fd tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:48:41.612922 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-3dd09b69-8200-4e06-b99f-bd67942937fd tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c83c05bec4f456d8aa7d51732ddc8af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b2a80a004e04da7ae12db9f3f87146f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:48:41.623141 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-3dd09b69-8200-4e06-b99f-bd67942937fd tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] 10.222.0.20 "GET /compute/v2.1/servers/74a59be2-69eb-4bdc-865c-570f5a2019df" status: 200 len: 1370 microversion: 2.1 time: 0.187193 Jul 06 13:48:41.636969 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 271/545] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:48:41 2022] GET /compute/v2.1/servers/74a59be2-69eb-4bdc-865c-570f5a2019df => generated 1370 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 06 13:48:41.649925 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-63e52df5-5c07-45f1-a151-f2ddf12e6f7c tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] 10.222.0.20 "POST /compute/v2.1/servers/4895b615-7e9b-4a58-ac74-008e7ba87aad/action" status: 202 len: 0 microversion: 2.1 time: 0.674414 Jul 06 13:48:41.650950 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 275/546] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Jul 6 13:48:40 2022] POST /compute/v2.1/servers/4895b615-7e9b-4a58-ac74-008e7ba87aad/action => generated 0 bytes in 677 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 06 13:48:41.668272 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [req-7da0191b-eacf-458c-93f8-dff6380a46cb req-40281420-fcd1-455e-951c-f75c46954e57 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4895b615-7e9b-4a58-ac74-008e7ba87aad", "tag": "41ac049c-27f7-4531-b7d5-cc2e3f0f8c79"}]} {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 06 13:48:41.670708 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-11500e07-2ea1-4b47-9536-7184d8661dd6 tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:48:41.671700 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-11500e07-2ea1-4b47-9536-7184d8661dd6 tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] [instance: 4895b615-7e9b-4a58-ac74-008e7ba87aad] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:48:41.687950 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-11500e07-2ea1-4b47-9536-7184d8661dd6 tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:48:41.691074 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-11500e07-2ea1-4b47-9536-7184d8661dd6 tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:48:41.693646 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-11500e07-2ea1-4b47-9536-7184d8661dd6 tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:48:41.694541 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [req-7da0191b-eacf-458c-93f8-dff6380a46cb req-40281420-fcd1-455e-951c-f75c46954e57 service nova] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:48:41.695202 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-11500e07-2ea1-4b47-9536-7184d8661dd6 tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:48:41.697537 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [req-7da0191b-eacf-458c-93f8-dff6380a46cb req-40281420-fcd1-455e-951c-f75c46954e57 service nova] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:48:41.730911 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.compute.server_external_events [req-7da0191b-eacf-458c-93f8-dff6380a46cb req-40281420-fcd1-455e-951c-f75c46954e57 service nova] Creating event network-changed:41ac049c-27f7-4531-b7d5-cc2e3f0f8c79 for instance 4895b615-7e9b-4a58-ac74-008e7ba87aad on hv-cinder-81914 Jul 06 13:48:41.748395 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [req-7da0191b-eacf-458c-93f8-dff6380a46cb req-40281420-fcd1-455e-951c-f75c46954e57 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089892 Jul 06 13:48:41.749749 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 276/547] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 6 13:48:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 06 13:48:41.892346 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-11500e07-2ea1-4b47-9536-7184d8661dd6 tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19ccda8f7ce447c490910ffa14165c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ffa9da064c64346b5f227c28a89ea81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:48:41.904995 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-11500e07-2ea1-4b47-9536-7184d8661dd6 tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] 10.222.0.20 "GET /compute/v2.1/servers/4895b615-7e9b-4a58-ac74-008e7ba87aad" status: 200 len: 1637 microversion: 2.1 time: 0.249593 Jul 06 13:48:41.905679 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 272/548] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:48:41 2022] GET /compute/v2.1/servers/4895b615-7e9b-4a58-ac74-008e7ba87aad => generated 1637 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:48:42.641623 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-3071c4c0-0613-407e-9dfb-f11e6ea04bc8 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Calling method '>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:48:42.642817 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-3071c4c0-0613-407e-9dfb-f11e6ea04bc8 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] [instance: 74a59be2-69eb-4bdc-865c-570f5a2019df] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:48:42.649338 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-3071c4c0-0613-407e-9dfb-f11e6ea04bc8 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:48:42.649783 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-3071c4c0-0613-407e-9dfb-f11e6ea04bc8 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:48:42.650537 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-3071c4c0-0613-407e-9dfb-f11e6ea04bc8 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:48:42.650971 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-3071c4c0-0613-407e-9dfb-f11e6ea04bc8 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:48:42.787186 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-3071c4c0-0613-407e-9dfb-f11e6ea04bc8 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c83c05bec4f456d8aa7d51732ddc8af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b2a80a004e04da7ae12db9f3f87146f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:48:42.794586 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-3071c4c0-0613-407e-9dfb-f11e6ea04bc8 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] 10.222.0.20 "GET /compute/v2.1/servers/74a59be2-69eb-4bdc-865c-570f5a2019df" status: 200 len: 1564 microversion: 2.1 time: 0.157209 Jul 06 13:48:42.795153 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 277/549] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:48:42 2022] GET /compute/v2.1/servers/74a59be2-69eb-4bdc-865c-570f5a2019df => generated 1564 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:48:42.812535 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-7f3cd592-fcf0-45e8-828a-eaa305673f4c tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:48:42.813143 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-7f3cd592-fcf0-45e8-828a-eaa305673f4c tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] [instance: 74a59be2-69eb-4bdc-865c-570f5a2019df] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:48:42.819844 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-7f3cd592-fcf0-45e8-828a-eaa305673f4c tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:48:42.820285 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-7f3cd592-fcf0-45e8-828a-eaa305673f4c tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:48:42.821067 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-7f3cd592-fcf0-45e8-828a-eaa305673f4c tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:48:42.821498 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-7f3cd592-fcf0-45e8-828a-eaa305673f4c tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:48:42.905702 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-7f3cd592-fcf0-45e8-828a-eaa305673f4c tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] 10.222.0.20 "GET /compute/v2.1/servers/74a59be2-69eb-4bdc-865c-570f5a2019df/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.097695 Jul 06 13:48:42.906287 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 273/550] 10.222.0.20 () {58 vars in 1274 bytes} [Wed Jul 6 13:48:42 2022] GET /compute/v2.1/servers/74a59be2-69eb-4bdc-865c-570f5a2019df/os-interface => generated 284 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 06 13:48:44.057451 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [req-dcea3e37-ea43-4e41-83ed-d1d04c041a34 req-99dd00b7-d278-4039-8c96-4df8628e0a4f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "74a59be2-69eb-4bdc-865c-570f5a2019df", "tag": "d9803c72-57aa-4aaf-b69c-e5ca48b8a2ca"}]} {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 06 13:48:44.069092 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [req-dcea3e37-ea43-4e41-83ed-d1d04c041a34 req-99dd00b7-d278-4039-8c96-4df8628e0a4f service nova] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:48:44.069871 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [req-dcea3e37-ea43-4e41-83ed-d1d04c041a34 req-99dd00b7-d278-4039-8c96-4df8628e0a4f service nova] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:48:44.085048 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.compute.server_external_events [req-dcea3e37-ea43-4e41-83ed-d1d04c041a34 req-99dd00b7-d278-4039-8c96-4df8628e0a4f service nova] Creating event network-changed:d9803c72-57aa-4aaf-b69c-e5ca48b8a2ca for instance 74a59be2-69eb-4bdc-865c-570f5a2019df on hv-cinder-81914 Jul 06 13:48:44.099674 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [req-dcea3e37-ea43-4e41-83ed-d1d04c041a34 req-99dd00b7-d278-4039-8c96-4df8628e0a4f service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046587 Jul 06 13:48:44.100752 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 278/551] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 6 13:48:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 06 13:48:59.781301 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG dbcounter [-] [124367] Writing DB stats nova_api:SELECT=33 {{(pid=124367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:48:59.782053 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG dbcounter [-] [124367] Writing DB stats nova_cell1:SELECT=41 {{(pid=124367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:48:59.787877 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-d7ef9ffa-09ec-428d-9a89-1aa5aef9c908 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:48:59.788362 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-d7ef9ffa-09ec-428d-9a89-1aa5aef9c908 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] [instance: 5cf73c2b-28f6-49f1-a119-224c05679d2c] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:48:59.795202 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-d7ef9ffa-09ec-428d-9a89-1aa5aef9c908 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:48:59.795652 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-d7ef9ffa-09ec-428d-9a89-1aa5aef9c908 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:48:59.796419 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-d7ef9ffa-09ec-428d-9a89-1aa5aef9c908 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:48:59.796851 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-d7ef9ffa-09ec-428d-9a89-1aa5aef9c908 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:48:59.821836 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-d7ef9ffa-09ec-428d-9a89-1aa5aef9c908 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] 10.222.0.20 "GET /compute/v2.1/servers/5cf73c2b-28f6-49f1-a119-224c05679d2c/ips" status: 200 len: 151 microversion: 2.1 time: 0.041949 Jul 06 13:48:59.822418 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 274/552] 10.222.0.20 () {58 vars in 1247 bytes} [Wed Jul 6 13:48:59 2022] GET /compute/v2.1/servers/5cf73c2b-28f6-49f1-a119-224c05679d2c/ips => generated 151 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 06 13:49:02.238102 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG dbcounter [-] [124368] Writing DB stats nova_api:SELECT=52,nova_api:INSERT=3 {{(pid=124368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:49:02.239060 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG dbcounter [-] [124368] Writing DB stats nova_cell1:SELECT=54 {{(pid=124368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:49:02.243301 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-26713bea-cda2-4445-a020-1f87bf783d8b tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "56776123-3d65-4f21-8214-ad1c2ba18e6b"}} {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 06 13:49:02.244465 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-26713bea-cda2-4445-a020-1f87bf783d8b tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] [instance: 5cf73c2b-28f6-49f1-a119-224c05679d2c] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:49:02.251525 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-26713bea-cda2-4445-a020-1f87bf783d8b tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:49:02.251976 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-26713bea-cda2-4445-a020-1f87bf783d8b tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:49:02.252743 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-26713bea-cda2-4445-a020-1f87bf783d8b tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:49:02.253218 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-26713bea-cda2-4445-a020-1f87bf783d8b tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:49:02.540441 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-26713bea-cda2-4445-a020-1f87bf783d8b tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] 10.222.0.20 "POST /compute/v2.1/servers/5cf73c2b-28f6-49f1-a119-224c05679d2c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.304120 Jul 06 13:49:02.541167 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 279/553] 10.222.0.20 () {60 vars in 1322 bytes} [Wed Jul 6 13:49:02 2022] POST /compute/v2.1/servers/5cf73c2b-28f6-49f1-a119-224c05679d2c/os-volume_attachments => generated 194 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 06 13:49:12.670605 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-6637f479-09bc-44e7-99ef-96bfcf06c0d0 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:49:12.671185 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-6637f479-09bc-44e7-99ef-96bfcf06c0d0 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] [instance: 546a77fd-66e1-4d89-afa3-58d632b09186] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:49:12.673492 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG dbcounter [-] [124367] Writing DB stats nova_api:SELECT=2 {{(pid=124367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:49:12.674134 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG dbcounter [-] [124367] Writing DB stats nova_cell1:SELECT=4 {{(pid=124367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:49:12.681556 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-6637f479-09bc-44e7-99ef-96bfcf06c0d0 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:49:12.682008 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-6637f479-09bc-44e7-99ef-96bfcf06c0d0 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:49:12.682813 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-6637f479-09bc-44e7-99ef-96bfcf06c0d0 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:49:12.683248 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-6637f479-09bc-44e7-99ef-96bfcf06c0d0 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:49:12.706461 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-6637f479-09bc-44e7-99ef-96bfcf06c0d0 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] 10.222.0.20 "GET /compute/v2.1/servers/546a77fd-66e1-4d89-afa3-58d632b09186/ips" status: 200 len: 146 microversion: 2.1 time: 0.039639 Jul 06 13:49:12.707021 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 275/554] 10.222.0.20 () {58 vars in 1247 bytes} [Wed Jul 6 13:49:12 2022] GET /compute/v2.1/servers/546a77fd-66e1-4d89-afa3-58d632b09186/ips => generated 146 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 06 13:49:14.877696 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG dbcounter [-] [124368] Writing DB stats nova_api:SELECT=2 {{(pid=124368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:49:14.878524 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG dbcounter [-] [124368] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:49:14.883246 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-0448f1f5-3f5e-45ea-9d10-3e340369cd03 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1ec4acf0-fb51-4260-93d3-0b67fe07f21b"}} {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 06 13:49:14.884466 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-0448f1f5-3f5e-45ea-9d10-3e340369cd03 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] [instance: 546a77fd-66e1-4d89-afa3-58d632b09186] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:49:14.891785 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-0448f1f5-3f5e-45ea-9d10-3e340369cd03 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:49:14.892173 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-0448f1f5-3f5e-45ea-9d10-3e340369cd03 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:49:14.892925 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-0448f1f5-3f5e-45ea-9d10-3e340369cd03 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:49:14.893379 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-0448f1f5-3f5e-45ea-9d10-3e340369cd03 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:49:24.889677 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG dbcounter [-] [124368] Writing DB stats nova_api:SELECT=2 {{(pid=124368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:49:24.967131 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG dbcounter [-] [124368] Writing DB stats nova_cell1:SELECT=6 {{(pid=124368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:49:26.319609 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-0448f1f5-3f5e-45ea-9d10-3e340369cd03 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] 10.222.0.20 "POST /compute/v2.1/servers/546a77fd-66e1-4d89-afa3-58d632b09186/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 11.443114 Jul 06 13:49:26.320254 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 280/555] 10.222.0.20 () {60 vars in 1322 bytes} [Wed Jul 6 13:49:14 2022] POST /compute/v2.1/servers/546a77fd-66e1-4d89-afa3-58d632b09186/os-volume_attachments => generated 194 bytes in 11445 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 06 13:49:27.933383 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-c9ea34ff-cccc-41f2-8e11-dfdbcd1970ac tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Action: 'create', calling method: .version_select at 0x7ffbc43158b0>, body: {"keypair": {"name": "tempest-keypair-699048258", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFwRqiPMMm+JMAP83jTxp62u+YDTjDVmyP5SWvN9KxXfu4qvrxNHh1iM+g2qwYuUNikzoF84R+UIFQ6Jc97IbynxYJU7AUcbJH4/5WfTCowSAIpz4h4zxK/bgP9dQY2Geg=="}} {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 06 13:49:27.939173 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG dbcounter [-] [124367] Writing DB stats nova_api:SELECT=2 {{(pid=124367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:49:27.939811 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG dbcounter [-] [124367] Writing DB stats nova_cell1:SELECT=4 {{(pid=124367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:49:27.956869 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.quota [None req-c9ea34ff-cccc-41f2-8e11-dfdbcd1970ac tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Getting quotas for project bd85f2a57a0847debf5aaf81aab7a638. Resources: {'key_pairs'} {{(pid=124367) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 06 13:49:27.961707 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.quota [None req-c9ea34ff-cccc-41f2-8e11-dfdbcd1970ac tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Getting quotas for user 7b572a8f465048558fc969b85b2aec5b and project bd85f2a57a0847debf5aaf81aab7a638. Resources: {'key_pairs'} {{(pid=124367) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 06 13:49:27.993663 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-c9ea34ff-cccc-41f2-8e11-dfdbcd1970ac tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.064420 Jul 06 13:49:27.994346 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 276/556] 10.222.0.20 () {60 vars in 1158 bytes} [Wed Jul 6 13:49:27 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 06 13:49:29.298147 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-cbb8b57b-eec2-4d07-a6fb-8176c8fd0534 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-964088598", "imageRef": "b08481d9-1e39-41e8-97bd-b05a9c35b377", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "599de418-b206-4788-89c1-e9276ab94414"}], "security_groups": [{"name": "tempest-securitygroup--1450260043"}], "key_name": "tempest-keypair-699048258", "user_data": "}} {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 06 13:49:29.397134 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.network.neutron [None req-cbb8b57b-eec2-4d07-a6fb-8176c8fd0534 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] validate_networks() for [('599de418-b206-4788-89c1-e9276ab94414', None, None, None, None, None)] {{(pid=124368) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 06 13:49:29.772107 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.virt.hardware [None req-cbb8b57b-eec2-4d07-a6fb-8176c8fd0534 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Flavor limits 0:0:0 {{(pid=124368) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 06 13:49:29.772526 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.virt.hardware [None req-cbb8b57b-eec2-4d07-a6fb-8176c8fd0534 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Image limits 0:0:0 {{(pid=124368) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 06 13:49:29.773018 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.virt.hardware [None req-cbb8b57b-eec2-4d07-a6fb-8176c8fd0534 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Flavor pref 0:0:0 {{(pid=124368) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 06 13:49:29.773428 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.virt.hardware [None req-cbb8b57b-eec2-4d07-a6fb-8176c8fd0534 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Image pref 0:0:0 {{(pid=124368) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 06 13:49:29.773837 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.virt.hardware [None req-cbb8b57b-eec2-4d07-a6fb-8176c8fd0534 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124368) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 06 13:49:29.782496 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-cbb8b57b-eec2-4d07-a6fb-8176c8fd0534 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:49:29.782936 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-cbb8b57b-eec2-4d07-a6fb-8176c8fd0534 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:49:29.783728 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-cbb8b57b-eec2-4d07-a6fb-8176c8fd0534 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:49:29.784158 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-cbb8b57b-eec2-4d07-a6fb-8176c8fd0534 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:49:29.803060 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.quota [None req-cbb8b57b-eec2-4d07-a6fb-8176c8fd0534 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Getting quotas for project bd85f2a57a0847debf5aaf81aab7a638. Resources: {'instances', 'cores', 'ram'} {{(pid=124368) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 06 13:49:29.808749 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.quota [None req-cbb8b57b-eec2-4d07-a6fb-8176c8fd0534 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Getting quotas for user 7b572a8f465048558fc969b85b2aec5b and project bd85f2a57a0847debf5aaf81aab7a638. Resources: {'instances', 'cores', 'ram'} {{(pid=124368) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 06 13:49:29.824721 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-cbb8b57b-eec2-4d07-a6fb-8176c8fd0534 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Going to run 1 instances... {{(pid=124368) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 06 13:49:29.828444 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-cbb8b57b-eec2-4d07-a6fb-8176c8fd0534 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] [instance: 85dc896f-7a07-400c-abc8-cc2d27bda2db] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b08481d9-1e39-41e8-97bd-b05a9c35b377',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124368) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 06 13:49:29.882932 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-cbb8b57b-eec2-4d07-a6fb-8176c8fd0534 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.589987 Jul 06 13:49:29.883583 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 281/557] 10.222.0.20 () {60 vars in 1146 bytes} [Wed Jul 6 13:49:29 2022] POST /compute/v2.1/servers => generated 402 bytes in 591 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 06 13:49:29.894221 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-5dd99845-0b7b-457a-9f6a-d6e1654271bf tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:49:29.895317 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-5dd99845-0b7b-457a-9f6a-d6e1654271bf tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] [instance: 85dc896f-7a07-400c-abc8-cc2d27bda2db] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:49:29.952399 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-5dd99845-0b7b-457a-9f6a-d6e1654271bf tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b572a8f465048558fc969b85b2aec5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd85f2a57a0847debf5aaf81aab7a638', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:49:29.960252 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-5dd99845-0b7b-457a-9f6a-d6e1654271bf tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] 10.222.0.20 "GET /compute/v2.1/servers/85dc896f-7a07-400c-abc8-cc2d27bda2db" status: 200 len: 1240 microversion: 2.1 time: 0.070516 Jul 06 13:49:29.961093 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 277/558] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:49:29 2022] GET /compute/v2.1/servers/85dc896f-7a07-400c-abc8-cc2d27bda2db => generated 1240 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:49:30.978573 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-02070bea-c76d-48f1-a132-d67494fe8b48 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Calling method '>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:49:30.979188 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-02070bea-c76d-48f1-a132-d67494fe8b48 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] [instance: 85dc896f-7a07-400c-abc8-cc2d27bda2db] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:49:30.986366 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-02070bea-c76d-48f1-a132-d67494fe8b48 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:49:30.986818 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-02070bea-c76d-48f1-a132-d67494fe8b48 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:49:30.987619 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-02070bea-c76d-48f1-a132-d67494fe8b48 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:49:30.988055 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-02070bea-c76d-48f1-a132-d67494fe8b48 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:49:31.086358 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-02070bea-c76d-48f1-a132-d67494fe8b48 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b572a8f465048558fc969b85b2aec5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd85f2a57a0847debf5aaf81aab7a638', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:49:31.093877 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-02070bea-c76d-48f1-a132-d67494fe8b48 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] 10.222.0.20 "GET /compute/v2.1/servers/85dc896f-7a07-400c-abc8-cc2d27bda2db" status: 200 len: 1300 microversion: 2.1 time: 0.119898 Jul 06 13:49:31.094658 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 282/559] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:49:30 2022] GET /compute/v2.1/servers/85dc896f-7a07-400c-abc8-cc2d27bda2db => generated 1300 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:49:32.115277 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-ca00c78f-7c9d-43af-9608-5715602c39aa tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:49:32.116166 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-ca00c78f-7c9d-43af-9608-5715602c39aa tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] [instance: 85dc896f-7a07-400c-abc8-cc2d27bda2db] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:49:32.122820 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-ca00c78f-7c9d-43af-9608-5715602c39aa tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:49:32.123347 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-ca00c78f-7c9d-43af-9608-5715602c39aa tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:49:32.124187 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-ca00c78f-7c9d-43af-9608-5715602c39aa tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:49:32.124613 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-ca00c78f-7c9d-43af-9608-5715602c39aa tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:49:32.279861 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-ca00c78f-7c9d-43af-9608-5715602c39aa tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b572a8f465048558fc969b85b2aec5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd85f2a57a0847debf5aaf81aab7a638', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:49:32.288436 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-ca00c78f-7c9d-43af-9608-5715602c39aa tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] 10.222.0.20 "GET /compute/v2.1/servers/85dc896f-7a07-400c-abc8-cc2d27bda2db" status: 200 len: 1366 microversion: 2.1 time: 0.177887 Jul 06 13:49:32.296133 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 278/560] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:49:32 2022] GET /compute/v2.1/servers/85dc896f-7a07-400c-abc8-cc2d27bda2db => generated 1366 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:49:32.787542 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [req-85dc630e-c8d3-4a5b-be02-67f23434f216 req-76432d9a-70ec-4436-9683-e9d410af310c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "85dc896f-7a07-400c-abc8-cc2d27bda2db", "tag": "e9e85219-187e-4978-bd5f-5875bc364c0e"}]} {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 06 13:49:32.800790 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [req-85dc630e-c8d3-4a5b-be02-67f23434f216 req-76432d9a-70ec-4436-9683-e9d410af310c service nova] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:49:32.801771 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [req-85dc630e-c8d3-4a5b-be02-67f23434f216 req-76432d9a-70ec-4436-9683-e9d410af310c service nova] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:49:32.835907 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.compute.server_external_events [req-85dc630e-c8d3-4a5b-be02-67f23434f216 req-76432d9a-70ec-4436-9683-e9d410af310c service nova] Creating event network-changed:e9e85219-187e-4978-bd5f-5875bc364c0e for instance 85dc896f-7a07-400c-abc8-cc2d27bda2db on hv-cinder-81914 Jul 06 13:49:32.846774 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [req-85dc630e-c8d3-4a5b-be02-67f23434f216 req-76432d9a-70ec-4436-9683-e9d410af310c service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062300 Jul 06 13:49:32.847369 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 283/561] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 6 13:49:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 06 13:49:33.311437 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-02b7012d-d36b-4bbe-94fb-58cd4d6affe2 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:49:33.312045 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-02b7012d-d36b-4bbe-94fb-58cd4d6affe2 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] [instance: 85dc896f-7a07-400c-abc8-cc2d27bda2db] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:49:33.318845 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-02b7012d-d36b-4bbe-94fb-58cd4d6affe2 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:49:33.319302 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-02b7012d-d36b-4bbe-94fb-58cd4d6affe2 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:49:33.320078 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-02b7012d-d36b-4bbe-94fb-58cd4d6affe2 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:49:33.320586 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-02b7012d-d36b-4bbe-94fb-58cd4d6affe2 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:49:33.455650 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-02b7012d-d36b-4bbe-94fb-58cd4d6affe2 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b572a8f465048558fc969b85b2aec5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd85f2a57a0847debf5aaf81aab7a638', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:49:33.464779 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-02b7012d-d36b-4bbe-94fb-58cd4d6affe2 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] 10.222.0.20 "GET /compute/v2.1/servers/85dc896f-7a07-400c-abc8-cc2d27bda2db" status: 200 len: 1366 microversion: 2.1 time: 0.157053 Jul 06 13:49:33.476384 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 279/562] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:49:33 2022] GET /compute/v2.1/servers/85dc896f-7a07-400c-abc8-cc2d27bda2db => generated 1366 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:49:34.483924 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-e76d07ab-5d6f-4a08-9b9a-e2172c87424a tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Calling method '>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:49:34.484856 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-e76d07ab-5d6f-4a08-9b9a-e2172c87424a tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] [instance: 85dc896f-7a07-400c-abc8-cc2d27bda2db] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:49:34.502846 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-e76d07ab-5d6f-4a08-9b9a-e2172c87424a tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:49:34.503581 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-e76d07ab-5d6f-4a08-9b9a-e2172c87424a tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:49:34.505271 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-e76d07ab-5d6f-4a08-9b9a-e2172c87424a tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:49:34.505928 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-e76d07ab-5d6f-4a08-9b9a-e2172c87424a tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:49:34.666516 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-e76d07ab-5d6f-4a08-9b9a-e2172c87424a tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b572a8f465048558fc969b85b2aec5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd85f2a57a0847debf5aaf81aab7a638', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:49:34.673823 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-e76d07ab-5d6f-4a08-9b9a-e2172c87424a tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] 10.222.0.20 "GET /compute/v2.1/servers/85dc896f-7a07-400c-abc8-cc2d27bda2db" status: 200 len: 1366 microversion: 2.1 time: 0.194504 Jul 06 13:49:34.674406 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 284/563] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:49:34 2022] GET /compute/v2.1/servers/85dc896f-7a07-400c-abc8-cc2d27bda2db => generated 1366 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:49:35.690845 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-623d8d34-692f-46d2-9fd2-36851a4a194d tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:49:35.691648 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-623d8d34-692f-46d2-9fd2-36851a4a194d tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] [instance: 85dc896f-7a07-400c-abc8-cc2d27bda2db] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:49:35.698853 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-623d8d34-692f-46d2-9fd2-36851a4a194d tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:49:35.699376 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-623d8d34-692f-46d2-9fd2-36851a4a194d tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:49:35.700489 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-623d8d34-692f-46d2-9fd2-36851a4a194d tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:49:35.701027 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-623d8d34-692f-46d2-9fd2-36851a4a194d tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:49:35.849731 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-623d8d34-692f-46d2-9fd2-36851a4a194d tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b572a8f465048558fc969b85b2aec5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd85f2a57a0847debf5aaf81aab7a638', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:49:35.857445 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-623d8d34-692f-46d2-9fd2-36851a4a194d tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] 10.222.0.20 "GET /compute/v2.1/servers/85dc896f-7a07-400c-abc8-cc2d27bda2db" status: 200 len: 1366 microversion: 2.1 time: 0.170369 Jul 06 13:49:35.858003 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 280/564] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:49:35 2022] GET /compute/v2.1/servers/85dc896f-7a07-400c-abc8-cc2d27bda2db => generated 1366 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:49:36.874088 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-31e0e019-4d61-47cc-872e-8a7e94ab8a62 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Calling method '>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:49:36.874626 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-31e0e019-4d61-47cc-872e-8a7e94ab8a62 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] [instance: 85dc896f-7a07-400c-abc8-cc2d27bda2db] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:49:36.881541 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-31e0e019-4d61-47cc-872e-8a7e94ab8a62 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:49:36.882002 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-31e0e019-4d61-47cc-872e-8a7e94ab8a62 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:49:36.882780 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-31e0e019-4d61-47cc-872e-8a7e94ab8a62 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:49:36.883210 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-31e0e019-4d61-47cc-872e-8a7e94ab8a62 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:49:37.022702 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-31e0e019-4d61-47cc-872e-8a7e94ab8a62 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b572a8f465048558fc969b85b2aec5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd85f2a57a0847debf5aaf81aab7a638', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:49:37.030802 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-31e0e019-4d61-47cc-872e-8a7e94ab8a62 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] 10.222.0.20 "GET /compute/v2.1/servers/85dc896f-7a07-400c-abc8-cc2d27bda2db" status: 200 len: 1366 microversion: 2.1 time: 0.160584 Jul 06 13:49:37.031374 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 285/565] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:49:36 2022] GET /compute/v2.1/servers/85dc896f-7a07-400c-abc8-cc2d27bda2db => generated 1366 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:49:38.048303 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-0bd39e65-ee74-4e3b-85b7-b4c826061e16 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:49:38.048946 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-0bd39e65-ee74-4e3b-85b7-b4c826061e16 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] [instance: 85dc896f-7a07-400c-abc8-cc2d27bda2db] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:49:38.055912 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-0bd39e65-ee74-4e3b-85b7-b4c826061e16 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:49:38.056364 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-0bd39e65-ee74-4e3b-85b7-b4c826061e16 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:49:38.057155 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-0bd39e65-ee74-4e3b-85b7-b4c826061e16 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:49:38.057595 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-0bd39e65-ee74-4e3b-85b7-b4c826061e16 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:49:38.186141 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-0bd39e65-ee74-4e3b-85b7-b4c826061e16 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b572a8f465048558fc969b85b2aec5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd85f2a57a0847debf5aaf81aab7a638', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:49:38.193819 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-0bd39e65-ee74-4e3b-85b7-b4c826061e16 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] 10.222.0.20 "GET /compute/v2.1/servers/85dc896f-7a07-400c-abc8-cc2d27bda2db" status: 200 len: 1366 microversion: 2.1 time: 0.149827 Jul 06 13:49:38.194368 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 281/566] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:49:38 2022] GET /compute/v2.1/servers/85dc896f-7a07-400c-abc8-cc2d27bda2db => generated 1366 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:49:39.210428 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-e3f672fb-2444-4dd2-8bc2-fee0dc9f3e7a tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Calling method '>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:49:39.211043 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-e3f672fb-2444-4dd2-8bc2-fee0dc9f3e7a tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] [instance: 85dc896f-7a07-400c-abc8-cc2d27bda2db] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:49:39.217535 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-e3f672fb-2444-4dd2-8bc2-fee0dc9f3e7a tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:49:39.217933 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-e3f672fb-2444-4dd2-8bc2-fee0dc9f3e7a tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:49:39.218702 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-e3f672fb-2444-4dd2-8bc2-fee0dc9f3e7a tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:49:39.219146 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-e3f672fb-2444-4dd2-8bc2-fee0dc9f3e7a tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:49:39.352193 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-e3f672fb-2444-4dd2-8bc2-fee0dc9f3e7a tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b572a8f465048558fc969b85b2aec5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd85f2a57a0847debf5aaf81aab7a638', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:49:39.359554 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-e3f672fb-2444-4dd2-8bc2-fee0dc9f3e7a tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] 10.222.0.20 "GET /compute/v2.1/servers/85dc896f-7a07-400c-abc8-cc2d27bda2db" status: 200 len: 1366 microversion: 2.1 time: 0.153015 Jul 06 13:49:39.360105 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 286/567] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:49:39 2022] GET /compute/v2.1/servers/85dc896f-7a07-400c-abc8-cc2d27bda2db => generated 1366 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:49:40.377139 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-7bfe689d-5043-4890-838a-7127423383c7 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:49:40.377742 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-7bfe689d-5043-4890-838a-7127423383c7 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] [instance: 85dc896f-7a07-400c-abc8-cc2d27bda2db] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:49:40.380301 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG dbcounter [-] [124367] Writing DB stats nova_cell0:SELECT=6 {{(pid=124367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:49:40.386043 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-7bfe689d-5043-4890-838a-7127423383c7 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:49:40.387184 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-7bfe689d-5043-4890-838a-7127423383c7 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:49:40.388208 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-7bfe689d-5043-4890-838a-7127423383c7 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:49:40.388638 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-7bfe689d-5043-4890-838a-7127423383c7 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:49:40.520550 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-7bfe689d-5043-4890-838a-7127423383c7 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b572a8f465048558fc969b85b2aec5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd85f2a57a0847debf5aaf81aab7a638', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:49:40.527880 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-7bfe689d-5043-4890-838a-7127423383c7 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] 10.222.0.20 "GET /compute/v2.1/servers/85dc896f-7a07-400c-abc8-cc2d27bda2db" status: 200 len: 1366 microversion: 2.1 time: 0.154712 Jul 06 13:49:40.528437 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 282/568] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:49:40 2022] GET /compute/v2.1/servers/85dc896f-7a07-400c-abc8-cc2d27bda2db => generated 1366 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:49:41.546193 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-5c40c2e4-df94-4ffd-a11f-0eb0a980fd8d tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Calling method '>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:49:41.546852 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-5c40c2e4-df94-4ffd-a11f-0eb0a980fd8d tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] [instance: 85dc896f-7a07-400c-abc8-cc2d27bda2db] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:49:41.548900 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG dbcounter [-] [124368] Writing DB stats nova_cell0:SELECT=2 {{(pid=124368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:49:41.549614 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG dbcounter [-] [124368] Writing DB stats nova_cell0:SELECT=6 {{(pid=124368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:49:41.557243 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-5c40c2e4-df94-4ffd-a11f-0eb0a980fd8d tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:49:41.557698 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-5c40c2e4-df94-4ffd-a11f-0eb0a980fd8d tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:49:41.558470 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-5c40c2e4-df94-4ffd-a11f-0eb0a980fd8d tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:49:41.558913 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-5c40c2e4-df94-4ffd-a11f-0eb0a980fd8d tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:49:41.720541 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-5c40c2e4-df94-4ffd-a11f-0eb0a980fd8d tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b572a8f465048558fc969b85b2aec5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd85f2a57a0847debf5aaf81aab7a638', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:49:41.730452 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-5c40c2e4-df94-4ffd-a11f-0eb0a980fd8d tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] 10.222.0.20 "GET /compute/v2.1/servers/85dc896f-7a07-400c-abc8-cc2d27bda2db" status: 200 len: 1366 microversion: 2.1 time: 0.188319 Jul 06 13:49:41.731306 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 287/569] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:49:41 2022] GET /compute/v2.1/servers/85dc896f-7a07-400c-abc8-cc2d27bda2db => generated 1366 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:49:42.565620 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [req-a393f47e-095e-4da5-b0bf-f35e43312f8c req-ffe7df16-35f1-4053-87e8-9c3a9d70d16d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "85dc896f-7a07-400c-abc8-cc2d27bda2db", "name": "network-vif-plugged", "status": "completed", "tag": "e9e85219-187e-4978-bd5f-5875bc364c0e"}]} {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 06 13:49:42.575794 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [req-a393f47e-095e-4da5-b0bf-f35e43312f8c req-ffe7df16-35f1-4053-87e8-9c3a9d70d16d service nova] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:49:42.576238 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [req-a393f47e-095e-4da5-b0bf-f35e43312f8c req-ffe7df16-35f1-4053-87e8-9c3a9d70d16d service nova] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:49:42.589899 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.compute.server_external_events [req-a393f47e-095e-4da5-b0bf-f35e43312f8c req-ffe7df16-35f1-4053-87e8-9c3a9d70d16d service nova] Creating event network-vif-plugged:e9e85219-187e-4978-bd5f-5875bc364c0e for instance 85dc896f-7a07-400c-abc8-cc2d27bda2db on hv-cinder-81914 Jul 06 13:49:42.595022 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [req-a393f47e-095e-4da5-b0bf-f35e43312f8c req-ffe7df16-35f1-4053-87e8-9c3a9d70d16d service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032917 Jul 06 13:49:42.595560 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 283/570] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 6 13:49:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 06 13:49:42.747953 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-6e80d67e-668d-4e9c-acc2-a50c904d44d5 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Calling method '>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:49:42.748672 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-6e80d67e-668d-4e9c-acc2-a50c904d44d5 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] [instance: 85dc896f-7a07-400c-abc8-cc2d27bda2db] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:49:42.756233 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-6e80d67e-668d-4e9c-acc2-a50c904d44d5 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:49:42.756691 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-6e80d67e-668d-4e9c-acc2-a50c904d44d5 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:49:42.757505 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-6e80d67e-668d-4e9c-acc2-a50c904d44d5 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:49:42.757947 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-6e80d67e-668d-4e9c-acc2-a50c904d44d5 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:49:42.939634 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-6e80d67e-668d-4e9c-acc2-a50c904d44d5 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b572a8f465048558fc969b85b2aec5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd85f2a57a0847debf5aaf81aab7a638', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:49:42.947855 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-6e80d67e-668d-4e9c-acc2-a50c904d44d5 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] 10.222.0.20 "GET /compute/v2.1/servers/85dc896f-7a07-400c-abc8-cc2d27bda2db" status: 200 len: 1366 microversion: 2.1 time: 0.203839 Jul 06 13:49:42.948425 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 288/571] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:49:42 2022] GET /compute/v2.1/servers/85dc896f-7a07-400c-abc8-cc2d27bda2db => generated 1366 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:49:43.309614 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-d2158a3e-78e6-4ebd-aaa6-545af964e411 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 06 13:49:43.316208 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-d2158a3e-78e6-4ebd-aaa6-545af964e411 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:49:43.317474 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-d2158a3e-78e6-4ebd-aaa6-545af964e411 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:49:43.386750 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-d2158a3e-78e6-4ebd-aaa6-545af964e411 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] [instance: 546a77fd-66e1-4d89-afa3-58d632b09186] Going to try to stop instance {{(pid=124367) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jul 06 13:49:43.435281 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-d2158a3e-78e6-4ebd-aaa6-545af964e411 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] 10.222.0.20 "POST /compute/v2.1/servers/546a77fd-66e1-4d89-afa3-58d632b09186/action" status: 202 len: 0 microversion: 2.1 time: 0.129687 Jul 06 13:49:43.436106 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 284/572] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Jul 6 13:49:43 2022] POST /compute/v2.1/servers/546a77fd-66e1-4d89-afa3-58d632b09186/action => generated 0 bytes in 131 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 06 13:49:43.445377 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-f905241e-9f9d-423f-b98f-6dcf77b52758 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Calling method '>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:49:43.446112 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-f905241e-9f9d-423f-b98f-6dcf77b52758 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] [instance: 546a77fd-66e1-4d89-afa3-58d632b09186] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:49:43.453570 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-f905241e-9f9d-423f-b98f-6dcf77b52758 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:49:43.454032 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-f905241e-9f9d-423f-b98f-6dcf77b52758 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:49:43.454817 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-f905241e-9f9d-423f-b98f-6dcf77b52758 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:49:43.455838 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-f905241e-9f9d-423f-b98f-6dcf77b52758 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:49:43.602265 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-f905241e-9f9d-423f-b98f-6dcf77b52758 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d7cacb73c8342579d9f990b0193487c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05df572327d54bd99595974b75898052', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:49:43.610625 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-f905241e-9f9d-423f-b98f-6dcf77b52758 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] 10.222.0.20 "GET /compute/v2.1/servers/546a77fd-66e1-4d89-afa3-58d632b09186" status: 200 len: 1723 microversion: 2.1 time: 0.170162 Jul 06 13:49:43.611200 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 289/573] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:49:43 2022] GET /compute/v2.1/servers/546a77fd-66e1-4d89-afa3-58d632b09186 => generated 1723 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:49:43.967181 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-965cb3d9-ae1f-454c-8059-5184445cb6f7 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:49:43.967902 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-965cb3d9-ae1f-454c-8059-5184445cb6f7 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] [instance: 85dc896f-7a07-400c-abc8-cc2d27bda2db] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:49:43.975877 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-965cb3d9-ae1f-454c-8059-5184445cb6f7 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:49:43.976328 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-965cb3d9-ae1f-454c-8059-5184445cb6f7 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:49:43.977124 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-965cb3d9-ae1f-454c-8059-5184445cb6f7 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:49:43.977560 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-965cb3d9-ae1f-454c-8059-5184445cb6f7 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:49:44.106852 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-965cb3d9-ae1f-454c-8059-5184445cb6f7 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b572a8f465048558fc969b85b2aec5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd85f2a57a0847debf5aaf81aab7a638', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:49:44.114335 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-965cb3d9-ae1f-454c-8059-5184445cb6f7 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] 10.222.0.20 "GET /compute/v2.1/servers/85dc896f-7a07-400c-abc8-cc2d27bda2db" status: 200 len: 1366 microversion: 2.1 time: 0.151350 Jul 06 13:49:44.114904 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 285/574] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:49:43 2022] GET /compute/v2.1/servers/85dc896f-7a07-400c-abc8-cc2d27bda2db => generated 1366 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:49:44.628514 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-bae73ee3-1c7e-4b38-946e-593b5df0223e tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Calling method '>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:49:44.629284 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-bae73ee3-1c7e-4b38-946e-593b5df0223e tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] [instance: 546a77fd-66e1-4d89-afa3-58d632b09186] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:49:44.636554 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-bae73ee3-1c7e-4b38-946e-593b5df0223e tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:49:44.637032 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-bae73ee3-1c7e-4b38-946e-593b5df0223e tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:49:44.637837 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-bae73ee3-1c7e-4b38-946e-593b5df0223e tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:49:44.638282 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-bae73ee3-1c7e-4b38-946e-593b5df0223e tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:49:44.784058 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-bae73ee3-1c7e-4b38-946e-593b5df0223e tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d7cacb73c8342579d9f990b0193487c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05df572327d54bd99595974b75898052', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:49:44.793494 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-bae73ee3-1c7e-4b38-946e-593b5df0223e tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] 10.222.0.20 "GET /compute/v2.1/servers/546a77fd-66e1-4d89-afa3-58d632b09186" status: 200 len: 1723 microversion: 2.1 time: 0.168893 Jul 06 13:49:44.794066 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 290/575] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:49:44 2022] GET /compute/v2.1/servers/546a77fd-66e1-4d89-afa3-58d632b09186 => generated 1723 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:49:45.132266 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-d668a097-3a5a-4a3d-89eb-160682880311 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:49:45.132867 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-d668a097-3a5a-4a3d-89eb-160682880311 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] [instance: 85dc896f-7a07-400c-abc8-cc2d27bda2db] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:49:45.139241 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-d668a097-3a5a-4a3d-89eb-160682880311 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:49:45.139689 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-d668a097-3a5a-4a3d-89eb-160682880311 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:49:45.140445 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-d668a097-3a5a-4a3d-89eb-160682880311 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:49:45.140879 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-d668a097-3a5a-4a3d-89eb-160682880311 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:49:45.293389 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-d668a097-3a5a-4a3d-89eb-160682880311 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b572a8f465048558fc969b85b2aec5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd85f2a57a0847debf5aaf81aab7a638', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:49:45.307556 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-d668a097-3a5a-4a3d-89eb-160682880311 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] 10.222.0.20 "GET /compute/v2.1/servers/85dc896f-7a07-400c-abc8-cc2d27bda2db" status: 200 len: 1366 microversion: 2.1 time: 0.180104 Jul 06 13:49:45.308141 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 286/576] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:49:45 2022] GET /compute/v2.1/servers/85dc896f-7a07-400c-abc8-cc2d27bda2db => generated 1366 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:49:45.810900 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-8c6719b4-dc64-4668-a6dc-c387ded66bd0 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Calling method '>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:49:45.811638 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-8c6719b4-dc64-4668-a6dc-c387ded66bd0 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] [instance: 546a77fd-66e1-4d89-afa3-58d632b09186] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:49:45.819717 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-8c6719b4-dc64-4668-a6dc-c387ded66bd0 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:49:45.820053 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-8c6719b4-dc64-4668-a6dc-c387ded66bd0 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:49:45.820755 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-8c6719b4-dc64-4668-a6dc-c387ded66bd0 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:49:45.821268 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-8c6719b4-dc64-4668-a6dc-c387ded66bd0 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:49:45.959822 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-8c6719b4-dc64-4668-a6dc-c387ded66bd0 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d7cacb73c8342579d9f990b0193487c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05df572327d54bd99595974b75898052', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:49:45.968472 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-8c6719b4-dc64-4668-a6dc-c387ded66bd0 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] 10.222.0.20 "GET /compute/v2.1/servers/546a77fd-66e1-4d89-afa3-58d632b09186" status: 200 len: 1723 microversion: 2.1 time: 0.161535 Jul 06 13:49:45.969080 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 291/577] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:49:45 2022] GET /compute/v2.1/servers/546a77fd-66e1-4d89-afa3-58d632b09186 => generated 1723 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:49:46.326447 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-c3f78b38-fe2d-4fed-b943-45249961fde7 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:49:46.327124 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-c3f78b38-fe2d-4fed-b943-45249961fde7 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] [instance: 85dc896f-7a07-400c-abc8-cc2d27bda2db] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:49:46.334351 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-c3f78b38-fe2d-4fed-b943-45249961fde7 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:49:46.334901 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-c3f78b38-fe2d-4fed-b943-45249961fde7 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:49:46.335722 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-c3f78b38-fe2d-4fed-b943-45249961fde7 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:49:46.336238 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-c3f78b38-fe2d-4fed-b943-45249961fde7 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:49:46.468935 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-c3f78b38-fe2d-4fed-b943-45249961fde7 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b572a8f465048558fc969b85b2aec5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd85f2a57a0847debf5aaf81aab7a638', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:49:46.478363 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-c3f78b38-fe2d-4fed-b943-45249961fde7 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] 10.222.0.20 "GET /compute/v2.1/servers/85dc896f-7a07-400c-abc8-cc2d27bda2db" status: 200 len: 1556 microversion: 2.1 time: 0.156053 Jul 06 13:49:46.479228 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 287/578] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:49:46 2022] GET /compute/v2.1/servers/85dc896f-7a07-400c-abc8-cc2d27bda2db => generated 1556 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:49:46.494871 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-f5f8c8d5-fa0d-4f57-8ecb-95f22629990b tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Calling method '>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:49:46.495579 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-f5f8c8d5-fa0d-4f57-8ecb-95f22629990b tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] [instance: 85dc896f-7a07-400c-abc8-cc2d27bda2db] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:49:46.501490 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-f5f8c8d5-fa0d-4f57-8ecb-95f22629990b tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:49:46.501946 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-f5f8c8d5-fa0d-4f57-8ecb-95f22629990b tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:49:46.502717 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-f5f8c8d5-fa0d-4f57-8ecb-95f22629990b tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:49:46.503159 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-f5f8c8d5-fa0d-4f57-8ecb-95f22629990b tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:49:46.597684 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-f5f8c8d5-fa0d-4f57-8ecb-95f22629990b tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] 10.222.0.20 "GET /compute/v2.1/servers/85dc896f-7a07-400c-abc8-cc2d27bda2db/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.106461 Jul 06 13:49:46.598692 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 292/579] 10.222.0.20 () {58 vars in 1274 bytes} [Wed Jul 6 13:49:46 2022] GET /compute/v2.1/servers/85dc896f-7a07-400c-abc8-cc2d27bda2db/os-interface => generated 284 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 06 13:49:46.986332 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-886866f0-2ac0-495f-b54c-61f532d4652f tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:49:46.987279 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-886866f0-2ac0-495f-b54c-61f532d4652f tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] [instance: 546a77fd-66e1-4d89-afa3-58d632b09186] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:49:46.994132 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-886866f0-2ac0-495f-b54c-61f532d4652f tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:49:46.994859 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-886866f0-2ac0-495f-b54c-61f532d4652f tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:49:46.995849 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-886866f0-2ac0-495f-b54c-61f532d4652f tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:49:46.996518 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-886866f0-2ac0-495f-b54c-61f532d4652f tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:49:47.320560 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-886866f0-2ac0-495f-b54c-61f532d4652f tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d7cacb73c8342579d9f990b0193487c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05df572327d54bd99595974b75898052', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:49:47.328717 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-886866f0-2ac0-495f-b54c-61f532d4652f tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] 10.222.0.20 "GET /compute/v2.1/servers/546a77fd-66e1-4d89-afa3-58d632b09186" status: 200 len: 1723 microversion: 2.1 time: 0.346162 Jul 06 13:49:47.329908 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 288/580] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:49:46 2022] GET /compute/v2.1/servers/546a77fd-66e1-4d89-afa3-58d632b09186 => generated 1723 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:49:47.930937 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [req-2d920b21-371e-40f5-a8b0-a734fd77c5f8 req-8f0e4077-8b22-42b1-86db-848f81270656 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "85dc896f-7a07-400c-abc8-cc2d27bda2db", "tag": "e9e85219-187e-4978-bd5f-5875bc364c0e"}]} {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 06 13:49:47.938901 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [req-2d920b21-371e-40f5-a8b0-a734fd77c5f8 req-8f0e4077-8b22-42b1-86db-848f81270656 service nova] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:49:47.939750 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [req-2d920b21-371e-40f5-a8b0-a734fd77c5f8 req-8f0e4077-8b22-42b1-86db-848f81270656 service nova] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:49:47.954624 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.compute.server_external_events [req-2d920b21-371e-40f5-a8b0-a734fd77c5f8 req-8f0e4077-8b22-42b1-86db-848f81270656 service nova] Creating event network-changed:e9e85219-187e-4978-bd5f-5875bc364c0e for instance 85dc896f-7a07-400c-abc8-cc2d27bda2db on hv-cinder-81914 Jul 06 13:49:47.960443 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [req-2d920b21-371e-40f5-a8b0-a734fd77c5f8 req-8f0e4077-8b22-42b1-86db-848f81270656 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033832 Jul 06 13:49:47.961294 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 293/581] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 6 13:49:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 06 13:49:48.349794 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-502a1fa0-8e10-4cb7-940d-01c6295d4e89 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:49:48.351002 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-502a1fa0-8e10-4cb7-940d-01c6295d4e89 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] [instance: 546a77fd-66e1-4d89-afa3-58d632b09186] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:49:48.364532 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-502a1fa0-8e10-4cb7-940d-01c6295d4e89 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:49:48.364991 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-502a1fa0-8e10-4cb7-940d-01c6295d4e89 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:49:48.365805 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-502a1fa0-8e10-4cb7-940d-01c6295d4e89 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:49:48.366243 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-502a1fa0-8e10-4cb7-940d-01c6295d4e89 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:49:48.613040 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-502a1fa0-8e10-4cb7-940d-01c6295d4e89 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d7cacb73c8342579d9f990b0193487c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05df572327d54bd99595974b75898052', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:49:48.622745 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-502a1fa0-8e10-4cb7-940d-01c6295d4e89 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] 10.222.0.20 "GET /compute/v2.1/servers/546a77fd-66e1-4d89-afa3-58d632b09186" status: 200 len: 1723 microversion: 2.1 time: 0.278567 Jul 06 13:49:48.623415 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 289/582] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:49:48 2022] GET /compute/v2.1/servers/546a77fd-66e1-4d89-afa3-58d632b09186 => generated 1723 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:49:49.641062 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-676dcbe4-dc62-4f85-8674-29c5fb1cab5e tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Calling method '>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:49:49.642561 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-676dcbe4-dc62-4f85-8674-29c5fb1cab5e tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] [instance: 546a77fd-66e1-4d89-afa3-58d632b09186] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:49:49.656044 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-676dcbe4-dc62-4f85-8674-29c5fb1cab5e tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:49:49.656499 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-676dcbe4-dc62-4f85-8674-29c5fb1cab5e tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:49:49.658320 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-676dcbe4-dc62-4f85-8674-29c5fb1cab5e tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:49:49.658733 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-676dcbe4-dc62-4f85-8674-29c5fb1cab5e tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:49:49.813680 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-676dcbe4-dc62-4f85-8674-29c5fb1cab5e tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d7cacb73c8342579d9f990b0193487c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05df572327d54bd99595974b75898052', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:49:49.822270 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-676dcbe4-dc62-4f85-8674-29c5fb1cab5e tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] 10.222.0.20 "GET /compute/v2.1/servers/546a77fd-66e1-4d89-afa3-58d632b09186" status: 200 len: 1723 microversion: 2.1 time: 0.186352 Jul 06 13:49:49.822833 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 294/583] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:49:49 2022] GET /compute/v2.1/servers/546a77fd-66e1-4d89-afa3-58d632b09186 => generated 1723 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:49:50.839652 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-56db21aa-41e0-42e6-a87a-6f842f47060a tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:49:50.840921 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-56db21aa-41e0-42e6-a87a-6f842f47060a tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] [instance: 546a77fd-66e1-4d89-afa3-58d632b09186] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:49:50.847914 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-56db21aa-41e0-42e6-a87a-6f842f47060a tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:49:50.849221 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-56db21aa-41e0-42e6-a87a-6f842f47060a tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:49:50.849893 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-56db21aa-41e0-42e6-a87a-6f842f47060a tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:49:50.850272 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-56db21aa-41e0-42e6-a87a-6f842f47060a tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:49:50.977508 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-56db21aa-41e0-42e6-a87a-6f842f47060a tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d7cacb73c8342579d9f990b0193487c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05df572327d54bd99595974b75898052', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:49:50.985577 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-56db21aa-41e0-42e6-a87a-6f842f47060a tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] 10.222.0.20 "GET /compute/v2.1/servers/546a77fd-66e1-4d89-afa3-58d632b09186" status: 200 len: 1723 microversion: 2.1 time: 0.149801 Jul 06 13:49:50.986133 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 290/584] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:49:50 2022] GET /compute/v2.1/servers/546a77fd-66e1-4d89-afa3-58d632b09186 => generated 1723 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:49:52.002685 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-283479e2-47e4-4614-81a5-d4ae177e2ef1 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Calling method '>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:49:52.003351 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-283479e2-47e4-4614-81a5-d4ae177e2ef1 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] [instance: 546a77fd-66e1-4d89-afa3-58d632b09186] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:49:52.010330 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-283479e2-47e4-4614-81a5-d4ae177e2ef1 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:49:52.010781 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-283479e2-47e4-4614-81a5-d4ae177e2ef1 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:49:52.011548 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-283479e2-47e4-4614-81a5-d4ae177e2ef1 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:49:52.011988 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-283479e2-47e4-4614-81a5-d4ae177e2ef1 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:49:52.143383 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-283479e2-47e4-4614-81a5-d4ae177e2ef1 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d7cacb73c8342579d9f990b0193487c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05df572327d54bd99595974b75898052', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:49:52.151966 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-283479e2-47e4-4614-81a5-d4ae177e2ef1 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] 10.222.0.20 "GET /compute/v2.1/servers/546a77fd-66e1-4d89-afa3-58d632b09186" status: 200 len: 1723 microversion: 2.1 time: 0.153147 Jul 06 13:49:52.152541 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 295/585] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:49:51 2022] GET /compute/v2.1/servers/546a77fd-66e1-4d89-afa3-58d632b09186 => generated 1723 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:49:53.169673 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-ec1215ee-d398-49ea-b9e5-9c6e814b329d tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:49:53.170277 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-ec1215ee-d398-49ea-b9e5-9c6e814b329d tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] [instance: 546a77fd-66e1-4d89-afa3-58d632b09186] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:49:53.177197 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-ec1215ee-d398-49ea-b9e5-9c6e814b329d tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:49:53.177643 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-ec1215ee-d398-49ea-b9e5-9c6e814b329d tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:49:53.178396 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-ec1215ee-d398-49ea-b9e5-9c6e814b329d tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:49:53.178825 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-ec1215ee-d398-49ea-b9e5-9c6e814b329d tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:49:53.304532 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-ec1215ee-d398-49ea-b9e5-9c6e814b329d tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d7cacb73c8342579d9f990b0193487c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05df572327d54bd99595974b75898052', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:49:53.312482 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-ec1215ee-d398-49ea-b9e5-9c6e814b329d tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] 10.222.0.20 "GET /compute/v2.1/servers/546a77fd-66e1-4d89-afa3-58d632b09186" status: 200 len: 1723 microversion: 2.1 time: 0.146649 Jul 06 13:49:53.313055 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 291/586] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:49:53 2022] GET /compute/v2.1/servers/546a77fd-66e1-4d89-afa3-58d632b09186 => generated 1723 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:49:54.329695 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-7e7f9f49-1d41-43b8-8dbc-5d16b1e7158b tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Calling method '>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:49:54.330311 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-7e7f9f49-1d41-43b8-8dbc-5d16b1e7158b tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] [instance: 546a77fd-66e1-4d89-afa3-58d632b09186] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:49:54.336924 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-7e7f9f49-1d41-43b8-8dbc-5d16b1e7158b tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:49:54.337408 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-7e7f9f49-1d41-43b8-8dbc-5d16b1e7158b tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:49:54.338174 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-7e7f9f49-1d41-43b8-8dbc-5d16b1e7158b tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:49:54.338657 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-7e7f9f49-1d41-43b8-8dbc-5d16b1e7158b tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:49:54.468788 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-7e7f9f49-1d41-43b8-8dbc-5d16b1e7158b tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d7cacb73c8342579d9f990b0193487c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05df572327d54bd99595974b75898052', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:49:54.477514 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-7e7f9f49-1d41-43b8-8dbc-5d16b1e7158b tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] 10.222.0.20 "GET /compute/v2.1/servers/546a77fd-66e1-4d89-afa3-58d632b09186" status: 200 len: 1723 microversion: 2.1 time: 0.151747 Jul 06 13:49:54.478099 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 296/587] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:49:54 2022] GET /compute/v2.1/servers/546a77fd-66e1-4d89-afa3-58d632b09186 => generated 1723 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:49:55.494862 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-14758cd2-2ae7-439b-8a37-27a387de0341 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:49:55.495598 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-14758cd2-2ae7-439b-8a37-27a387de0341 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] [instance: 546a77fd-66e1-4d89-afa3-58d632b09186] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:49:55.502103 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-14758cd2-2ae7-439b-8a37-27a387de0341 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:49:55.502547 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-14758cd2-2ae7-439b-8a37-27a387de0341 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:49:55.503550 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-14758cd2-2ae7-439b-8a37-27a387de0341 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:49:55.504167 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-14758cd2-2ae7-439b-8a37-27a387de0341 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:49:55.652418 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-14758cd2-2ae7-439b-8a37-27a387de0341 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d7cacb73c8342579d9f990b0193487c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05df572327d54bd99595974b75898052', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:49:55.661587 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-14758cd2-2ae7-439b-8a37-27a387de0341 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] 10.222.0.20 "GET /compute/v2.1/servers/546a77fd-66e1-4d89-afa3-58d632b09186" status: 200 len: 1723 microversion: 2.1 time: 0.170555 Jul 06 13:49:55.662317 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 292/588] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:49:55 2022] GET /compute/v2.1/servers/546a77fd-66e1-4d89-afa3-58d632b09186 => generated 1723 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:49:56.679850 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-a7efe73e-b5e2-416e-8dcb-bee36745125b tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Calling method '>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:49:56.681148 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-a7efe73e-b5e2-416e-8dcb-bee36745125b tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] [instance: 546a77fd-66e1-4d89-afa3-58d632b09186] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:49:56.683797 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG dbcounter [-] [124368] Writing DB stats nova_api:SELECT=46,nova_api:INSERT=3 {{(pid=124368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:49:56.693724 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-a7efe73e-b5e2-416e-8dcb-bee36745125b tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:49:56.693724 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-a7efe73e-b5e2-416e-8dcb-bee36745125b tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:49:56.693724 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-a7efe73e-b5e2-416e-8dcb-bee36745125b tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:49:56.693724 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-a7efe73e-b5e2-416e-8dcb-bee36745125b tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:49:56.710493 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG dbcounter [-] [124368] Writing DB stats nova_cell1:SELECT=88,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:49:56.833155 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-a7efe73e-b5e2-416e-8dcb-bee36745125b tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d7cacb73c8342579d9f990b0193487c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05df572327d54bd99595974b75898052', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:49:56.840891 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-a7efe73e-b5e2-416e-8dcb-bee36745125b tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] 10.222.0.20 "GET /compute/v2.1/servers/546a77fd-66e1-4d89-afa3-58d632b09186" status: 200 len: 1723 microversion: 2.1 time: 0.164890 Jul 06 13:49:56.841482 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 297/589] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:49:56 2022] GET /compute/v2.1/servers/546a77fd-66e1-4d89-afa3-58d632b09186 => generated 1723 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:49:57.858452 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-0f993f5c-f636-4839-a510-bef9b98f4cb7 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:49:57.859095 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-0f993f5c-f636-4839-a510-bef9b98f4cb7 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] [instance: 546a77fd-66e1-4d89-afa3-58d632b09186] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:49:57.867654 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-0f993f5c-f636-4839-a510-bef9b98f4cb7 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:49:57.868105 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-0f993f5c-f636-4839-a510-bef9b98f4cb7 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:49:57.868868 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-0f993f5c-f636-4839-a510-bef9b98f4cb7 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:49:57.869345 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-0f993f5c-f636-4839-a510-bef9b98f4cb7 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:49:57.999746 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-0f993f5c-f636-4839-a510-bef9b98f4cb7 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d7cacb73c8342579d9f990b0193487c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05df572327d54bd99595974b75898052', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:49:58.002048 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG dbcounter [-] [124367] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:49:58.009701 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-0f993f5c-f636-4839-a510-bef9b98f4cb7 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] 10.222.0.20 "GET /compute/v2.1/servers/546a77fd-66e1-4d89-afa3-58d632b09186" status: 200 len: 1723 microversion: 2.1 time: 0.155017 Jul 06 13:49:58.010197 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 293/590] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:49:57 2022] GET /compute/v2.1/servers/546a77fd-66e1-4d89-afa3-58d632b09186 => generated 1723 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:49:59.026473 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-ed4ef0c7-2ebf-41aa-85a4-49d6860b2d7f tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Calling method '>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:49:59.027359 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-ed4ef0c7-2ebf-41aa-85a4-49d6860b2d7f tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] [instance: 546a77fd-66e1-4d89-afa3-58d632b09186] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:49:59.038228 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-ed4ef0c7-2ebf-41aa-85a4-49d6860b2d7f tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:49:59.038680 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-ed4ef0c7-2ebf-41aa-85a4-49d6860b2d7f tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:49:59.039483 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-ed4ef0c7-2ebf-41aa-85a4-49d6860b2d7f tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:49:59.039915 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-ed4ef0c7-2ebf-41aa-85a4-49d6860b2d7f tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:49:59.171467 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-ed4ef0c7-2ebf-41aa-85a4-49d6860b2d7f tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d7cacb73c8342579d9f990b0193487c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05df572327d54bd99595974b75898052', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:49:59.179929 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-ed4ef0c7-2ebf-41aa-85a4-49d6860b2d7f tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] 10.222.0.20 "GET /compute/v2.1/servers/546a77fd-66e1-4d89-afa3-58d632b09186" status: 200 len: 1723 microversion: 2.1 time: 0.157333 Jul 06 13:49:59.180494 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 298/591] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:49:59 2022] GET /compute/v2.1/servers/546a77fd-66e1-4d89-afa3-58d632b09186 => generated 1723 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:50:00.197463 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-bc99a624-2c6a-4314-af8e-c5de33313fea tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:50:00.198072 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-bc99a624-2c6a-4314-af8e-c5de33313fea tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] [instance: 546a77fd-66e1-4d89-afa3-58d632b09186] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:50:00.200488 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG dbcounter [-] [124367] Writing DB stats nova_api:SELECT=48,nova_api:INSERT=1 {{(pid=124367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:50:00.207389 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-bc99a624-2c6a-4314-af8e-c5de33313fea tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:50:00.207846 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-bc99a624-2c6a-4314-af8e-c5de33313fea tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:50:00.208660 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-bc99a624-2c6a-4314-af8e-c5de33313fea tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:50:00.209138 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-bc99a624-2c6a-4314-af8e-c5de33313fea tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:50:00.346329 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-bc99a624-2c6a-4314-af8e-c5de33313fea tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d7cacb73c8342579d9f990b0193487c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05df572327d54bd99595974b75898052', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:50:00.354534 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-bc99a624-2c6a-4314-af8e-c5de33313fea tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] 10.222.0.20 "GET /compute/v2.1/servers/546a77fd-66e1-4d89-afa3-58d632b09186" status: 200 len: 1723 microversion: 2.1 time: 0.160858 Jul 06 13:50:00.355011 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 294/592] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:50:00 2022] GET /compute/v2.1/servers/546a77fd-66e1-4d89-afa3-58d632b09186 => generated 1723 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:50:01.371615 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-a7fddec6-4de2-4171-ab3e-f67ad6dd2047 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Calling method '>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:50:01.372219 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-a7fddec6-4de2-4171-ab3e-f67ad6dd2047 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] [instance: 546a77fd-66e1-4d89-afa3-58d632b09186] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:50:01.379381 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-a7fddec6-4de2-4171-ab3e-f67ad6dd2047 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:50:01.379833 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-a7fddec6-4de2-4171-ab3e-f67ad6dd2047 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:50:01.380623 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-a7fddec6-4de2-4171-ab3e-f67ad6dd2047 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:50:01.381081 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-a7fddec6-4de2-4171-ab3e-f67ad6dd2047 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:50:01.508429 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-a7fddec6-4de2-4171-ab3e-f67ad6dd2047 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d7cacb73c8342579d9f990b0193487c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05df572327d54bd99595974b75898052', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:50:01.516351 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-a7fddec6-4de2-4171-ab3e-f67ad6dd2047 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] 10.222.0.20 "GET /compute/v2.1/servers/546a77fd-66e1-4d89-afa3-58d632b09186" status: 200 len: 1723 microversion: 2.1 time: 0.148536 Jul 06 13:50:01.516857 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 299/593] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:50:01 2022] GET /compute/v2.1/servers/546a77fd-66e1-4d89-afa3-58d632b09186 => generated 1723 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:50:02.535031 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-c25abef5-e92c-4294-a136-9fd1c94de8c1 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:50:02.535555 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-c25abef5-e92c-4294-a136-9fd1c94de8c1 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] [instance: 546a77fd-66e1-4d89-afa3-58d632b09186] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:50:02.542101 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-c25abef5-e92c-4294-a136-9fd1c94de8c1 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:50:02.542576 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-c25abef5-e92c-4294-a136-9fd1c94de8c1 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:50:02.543365 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-c25abef5-e92c-4294-a136-9fd1c94de8c1 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:50:02.543798 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-c25abef5-e92c-4294-a136-9fd1c94de8c1 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:50:02.675918 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-c25abef5-e92c-4294-a136-9fd1c94de8c1 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d7cacb73c8342579d9f990b0193487c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05df572327d54bd99595974b75898052', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:50:02.683896 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-c25abef5-e92c-4294-a136-9fd1c94de8c1 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] 10.222.0.20 "GET /compute/v2.1/servers/546a77fd-66e1-4d89-afa3-58d632b09186" status: 200 len: 1723 microversion: 2.1 time: 0.153143 Jul 06 13:50:02.684459 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 295/594] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:50:02 2022] GET /compute/v2.1/servers/546a77fd-66e1-4d89-afa3-58d632b09186 => generated 1723 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:50:03.701225 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-5e356359-3359-4a1d-a95b-c8387f94ca65 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Calling method '>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:50:03.701768 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-5e356359-3359-4a1d-a95b-c8387f94ca65 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] [instance: 546a77fd-66e1-4d89-afa3-58d632b09186] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:50:03.709117 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-5e356359-3359-4a1d-a95b-c8387f94ca65 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:50:03.709568 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-5e356359-3359-4a1d-a95b-c8387f94ca65 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:50:03.710332 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-5e356359-3359-4a1d-a95b-c8387f94ca65 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:50:03.710766 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-5e356359-3359-4a1d-a95b-c8387f94ca65 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:50:03.841026 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-5e356359-3359-4a1d-a95b-c8387f94ca65 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d7cacb73c8342579d9f990b0193487c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05df572327d54bd99595974b75898052', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:50:03.848899 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-5e356359-3359-4a1d-a95b-c8387f94ca65 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] 10.222.0.20 "GET /compute/v2.1/servers/546a77fd-66e1-4d89-afa3-58d632b09186" status: 200 len: 1723 microversion: 2.1 time: 0.151595 Jul 06 13:50:03.849490 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 300/595] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:50:03 2022] GET /compute/v2.1/servers/546a77fd-66e1-4d89-afa3-58d632b09186 => generated 1723 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:50:04.866861 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-5ec61fdf-c250-40df-be80-0ad95b4bca38 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:50:04.867383 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-5ec61fdf-c250-40df-be80-0ad95b4bca38 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] [instance: 546a77fd-66e1-4d89-afa3-58d632b09186] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:50:04.873959 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-5ec61fdf-c250-40df-be80-0ad95b4bca38 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:50:04.874411 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-5ec61fdf-c250-40df-be80-0ad95b4bca38 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:50:04.875171 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-5ec61fdf-c250-40df-be80-0ad95b4bca38 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:50:04.875608 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-5ec61fdf-c250-40df-be80-0ad95b4bca38 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:50:05.002068 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-5ec61fdf-c250-40df-be80-0ad95b4bca38 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d7cacb73c8342579d9f990b0193487c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05df572327d54bd99595974b75898052', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:50:05.010575 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-5ec61fdf-c250-40df-be80-0ad95b4bca38 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] 10.222.0.20 "GET /compute/v2.1/servers/546a77fd-66e1-4d89-afa3-58d632b09186" status: 200 len: 1723 microversion: 2.1 time: 0.148696 Jul 06 13:50:05.011125 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 296/596] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:50:04 2022] GET /compute/v2.1/servers/546a77fd-66e1-4d89-afa3-58d632b09186 => generated 1723 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:50:06.027526 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-39d92973-be37-4ae3-912c-c9177a431c42 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Calling method '>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:50:06.028139 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-39d92973-be37-4ae3-912c-c9177a431c42 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] [instance: 546a77fd-66e1-4d89-afa3-58d632b09186] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:50:06.034581 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-39d92973-be37-4ae3-912c-c9177a431c42 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:50:06.035028 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-39d92973-be37-4ae3-912c-c9177a431c42 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:50:06.035794 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-39d92973-be37-4ae3-912c-c9177a431c42 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:50:06.036228 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-39d92973-be37-4ae3-912c-c9177a431c42 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:50:06.168660 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-39d92973-be37-4ae3-912c-c9177a431c42 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d7cacb73c8342579d9f990b0193487c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05df572327d54bd99595974b75898052', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:50:06.176832 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-39d92973-be37-4ae3-912c-c9177a431c42 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] 10.222.0.20 "GET /compute/v2.1/servers/546a77fd-66e1-4d89-afa3-58d632b09186" status: 200 len: 1723 microversion: 2.1 time: 0.153112 Jul 06 13:50:06.177424 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 301/597] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:50:06 2022] GET /compute/v2.1/servers/546a77fd-66e1-4d89-afa3-58d632b09186 => generated 1723 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:50:07.194798 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-fb02bf1c-700c-41ce-b046-a21a2e700e89 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:50:07.195389 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-fb02bf1c-700c-41ce-b046-a21a2e700e89 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] [instance: 546a77fd-66e1-4d89-afa3-58d632b09186] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:50:07.201811 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-fb02bf1c-700c-41ce-b046-a21a2e700e89 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:50:07.202262 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-fb02bf1c-700c-41ce-b046-a21a2e700e89 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:50:07.203021 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-fb02bf1c-700c-41ce-b046-a21a2e700e89 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:50:07.203453 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-fb02bf1c-700c-41ce-b046-a21a2e700e89 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:50:07.332656 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-fb02bf1c-700c-41ce-b046-a21a2e700e89 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d7cacb73c8342579d9f990b0193487c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05df572327d54bd99595974b75898052', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:50:07.340484 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-fb02bf1c-700c-41ce-b046-a21a2e700e89 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] 10.222.0.20 "GET /compute/v2.1/servers/546a77fd-66e1-4d89-afa3-58d632b09186" status: 200 len: 1723 microversion: 2.1 time: 0.150550 Jul 06 13:50:07.341058 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 297/598] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:50:07 2022] GET /compute/v2.1/servers/546a77fd-66e1-4d89-afa3-58d632b09186 => generated 1723 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:50:08.357351 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-d191964c-0f45-4b06-9adc-ea38604b7288 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Calling method '>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:50:08.357958 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-d191964c-0f45-4b06-9adc-ea38604b7288 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] [instance: 546a77fd-66e1-4d89-afa3-58d632b09186] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:50:08.364643 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-d191964c-0f45-4b06-9adc-ea38604b7288 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:50:08.365124 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-d191964c-0f45-4b06-9adc-ea38604b7288 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:50:08.365883 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-d191964c-0f45-4b06-9adc-ea38604b7288 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:50:08.366316 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-d191964c-0f45-4b06-9adc-ea38604b7288 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:50:08.495431 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-d191964c-0f45-4b06-9adc-ea38604b7288 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d7cacb73c8342579d9f990b0193487c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05df572327d54bd99595974b75898052', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:50:08.505680 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-d191964c-0f45-4b06-9adc-ea38604b7288 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] 10.222.0.20 "GET /compute/v2.1/servers/546a77fd-66e1-4d89-afa3-58d632b09186" status: 200 len: 1723 microversion: 2.1 time: 0.152023 Jul 06 13:50:08.506257 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 302/599] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:50:08 2022] GET /compute/v2.1/servers/546a77fd-66e1-4d89-afa3-58d632b09186 => generated 1723 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:50:09.522560 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-fda572ab-371f-4210-8980-b2516899ff63 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:50:09.523161 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-fda572ab-371f-4210-8980-b2516899ff63 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] [instance: 546a77fd-66e1-4d89-afa3-58d632b09186] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:50:09.529592 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-fda572ab-371f-4210-8980-b2516899ff63 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:50:09.530035 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-fda572ab-371f-4210-8980-b2516899ff63 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:50:09.530784 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-fda572ab-371f-4210-8980-b2516899ff63 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:50:09.531212 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-fda572ab-371f-4210-8980-b2516899ff63 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:50:09.661619 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-fda572ab-371f-4210-8980-b2516899ff63 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d7cacb73c8342579d9f990b0193487c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05df572327d54bd99595974b75898052', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:50:09.669651 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-fda572ab-371f-4210-8980-b2516899ff63 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] 10.222.0.20 "GET /compute/v2.1/servers/546a77fd-66e1-4d89-afa3-58d632b09186" status: 200 len: 1723 microversion: 2.1 time: 0.151621 Jul 06 13:50:09.670208 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 298/600] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:50:09 2022] GET /compute/v2.1/servers/546a77fd-66e1-4d89-afa3-58d632b09186 => generated 1723 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 06 13:50:10.687354 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-e7aec461-e6fd-4782-a429-cf4940897cb3 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Calling method '>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:50:10.687974 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-e7aec461-e6fd-4782-a429-cf4940897cb3 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] [instance: 546a77fd-66e1-4d89-afa3-58d632b09186] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:50:10.694625 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-e7aec461-e6fd-4782-a429-cf4940897cb3 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:50:10.695080 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-e7aec461-e6fd-4782-a429-cf4940897cb3 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:50:10.695854 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-e7aec461-e6fd-4782-a429-cf4940897cb3 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:50:10.696298 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-e7aec461-e6fd-4782-a429-cf4940897cb3 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:50:10.825821 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-e7aec461-e6fd-4782-a429-cf4940897cb3 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d7cacb73c8342579d9f990b0193487c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05df572327d54bd99595974b75898052', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:50:10.833723 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-e7aec461-e6fd-4782-a429-cf4940897cb3 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] 10.222.0.20 "GET /compute/v2.1/servers/546a77fd-66e1-4d89-afa3-58d632b09186" status: 200 len: 1700 microversion: 2.1 time: 0.150292 Jul 06 13:50:10.834283 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 303/601] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:50:10 2022] GET /compute/v2.1/servers/546a77fd-66e1-4d89-afa3-58d632b09186 => generated 1700 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:50:10.850447 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-369c2044-a666-4465-805a-79f523d7baa7 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 06 13:50:10.856916 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-369c2044-a666-4465-805a-79f523d7baa7 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:50:10.857387 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-369c2044-a666-4465-805a-79f523d7baa7 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:50:10.878938 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-369c2044-a666-4465-805a-79f523d7baa7 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] [instance: 546a77fd-66e1-4d89-afa3-58d632b09186] Going to try to start instance {{(pid=124367) start /opt/stack/nova/nova/compute/api.py:2730}} Jul 06 13:50:10.922756 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-369c2044-a666-4465-805a-79f523d7baa7 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] 10.222.0.20 "POST /compute/v2.1/servers/546a77fd-66e1-4d89-afa3-58d632b09186/action" status: 202 len: 0 microversion: 2.1 time: 0.076552 Jul 06 13:50:10.923265 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 299/602] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Jul 6 13:50:10 2022] POST /compute/v2.1/servers/546a77fd-66e1-4d89-afa3-58d632b09186/action => generated 0 bytes in 78 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 06 13:50:10.931834 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-07b9a712-e445-4f8d-a1d2-cfa13900c865 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Calling method '>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:50:10.932477 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-07b9a712-e445-4f8d-a1d2-cfa13900c865 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] [instance: 546a77fd-66e1-4d89-afa3-58d632b09186] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:50:10.938564 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-07b9a712-e445-4f8d-a1d2-cfa13900c865 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:50:10.939147 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-07b9a712-e445-4f8d-a1d2-cfa13900c865 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:50:10.939995 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-07b9a712-e445-4f8d-a1d2-cfa13900c865 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:50:10.940433 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-07b9a712-e445-4f8d-a1d2-cfa13900c865 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:50:11.071205 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-07b9a712-e445-4f8d-a1d2-cfa13900c865 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d7cacb73c8342579d9f990b0193487c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05df572327d54bd99595974b75898052', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:50:11.079775 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-07b9a712-e445-4f8d-a1d2-cfa13900c865 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] 10.222.0.20 "GET /compute/v2.1/servers/546a77fd-66e1-4d89-afa3-58d632b09186" status: 200 len: 1709 microversion: 2.1 time: 0.151819 Jul 06 13:50:11.080360 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 304/603] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:50:10 2022] GET /compute/v2.1/servers/546a77fd-66e1-4d89-afa3-58d632b09186 => generated 1709 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:50:12.099733 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-56d0404e-d96e-4ecd-9b05-f58b37f15075 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:50:12.100731 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-56d0404e-d96e-4ecd-9b05-f58b37f15075 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] [instance: 546a77fd-66e1-4d89-afa3-58d632b09186] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:50:12.107445 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-56d0404e-d96e-4ecd-9b05-f58b37f15075 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:50:12.108021 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-56d0404e-d96e-4ecd-9b05-f58b37f15075 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:50:12.108847 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-56d0404e-d96e-4ecd-9b05-f58b37f15075 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:50:12.109351 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-56d0404e-d96e-4ecd-9b05-f58b37f15075 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:50:12.241506 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-56d0404e-d96e-4ecd-9b05-f58b37f15075 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d7cacb73c8342579d9f990b0193487c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05df572327d54bd99595974b75898052', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:50:12.249612 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-56d0404e-d96e-4ecd-9b05-f58b37f15075 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] 10.222.0.20 "GET /compute/v2.1/servers/546a77fd-66e1-4d89-afa3-58d632b09186" status: 200 len: 1709 microversion: 2.1 time: 0.155888 Jul 06 13:50:12.250175 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 300/604] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:50:12 2022] GET /compute/v2.1/servers/546a77fd-66e1-4d89-afa3-58d632b09186 => generated 1709 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:50:13.267234 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-3ff45e65-469d-47df-9321-ef46feeecaa3 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Calling method '>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:50:13.267841 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-3ff45e65-469d-47df-9321-ef46feeecaa3 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] [instance: 546a77fd-66e1-4d89-afa3-58d632b09186] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:50:13.274939 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-3ff45e65-469d-47df-9321-ef46feeecaa3 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:50:13.275386 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-3ff45e65-469d-47df-9321-ef46feeecaa3 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:50:13.276139 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-3ff45e65-469d-47df-9321-ef46feeecaa3 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:50:13.276601 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-3ff45e65-469d-47df-9321-ef46feeecaa3 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:50:13.406534 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-3ff45e65-469d-47df-9321-ef46feeecaa3 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d7cacb73c8342579d9f990b0193487c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05df572327d54bd99595974b75898052', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:50:13.415205 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-3ff45e65-469d-47df-9321-ef46feeecaa3 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] 10.222.0.20 "GET /compute/v2.1/servers/546a77fd-66e1-4d89-afa3-58d632b09186" status: 200 len: 1713 microversion: 2.1 time: 0.151772 Jul 06 13:50:13.415776 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 305/605] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:50:13 2022] GET /compute/v2.1/servers/546a77fd-66e1-4d89-afa3-58d632b09186 => generated 1713 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:50:24.745537 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG dbcounter [-] [124367] Writing DB stats nova_api:SELECT=13 {{(pid=124367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:50:24.746418 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG dbcounter [-] [124367] Writing DB stats nova_cell1:SELECT=47,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:50:24.930670 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-c7f8d843-88f6-4cd7-91c3-564824ff00c1 tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Action: 'create', calling method: .version_select at 0x7ffbc431db80>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1950493681", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLlHvUr8GRVcjVWo/YHyy9JgqZ2xGEuUshoL92JRYORB2tSz3uen33s8qBMMwK9/ZCsk6BDVoH7pH2HheC+Lhca+maTrPiBRihSeu0GILwEvJ7e26ckMzIAZKMmd/Ek0CA=="}} {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 06 13:50:24.944248 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.quota [None req-c7f8d843-88f6-4cd7-91c3-564824ff00c1 tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Getting quotas for project 7bf864bb1764452e8e3a6f0d5929da9f. Resources: {'key_pairs'} {{(pid=124367) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 06 13:50:24.948033 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.quota [None req-c7f8d843-88f6-4cd7-91c3-564824ff00c1 tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Getting quotas for user 32a8191b1c184c75b428579ace2da61c and project 7bf864bb1764452e8e3a6f0d5929da9f. Resources: {'key_pairs'} {{(pid=124367) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 06 13:50:24.971094 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-c7f8d843-88f6-4cd7-91c3-564824ff00c1 tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.232069 Jul 06 13:50:24.972443 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 301/606] 10.222.0.20 () {60 vars in 1158 bytes} [Wed Jul 6 13:50:24 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 06 13:50:26.896091 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 06 13:50:26.897208 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: Wed Jul 6 13:50:26 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 06 13:50:50.569012 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-c71fcb7e-29b4-4db3-aae2-49be9361ab38 tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 06 13:50:50.569620 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-c71fcb7e-29b4-4db3-aae2-49be9361ab38 tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] [instance: 0a925141-db5f-4cae-bc6c-8ca4930adf73] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:50:50.571720 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG dbcounter [-] [124368] Writing DB stats nova_api:SELECT=17 {{(pid=124368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:50:50.572361 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG dbcounter [-] [124368] Writing DB stats nova_cell1:SELECT=53 {{(pid=124368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:50:50.578481 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-c71fcb7e-29b4-4db3-aae2-49be9361ab38 tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:50:50.578481 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-c71fcb7e-29b4-4db3-aae2-49be9361ab38 tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:50:50.579250 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-c71fcb7e-29b4-4db3-aae2-49be9361ab38 tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:50:50.579774 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-c71fcb7e-29b4-4db3-aae2-49be9361ab38 tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:50:50.603946 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.objects.instance [None req-c71fcb7e-29b4-4db3-aae2-49be9361ab38 tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] Lazy-loading 'flavor' on Instance uuid 0a925141-db5f-4cae-bc6c-8ca4930adf73 {{(pid=124368) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 06 13:50:50.675420 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-c71fcb7e-29b4-4db3-aae2-49be9361ab38 tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] 10.222.0.20 "POST /compute/v2.1/servers/0a925141-db5f-4cae-bc6c-8ca4930adf73/action" status: 202 len: 0 microversion: 2.1 time: 0.109854 Jul 06 13:50:50.676000 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 306/607] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Jul 6 13:50:50 2022] POST /compute/v2.1/servers/0a925141-db5f-4cae-bc6c-8ca4930adf73/action => generated 0 bytes in 112 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 06 13:50:50.682633 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG dbcounter [-] [124367] Writing DB stats nova_cell0:SELECT=4 {{(pid=124367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:50:50.683399 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG dbcounter [-] [124367] Writing DB stats nova_api:SELECT=11,nova_api:INSERT=1 {{(pid=124367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:50:50.688196 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-942b0264-ea54-44c4-8b86-d0f68cb76c4f tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:50:50.688810 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-942b0264-ea54-44c4-8b86-d0f68cb76c4f tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] [instance: 0a925141-db5f-4cae-bc6c-8ca4930adf73] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:50:50.699926 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-942b0264-ea54-44c4-8b86-d0f68cb76c4f tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:50:50.700371 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-942b0264-ea54-44c4-8b86-d0f68cb76c4f tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:50:50.701165 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-942b0264-ea54-44c4-8b86-d0f68cb76c4f tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:50:50.701594 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-942b0264-ea54-44c4-8b86-d0f68cb76c4f tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:50:50.934783 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-942b0264-ea54-44c4-8b86-d0f68cb76c4f tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53d00e4198e240c8a5c2fbe8bd241b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1727f66e37f94cc6971b574c8635e078', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:50:50.945779 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-942b0264-ea54-44c4-8b86-d0f68cb76c4f tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] 10.222.0.20 "GET /compute/v2.1/servers/0a925141-db5f-4cae-bc6c-8ca4930adf73" status: 200 len: 1566 microversion: 2.1 time: 0.264838 Jul 06 13:50:50.946361 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 302/608] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:50:50 2022] GET /compute/v2.1/servers/0a925141-db5f-4cae-bc6c-8ca4930adf73 => generated 1566 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:50:51.723377 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-860b4a26-b70a-4ea9-b982-73a21bed09aa tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-234823876", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1950493681", "security_groups": [{"name": "tempest-secgroup-smoke-113773701"}], "block_device_mapping_v2": [{"uuid": "732d4d00-624a-4902-b655-7ce2bb16af77", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "6522e807-4f7f-4722-945c-07724b4eff64"}]}} {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 06 13:50:51.929989 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.network.neutron [None req-860b4a26-b70a-4ea9-b982-73a21bed09aa tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] validate_networks() for [('6522e807-4f7f-4722-945c-07724b4eff64', None, None, None, None, None)] {{(pid=124368) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 06 13:50:51.963426 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-01e8e47a-14da-4dbe-930d-1bae7b912f22 tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:50:51.964154 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-01e8e47a-14da-4dbe-930d-1bae7b912f22 tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] [instance: 0a925141-db5f-4cae-bc6c-8ca4930adf73] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:50:51.970592 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-01e8e47a-14da-4dbe-930d-1bae7b912f22 tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:50:51.971544 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-01e8e47a-14da-4dbe-930d-1bae7b912f22 tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:50:51.972308 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-01e8e47a-14da-4dbe-930d-1bae7b912f22 tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:50:51.972736 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-01e8e47a-14da-4dbe-930d-1bae7b912f22 tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:50:52.105616 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-01e8e47a-14da-4dbe-930d-1bae7b912f22 tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53d00e4198e240c8a5c2fbe8bd241b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1727f66e37f94cc6971b574c8635e078', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:50:52.114452 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-01e8e47a-14da-4dbe-930d-1bae7b912f22 tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] 10.222.0.20 "GET /compute/v2.1/servers/0a925141-db5f-4cae-bc6c-8ca4930adf73" status: 200 len: 1566 microversion: 2.1 time: 0.154819 Jul 06 13:50:52.115017 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 303/609] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:50:51 2022] GET /compute/v2.1/servers/0a925141-db5f-4cae-bc6c-8ca4930adf73 => generated 1566 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 06 13:50:52.352536 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.virt.hardware [None req-860b4a26-b70a-4ea9-b982-73a21bed09aa tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Flavor limits 0:0:0 {{(pid=124368) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 06 13:50:52.353043 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.virt.hardware [None req-860b4a26-b70a-4ea9-b982-73a21bed09aa tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Image limits 0:0:0 {{(pid=124368) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 06 13:50:52.353489 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.virt.hardware [None req-860b4a26-b70a-4ea9-b982-73a21bed09aa tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Flavor pref 0:0:0 {{(pid=124368) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 06 13:50:52.353900 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.virt.hardware [None req-860b4a26-b70a-4ea9-b982-73a21bed09aa tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Image pref 0:0:0 {{(pid=124368) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 06 13:50:52.354316 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.virt.hardware [None req-860b4a26-b70a-4ea9-b982-73a21bed09aa tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124368) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 06 13:50:52.363600 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-860b4a26-b70a-4ea9-b982-73a21bed09aa tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:50:52.364043 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-860b4a26-b70a-4ea9-b982-73a21bed09aa tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:50:52.364831 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-860b4a26-b70a-4ea9-b982-73a21bed09aa tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:50:52.365295 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-860b4a26-b70a-4ea9-b982-73a21bed09aa tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:50:52.381734 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.quota [None req-860b4a26-b70a-4ea9-b982-73a21bed09aa tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Getting quotas for project 7bf864bb1764452e8e3a6f0d5929da9f. Resources: {'instances', 'cores', 'ram'} {{(pid=124368) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 06 13:50:52.385569 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.quota [None req-860b4a26-b70a-4ea9-b982-73a21bed09aa tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Getting quotas for user 32a8191b1c184c75b428579ace2da61c and project 7bf864bb1764452e8e3a6f0d5929da9f. Resources: {'instances', 'cores', 'ram'} {{(pid=124368) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 06 13:50:52.441363 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-860b4a26-b70a-4ea9-b982-73a21bed09aa tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Going to run 1 instances... {{(pid=124368) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 06 13:50:52.443494 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-860b4a26-b70a-4ea9-b982-73a21bed09aa tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] [instance: ee2271a7-8fab-4455-9c3b-32159f33ad03] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='732d4d00-624a-4902-b655-7ce2bb16af77',volume_size=None,volume_type=None)] {{(pid=124368) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 06 13:50:52.566666 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-860b4a26-b70a-4ea9-b982-73a21bed09aa tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.848394 Jul 06 13:50:52.567321 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 307/610] 10.222.0.20 () {60 vars in 1146 bytes} [Wed Jul 6 13:50:51 2022] POST /compute/v2.1/servers => generated 405 bytes in 850 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 06 13:50:52.577173 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-815c6523-b359-4704-889f-f576d53f3a3b tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:50:52.577772 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-815c6523-b359-4704-889f-f576d53f3a3b tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] [instance: ee2271a7-8fab-4455-9c3b-32159f33ad03] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:50:52.631314 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-815c6523-b359-4704-889f-f576d53f3a3b tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32a8191b1c184c75b428579ace2da61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bf864bb1764452e8e3a6f0d5929da9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:50:52.637945 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-815c6523-b359-4704-889f-f576d53f3a3b tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] 10.222.0.20 "GET /compute/v2.1/servers/ee2271a7-8fab-4455-9c3b-32159f33ad03" status: 200 len: 1094 microversion: 2.1 time: 0.064669 Jul 06 13:50:52.638503 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 304/611] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:50:52 2022] GET /compute/v2.1/servers/ee2271a7-8fab-4455-9c3b-32159f33ad03 => generated 1094 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:50:53.131850 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-77ce8026-5fe6-4c73-8304-a8b1cc3b6e84 tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] Calling method '>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:50:53.132493 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-77ce8026-5fe6-4c73-8304-a8b1cc3b6e84 tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] [instance: 0a925141-db5f-4cae-bc6c-8ca4930adf73] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:50:53.139859 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-77ce8026-5fe6-4c73-8304-a8b1cc3b6e84 tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:50:53.140240 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-77ce8026-5fe6-4c73-8304-a8b1cc3b6e84 tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:50:53.141016 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-77ce8026-5fe6-4c73-8304-a8b1cc3b6e84 tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:50:53.141455 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-77ce8026-5fe6-4c73-8304-a8b1cc3b6e84 tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:50:53.276753 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-77ce8026-5fe6-4c73-8304-a8b1cc3b6e84 tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53d00e4198e240c8a5c2fbe8bd241b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1727f66e37f94cc6971b574c8635e078', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:50:53.286030 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-77ce8026-5fe6-4c73-8304-a8b1cc3b6e84 tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] 10.222.0.20 "GET /compute/v2.1/servers/0a925141-db5f-4cae-bc6c-8ca4930adf73" status: 200 len: 1566 microversion: 2.1 time: 0.158657 Jul 06 13:50:53.286593 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 308/612] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:50:53 2022] GET /compute/v2.1/servers/0a925141-db5f-4cae-bc6c-8ca4930adf73 => generated 1566 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:50:53.656186 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-684411da-eb66-4bb8-9d4d-5ee2e1e92fb4 tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:50:53.656799 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-684411da-eb66-4bb8-9d4d-5ee2e1e92fb4 tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] [instance: ee2271a7-8fab-4455-9c3b-32159f33ad03] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:50:53.664550 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-684411da-eb66-4bb8-9d4d-5ee2e1e92fb4 tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:50:53.665020 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-684411da-eb66-4bb8-9d4d-5ee2e1e92fb4 tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:50:53.665794 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-684411da-eb66-4bb8-9d4d-5ee2e1e92fb4 tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:50:53.666227 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-684411da-eb66-4bb8-9d4d-5ee2e1e92fb4 tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:50:53.727135 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-684411da-eb66-4bb8-9d4d-5ee2e1e92fb4 tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32a8191b1c184c75b428579ace2da61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bf864bb1764452e8e3a6f0d5929da9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:50:53.734723 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-684411da-eb66-4bb8-9d4d-5ee2e1e92fb4 tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] 10.222.0.20 "GET /compute/v2.1/servers/ee2271a7-8fab-4455-9c3b-32159f33ad03" status: 200 len: 1192 microversion: 2.1 time: 0.082541 Jul 06 13:50:53.735501 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 305/613] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:50:53 2022] GET /compute/v2.1/servers/ee2271a7-8fab-4455-9c3b-32159f33ad03 => generated 1192 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:50:54.304317 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-35dc674e-fa84-4bb2-9793-35bfe5323ef0 tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] Calling method '>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:50:54.304941 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-35dc674e-fa84-4bb2-9793-35bfe5323ef0 tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] [instance: 0a925141-db5f-4cae-bc6c-8ca4930adf73] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:50:54.311448 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-35dc674e-fa84-4bb2-9793-35bfe5323ef0 tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:50:54.311905 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-35dc674e-fa84-4bb2-9793-35bfe5323ef0 tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:50:54.312682 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-35dc674e-fa84-4bb2-9793-35bfe5323ef0 tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:50:54.313160 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-35dc674e-fa84-4bb2-9793-35bfe5323ef0 tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:50:54.513746 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-35dc674e-fa84-4bb2-9793-35bfe5323ef0 tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53d00e4198e240c8a5c2fbe8bd241b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1727f66e37f94cc6971b574c8635e078', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:50:54.522211 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-35dc674e-fa84-4bb2-9793-35bfe5323ef0 tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] 10.222.0.20 "GET /compute/v2.1/servers/0a925141-db5f-4cae-bc6c-8ca4930adf73" status: 200 len: 1566 microversion: 2.1 time: 0.223038 Jul 06 13:50:54.522787 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 309/614] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:50:54 2022] GET /compute/v2.1/servers/0a925141-db5f-4cae-bc6c-8ca4930adf73 => generated 1566 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:50:54.752974 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-38e42d64-2ba6-4545-b1ab-dffa1a086ae8 tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:50:54.754782 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-38e42d64-2ba6-4545-b1ab-dffa1a086ae8 tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] [instance: ee2271a7-8fab-4455-9c3b-32159f33ad03] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:50:54.767506 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-38e42d64-2ba6-4545-b1ab-dffa1a086ae8 tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:50:54.768094 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-38e42d64-2ba6-4545-b1ab-dffa1a086ae8 tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:50:54.769211 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-38e42d64-2ba6-4545-b1ab-dffa1a086ae8 tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:50:54.769752 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-38e42d64-2ba6-4545-b1ab-dffa1a086ae8 tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:50:54.925016 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-38e42d64-2ba6-4545-b1ab-dffa1a086ae8 tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32a8191b1c184c75b428579ace2da61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bf864bb1764452e8e3a6f0d5929da9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:50:54.932445 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-38e42d64-2ba6-4545-b1ab-dffa1a086ae8 tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] 10.222.0.20 "GET /compute/v2.1/servers/ee2271a7-8fab-4455-9c3b-32159f33ad03" status: 200 len: 1277 microversion: 2.1 time: 0.185441 Jul 06 13:50:54.933031 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 306/615] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:50:54 2022] GET /compute/v2.1/servers/ee2271a7-8fab-4455-9c3b-32159f33ad03 => generated 1277 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:50:55.539523 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-5a4ed364-69ec-4f5c-bd26-12c6a706e6b8 tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] Calling method '>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:50:55.540075 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-5a4ed364-69ec-4f5c-bd26-12c6a706e6b8 tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] [instance: 0a925141-db5f-4cae-bc6c-8ca4930adf73] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:50:55.546356 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-5a4ed364-69ec-4f5c-bd26-12c6a706e6b8 tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:50:55.546817 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-5a4ed364-69ec-4f5c-bd26-12c6a706e6b8 tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:50:55.547593 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-5a4ed364-69ec-4f5c-bd26-12c6a706e6b8 tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:50:55.548033 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-5a4ed364-69ec-4f5c-bd26-12c6a706e6b8 tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:50:55.665151 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [req-8fac002f-99f5-44a1-8e05-47699b864a08 req-4c92f1f2-f4d9-4070-82a5-7b98d0a9a1c5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ee2271a7-8fab-4455-9c3b-32159f33ad03", "tag": "45301213-2dd0-47c7-bd88-caba9757cb8d"}]} {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 06 13:50:55.674056 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [req-8fac002f-99f5-44a1-8e05-47699b864a08 req-4c92f1f2-f4d9-4070-82a5-7b98d0a9a1c5 service nova] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:50:55.674656 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [req-8fac002f-99f5-44a1-8e05-47699b864a08 req-4c92f1f2-f4d9-4070-82a5-7b98d0a9a1c5 service nova] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:50:55.687327 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.compute.server_external_events [req-8fac002f-99f5-44a1-8e05-47699b864a08 req-4c92f1f2-f4d9-4070-82a5-7b98d0a9a1c5 service nova] Creating event network-changed:45301213-2dd0-47c7-bd88-caba9757cb8d for instance ee2271a7-8fab-4455-9c3b-32159f33ad03 on hv-cinder-81914 Jul 06 13:50:55.693106 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [req-8fac002f-99f5-44a1-8e05-47699b864a08 req-4c92f1f2-f4d9-4070-82a5-7b98d0a9a1c5 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.126891 Jul 06 13:50:55.693864 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 307/616] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 6 13:50:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 06 13:50:55.773717 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-5a4ed364-69ec-4f5c-bd26-12c6a706e6b8 tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53d00e4198e240c8a5c2fbe8bd241b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1727f66e37f94cc6971b574c8635e078', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:50:55.781165 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-5a4ed364-69ec-4f5c-bd26-12c6a706e6b8 tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] 10.222.0.20 "GET /compute/v2.1/servers/0a925141-db5f-4cae-bc6c-8ca4930adf73" status: 200 len: 1566 microversion: 2.1 time: 0.245591 Jul 06 13:50:55.781829 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 310/617] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:50:55 2022] GET /compute/v2.1/servers/0a925141-db5f-4cae-bc6c-8ca4930adf73 => generated 1566 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:50:55.949776 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-9c2b1e77-ff85-4c02-bf53-fd8d4fda9545 tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:50:55.950476 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-9c2b1e77-ff85-4c02-bf53-fd8d4fda9545 tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] [instance: ee2271a7-8fab-4455-9c3b-32159f33ad03] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:50:55.956639 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-9c2b1e77-ff85-4c02-bf53-fd8d4fda9545 tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:50:55.957122 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-9c2b1e77-ff85-4c02-bf53-fd8d4fda9545 tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:50:55.957905 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-9c2b1e77-ff85-4c02-bf53-fd8d4fda9545 tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:50:55.958344 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-9c2b1e77-ff85-4c02-bf53-fd8d4fda9545 tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:50:56.090409 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-9c2b1e77-ff85-4c02-bf53-fd8d4fda9545 tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32a8191b1c184c75b428579ace2da61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bf864bb1764452e8e3a6f0d5929da9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:50:56.098086 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-9c2b1e77-ff85-4c02-bf53-fd8d4fda9545 tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] 10.222.0.20 "GET /compute/v2.1/servers/ee2271a7-8fab-4455-9c3b-32159f33ad03" status: 200 len: 1265 microversion: 2.1 time: 0.153029 Jul 06 13:50:56.098680 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 308/618] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:50:55 2022] GET /compute/v2.1/servers/ee2271a7-8fab-4455-9c3b-32159f33ad03 => generated 1265 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:50:56.797876 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-59a88720-858a-41ed-8619-59d0ba6e860c tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] Calling method '>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:50:56.798517 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-59a88720-858a-41ed-8619-59d0ba6e860c tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] [instance: 0a925141-db5f-4cae-bc6c-8ca4930adf73] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:50:56.805751 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-59a88720-858a-41ed-8619-59d0ba6e860c tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:50:56.806204 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-59a88720-858a-41ed-8619-59d0ba6e860c tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:50:56.806966 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-59a88720-858a-41ed-8619-59d0ba6e860c tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:50:56.807403 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-59a88720-858a-41ed-8619-59d0ba6e860c tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:50:56.944108 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-59a88720-858a-41ed-8619-59d0ba6e860c tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53d00e4198e240c8a5c2fbe8bd241b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1727f66e37f94cc6971b574c8635e078', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:50:56.951934 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-59a88720-858a-41ed-8619-59d0ba6e860c tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] 10.222.0.20 "GET /compute/v2.1/servers/0a925141-db5f-4cae-bc6c-8ca4930adf73" status: 200 len: 1566 microversion: 2.1 time: 0.157859 Jul 06 13:50:56.952540 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 311/619] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:50:56 2022] GET /compute/v2.1/servers/0a925141-db5f-4cae-bc6c-8ca4930adf73 => generated 1566 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:50:57.115146 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-000ab8e3-465e-4d15-9a4c-ee923df9800c tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:50:57.115679 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-000ab8e3-465e-4d15-9a4c-ee923df9800c tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] [instance: ee2271a7-8fab-4455-9c3b-32159f33ad03] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:50:57.122078 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-000ab8e3-465e-4d15-9a4c-ee923df9800c tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:50:57.122520 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-000ab8e3-465e-4d15-9a4c-ee923df9800c tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:50:57.123268 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-000ab8e3-465e-4d15-9a4c-ee923df9800c tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:50:57.123694 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-000ab8e3-465e-4d15-9a4c-ee923df9800c tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:50:57.257504 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-000ab8e3-465e-4d15-9a4c-ee923df9800c tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32a8191b1c184c75b428579ace2da61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bf864bb1764452e8e3a6f0d5929da9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:50:57.264942 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-000ab8e3-465e-4d15-9a4c-ee923df9800c tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] 10.222.0.20 "GET /compute/v2.1/servers/ee2271a7-8fab-4455-9c3b-32159f33ad03" status: 200 len: 1265 microversion: 2.1 time: 0.153947 Jul 06 13:50:57.265516 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 309/620] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:50:57 2022] GET /compute/v2.1/servers/ee2271a7-8fab-4455-9c3b-32159f33ad03 => generated 1265 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:50:57.558055 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-2c008c6d-ad11-49e3-8bac-e6505d098555 tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 06 13:50:57.559070 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-2c008c6d-ad11-49e3-8bac-e6505d098555 tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] [instance: 4895b615-7e9b-4a58-ac74-008e7ba87aad] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:50:57.566272 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-2c008c6d-ad11-49e3-8bac-e6505d098555 tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:50:57.566727 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-2c008c6d-ad11-49e3-8bac-e6505d098555 tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:50:57.567512 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-2c008c6d-ad11-49e3-8bac-e6505d098555 tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:50:57.567954 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-2c008c6d-ad11-49e3-8bac-e6505d098555 tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:50:57.640801 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-2c008c6d-ad11-49e3-8bac-e6505d098555 tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] 10.222.0.20 "POST /compute/v2.1/servers/4895b615-7e9b-4a58-ac74-008e7ba87aad/action" status: 202 len: 0 microversion: 2.1 time: 0.086623 Jul 06 13:50:57.642889 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 312/621] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Jul 6 13:50:57 2022] POST /compute/v2.1/servers/4895b615-7e9b-4a58-ac74-008e7ba87aad/action => generated 0 bytes in 88 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 06 13:50:57.650614 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-ed7cdb80-c2d5-49a4-a073-6940659a534d tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:50:57.651268 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-ed7cdb80-c2d5-49a4-a073-6940659a534d tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] [instance: 4895b615-7e9b-4a58-ac74-008e7ba87aad] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:50:57.657142 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-ed7cdb80-c2d5-49a4-a073-6940659a534d tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:50:57.657599 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-ed7cdb80-c2d5-49a4-a073-6940659a534d tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:50:57.658791 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-ed7cdb80-c2d5-49a4-a073-6940659a534d tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:50:57.659321 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-ed7cdb80-c2d5-49a4-a073-6940659a534d tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:50:57.844314 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-ed7cdb80-c2d5-49a4-a073-6940659a534d tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19ccda8f7ce447c490910ffa14165c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ffa9da064c64346b5f227c28a89ea81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:50:57.853681 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-ed7cdb80-c2d5-49a4-a073-6940659a534d tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] 10.222.0.20 "GET /compute/v2.1/servers/4895b615-7e9b-4a58-ac74-008e7ba87aad" status: 200 len: 1748 microversion: 2.1 time: 0.206747 Jul 06 13:50:57.854513 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 310/622] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:50:57 2022] GET /compute/v2.1/servers/4895b615-7e9b-4a58-ac74-008e7ba87aad => generated 1748 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:50:57.972077 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-9d80f901-efdc-428a-b0b3-3e0ec1691538 tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] Calling method '>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:50:57.972831 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-9d80f901-efdc-428a-b0b3-3e0ec1691538 tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] [instance: 0a925141-db5f-4cae-bc6c-8ca4930adf73] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:50:57.979092 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-9d80f901-efdc-428a-b0b3-3e0ec1691538 tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:50:57.979618 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-9d80f901-efdc-428a-b0b3-3e0ec1691538 tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:50:57.980387 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-9d80f901-efdc-428a-b0b3-3e0ec1691538 tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:50:57.980845 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-9d80f901-efdc-428a-b0b3-3e0ec1691538 tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:50:58.115683 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-9d80f901-efdc-428a-b0b3-3e0ec1691538 tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53d00e4198e240c8a5c2fbe8bd241b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1727f66e37f94cc6971b574c8635e078', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:50:58.123186 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-9d80f901-efdc-428a-b0b3-3e0ec1691538 tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] 10.222.0.20 "GET /compute/v2.1/servers/0a925141-db5f-4cae-bc6c-8ca4930adf73" status: 200 len: 1566 microversion: 2.1 time: 0.157046 Jul 06 13:50:58.123757 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 313/623] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:50:57 2022] GET /compute/v2.1/servers/0a925141-db5f-4cae-bc6c-8ca4930adf73 => generated 1566 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:50:58.282130 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-a5d9940f-72fc-41b3-a306-196c3335f662 tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:50:58.282820 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-a5d9940f-72fc-41b3-a306-196c3335f662 tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] [instance: ee2271a7-8fab-4455-9c3b-32159f33ad03] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:50:58.290016 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-a5d9940f-72fc-41b3-a306-196c3335f662 tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:50:58.290461 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-a5d9940f-72fc-41b3-a306-196c3335f662 tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:50:58.291410 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-a5d9940f-72fc-41b3-a306-196c3335f662 tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:50:58.291650 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-a5d9940f-72fc-41b3-a306-196c3335f662 tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:50:58.425996 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-a5d9940f-72fc-41b3-a306-196c3335f662 tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32a8191b1c184c75b428579ace2da61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bf864bb1764452e8e3a6f0d5929da9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:50:58.433339 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-a5d9940f-72fc-41b3-a306-196c3335f662 tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] 10.222.0.20 "GET /compute/v2.1/servers/ee2271a7-8fab-4455-9c3b-32159f33ad03" status: 200 len: 1265 microversion: 2.1 time: 0.155046 Jul 06 13:50:58.433894 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 311/624] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:50:58 2022] GET /compute/v2.1/servers/ee2271a7-8fab-4455-9c3b-32159f33ad03 => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:50:58.871615 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-296084bc-c218-4f6e-abf9-34b442c39d4d tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] Calling method '>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:50:58.872249 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-296084bc-c218-4f6e-abf9-34b442c39d4d tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] [instance: 4895b615-7e9b-4a58-ac74-008e7ba87aad] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:50:58.879190 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-296084bc-c218-4f6e-abf9-34b442c39d4d tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:50:58.879645 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-296084bc-c218-4f6e-abf9-34b442c39d4d tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:50:58.880419 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-296084bc-c218-4f6e-abf9-34b442c39d4d tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:50:58.880858 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-296084bc-c218-4f6e-abf9-34b442c39d4d tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:50:59.025641 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-296084bc-c218-4f6e-abf9-34b442c39d4d tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19ccda8f7ce447c490910ffa14165c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ffa9da064c64346b5f227c28a89ea81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:50:59.034337 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-296084bc-c218-4f6e-abf9-34b442c39d4d tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] 10.222.0.20 "GET /compute/v2.1/servers/4895b615-7e9b-4a58-ac74-008e7ba87aad" status: 200 len: 1753 microversion: 2.1 time: 0.165648 Jul 06 13:50:59.034903 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 314/625] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:50:58 2022] GET /compute/v2.1/servers/4895b615-7e9b-4a58-ac74-008e7ba87aad => generated 1753 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:50:59.139662 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-e97795e9-fd46-4431-a242-13f101d0f5b8 tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:50:59.140181 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-e97795e9-fd46-4431-a242-13f101d0f5b8 tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] [instance: 0a925141-db5f-4cae-bc6c-8ca4930adf73] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:50:59.146654 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-e97795e9-fd46-4431-a242-13f101d0f5b8 tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:50:59.147098 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-e97795e9-fd46-4431-a242-13f101d0f5b8 tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:50:59.147863 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-e97795e9-fd46-4431-a242-13f101d0f5b8 tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:50:59.148294 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-e97795e9-fd46-4431-a242-13f101d0f5b8 tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:50:59.277011 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-e97795e9-fd46-4431-a242-13f101d0f5b8 tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53d00e4198e240c8a5c2fbe8bd241b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1727f66e37f94cc6971b574c8635e078', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:50:59.284890 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-e97795e9-fd46-4431-a242-13f101d0f5b8 tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] 10.222.0.20 "GET /compute/v2.1/servers/0a925141-db5f-4cae-bc6c-8ca4930adf73" status: 200 len: 1566 microversion: 2.1 time: 0.149316 Jul 06 13:50:59.285455 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 312/626] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:50:59 2022] GET /compute/v2.1/servers/0a925141-db5f-4cae-bc6c-8ca4930adf73 => generated 1566 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:50:59.450665 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-b583794e-fa17-4967-a605-29717ca602ff tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Calling method '>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:50:59.451203 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-b583794e-fa17-4967-a605-29717ca602ff tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] [instance: ee2271a7-8fab-4455-9c3b-32159f33ad03] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:50:59.457225 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-b583794e-fa17-4967-a605-29717ca602ff tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:50:59.457681 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-b583794e-fa17-4967-a605-29717ca602ff tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:50:59.458449 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-b583794e-fa17-4967-a605-29717ca602ff tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:50:59.458887 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-b583794e-fa17-4967-a605-29717ca602ff tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:50:59.591413 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-b583794e-fa17-4967-a605-29717ca602ff tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32a8191b1c184c75b428579ace2da61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bf864bb1764452e8e3a6f0d5929da9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:50:59.599496 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-b583794e-fa17-4967-a605-29717ca602ff tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] 10.222.0.20 "GET /compute/v2.1/servers/ee2271a7-8fab-4455-9c3b-32159f33ad03" status: 200 len: 1265 microversion: 2.1 time: 0.152711 Jul 06 13:50:59.600055 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 315/627] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:50:59 2022] GET /compute/v2.1/servers/ee2271a7-8fab-4455-9c3b-32159f33ad03 => generated 1265 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:51:00.052377 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-f8765b8c-3f9a-4bd3-85c4-9080ecbe22c7 tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:51:00.053039 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-f8765b8c-3f9a-4bd3-85c4-9080ecbe22c7 tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] [instance: 4895b615-7e9b-4a58-ac74-008e7ba87aad] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:51:00.059213 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-f8765b8c-3f9a-4bd3-85c4-9080ecbe22c7 tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:51:00.059657 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-f8765b8c-3f9a-4bd3-85c4-9080ecbe22c7 tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:51:00.060416 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-f8765b8c-3f9a-4bd3-85c4-9080ecbe22c7 tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:51:00.060849 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-f8765b8c-3f9a-4bd3-85c4-9080ecbe22c7 tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:51:00.199874 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-f8765b8c-3f9a-4bd3-85c4-9080ecbe22c7 tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19ccda8f7ce447c490910ffa14165c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ffa9da064c64346b5f227c28a89ea81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:51:00.208982 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-f8765b8c-3f9a-4bd3-85c4-9080ecbe22c7 tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] 10.222.0.20 "GET /compute/v2.1/servers/4895b615-7e9b-4a58-ac74-008e7ba87aad" status: 200 len: 1753 microversion: 2.1 time: 0.161234 Jul 06 13:51:00.209562 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 313/628] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:51:00 2022] GET /compute/v2.1/servers/4895b615-7e9b-4a58-ac74-008e7ba87aad => generated 1753 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:51:00.301939 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-e8c34732-b8f3-4096-b601-49ada2909850 tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] Calling method '>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:51:00.302603 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-e8c34732-b8f3-4096-b601-49ada2909850 tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] [instance: 0a925141-db5f-4cae-bc6c-8ca4930adf73] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:51:00.309027 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-e8c34732-b8f3-4096-b601-49ada2909850 tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:51:00.309489 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-e8c34732-b8f3-4096-b601-49ada2909850 tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:51:00.310254 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-e8c34732-b8f3-4096-b601-49ada2909850 tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:51:00.310688 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-e8c34732-b8f3-4096-b601-49ada2909850 tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:51:00.441041 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-e8c34732-b8f3-4096-b601-49ada2909850 tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53d00e4198e240c8a5c2fbe8bd241b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1727f66e37f94cc6971b574c8635e078', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:51:00.448442 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-e8c34732-b8f3-4096-b601-49ada2909850 tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] 10.222.0.20 "GET /compute/v2.1/servers/0a925141-db5f-4cae-bc6c-8ca4930adf73" status: 200 len: 1566 microversion: 2.1 time: 0.150560 Jul 06 13:51:00.449027 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 316/629] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:51:00 2022] GET /compute/v2.1/servers/0a925141-db5f-4cae-bc6c-8ca4930adf73 => generated 1566 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:51:00.616265 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-d9bc5431-9ab2-46f1-8878-2b37b6009314 tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:51:00.616808 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-d9bc5431-9ab2-46f1-8878-2b37b6009314 tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] [instance: ee2271a7-8fab-4455-9c3b-32159f33ad03] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:51:00.622795 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-d9bc5431-9ab2-46f1-8878-2b37b6009314 tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:51:00.623243 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-d9bc5431-9ab2-46f1-8878-2b37b6009314 tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:51:00.624001 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-d9bc5431-9ab2-46f1-8878-2b37b6009314 tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:51:00.624461 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-d9bc5431-9ab2-46f1-8878-2b37b6009314 tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:51:00.947337 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-ed55fcbd-8d91-4e56-8ead-ce805c1fe4ad tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7f526dcf-d898-4258-a1c6-c22cc15925e3"}} {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 06 13:51:00.948665 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-ed55fcbd-8d91-4e56-8ead-ce805c1fe4ad tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] [instance: 74a59be2-69eb-4bdc-865c-570f5a2019df] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:51:00.954718 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-ed55fcbd-8d91-4e56-8ead-ce805c1fe4ad tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:51:00.955169 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-ed55fcbd-8d91-4e56-8ead-ce805c1fe4ad tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:51:00.955933 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-ed55fcbd-8d91-4e56-8ead-ce805c1fe4ad tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:51:00.956376 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-ed55fcbd-8d91-4e56-8ead-ce805c1fe4ad tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:51:01.004111 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-d9bc5431-9ab2-46f1-8878-2b37b6009314 tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32a8191b1c184c75b428579ace2da61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bf864bb1764452e8e3a6f0d5929da9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:51:01.011903 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-d9bc5431-9ab2-46f1-8878-2b37b6009314 tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] 10.222.0.20 "GET /compute/v2.1/servers/ee2271a7-8fab-4455-9c3b-32159f33ad03" status: 200 len: 1265 microversion: 2.1 time: 0.399631 Jul 06 13:51:01.012456 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 314/630] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:51:00 2022] GET /compute/v2.1/servers/ee2271a7-8fab-4455-9c3b-32159f33ad03 => generated 1265 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:51:01.227007 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-56e84b4c-71ab-49cd-9514-8f40730fb1f4 tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:51:01.227619 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-56e84b4c-71ab-49cd-9514-8f40730fb1f4 tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] [instance: 4895b615-7e9b-4a58-ac74-008e7ba87aad] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:51:01.231009 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-ed55fcbd-8d91-4e56-8ead-ce805c1fe4ad tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] 10.222.0.20 "POST /compute/v2.1/servers/74a59be2-69eb-4bdc-865c-570f5a2019df/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.413734 Jul 06 13:51:01.231836 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 317/631] 10.222.0.20 () {60 vars in 1322 bytes} [Wed Jul 6 13:51:00 2022] POST /compute/v2.1/servers/74a59be2-69eb-4bdc-865c-570f5a2019df/os-volume_attachments => generated 194 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 06 13:51:01.234358 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-56e84b4c-71ab-49cd-9514-8f40730fb1f4 tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:51:01.234814 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-56e84b4c-71ab-49cd-9514-8f40730fb1f4 tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:51:01.236054 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-56e84b4c-71ab-49cd-9514-8f40730fb1f4 tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:51:01.236986 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-56e84b4c-71ab-49cd-9514-8f40730fb1f4 tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:51:01.398517 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-56e84b4c-71ab-49cd-9514-8f40730fb1f4 tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19ccda8f7ce447c490910ffa14165c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ffa9da064c64346b5f227c28a89ea81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:51:01.406413 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-56e84b4c-71ab-49cd-9514-8f40730fb1f4 tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] 10.222.0.20 "GET /compute/v2.1/servers/4895b615-7e9b-4a58-ac74-008e7ba87aad" status: 200 len: 1753 microversion: 2.1 time: 0.183419 Jul 06 13:51:01.406965 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 315/632] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:51:01 2022] GET /compute/v2.1/servers/4895b615-7e9b-4a58-ac74-008e7ba87aad => generated 1753 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:51:01.465560 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-09599ac7-2bac-45b5-92e1-0bbc002b7285 tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] Calling method '>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:51:01.466281 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-09599ac7-2bac-45b5-92e1-0bbc002b7285 tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] [instance: 0a925141-db5f-4cae-bc6c-8ca4930adf73] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:51:01.473229 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-09599ac7-2bac-45b5-92e1-0bbc002b7285 tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:51:01.473682 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-09599ac7-2bac-45b5-92e1-0bbc002b7285 tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:51:01.474445 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-09599ac7-2bac-45b5-92e1-0bbc002b7285 tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:51:01.474882 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-09599ac7-2bac-45b5-92e1-0bbc002b7285 tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:51:01.609340 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-09599ac7-2bac-45b5-92e1-0bbc002b7285 tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53d00e4198e240c8a5c2fbe8bd241b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1727f66e37f94cc6971b574c8635e078', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:51:01.613314 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG dbcounter [-] [124368] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=5,nova_cell1:INSERT=3 {{(pid=124368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:51:01.618192 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-09599ac7-2bac-45b5-92e1-0bbc002b7285 tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] 10.222.0.20 "GET /compute/v2.1/servers/0a925141-db5f-4cae-bc6c-8ca4930adf73" status: 200 len: 1566 microversion: 2.1 time: 0.156778 Jul 06 13:51:01.618757 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 318/633] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:51:01 2022] GET /compute/v2.1/servers/0a925141-db5f-4cae-bc6c-8ca4930adf73 => generated 1566 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:51:02.028507 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-0adc57f9-9b4e-4df3-a33d-1cf91de3789e tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:51:02.029135 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-0adc57f9-9b4e-4df3-a33d-1cf91de3789e tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] [instance: ee2271a7-8fab-4455-9c3b-32159f33ad03] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:51:02.035287 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-0adc57f9-9b4e-4df3-a33d-1cf91de3789e tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:51:02.035756 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-0adc57f9-9b4e-4df3-a33d-1cf91de3789e tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:51:02.036510 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-0adc57f9-9b4e-4df3-a33d-1cf91de3789e tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:51:02.036938 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-0adc57f9-9b4e-4df3-a33d-1cf91de3789e tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:51:02.178401 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-0adc57f9-9b4e-4df3-a33d-1cf91de3789e tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32a8191b1c184c75b428579ace2da61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bf864bb1764452e8e3a6f0d5929da9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:51:02.185778 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-0adc57f9-9b4e-4df3-a33d-1cf91de3789e tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] 10.222.0.20 "GET /compute/v2.1/servers/ee2271a7-8fab-4455-9c3b-32159f33ad03" status: 200 len: 1265 microversion: 2.1 time: 0.161168 Jul 06 13:51:02.186326 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 316/634] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:51:02 2022] GET /compute/v2.1/servers/ee2271a7-8fab-4455-9c3b-32159f33ad03 => generated 1265 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:51:02.425279 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-85172a43-e510-468a-ac2d-28de52e7b215 tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] Calling method '>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:51:02.425811 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-85172a43-e510-468a-ac2d-28de52e7b215 tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] [instance: 4895b615-7e9b-4a58-ac74-008e7ba87aad] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:51:02.427959 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG dbcounter [-] [124368] Writing DB stats nova_cell0:SELECT=2 {{(pid=124368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:51:02.428623 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG dbcounter [-] [124368] Writing DB stats nova_cell0:SELECT=6 {{(pid=124368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:51:02.435241 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-85172a43-e510-468a-ac2d-28de52e7b215 tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:51:02.435684 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-85172a43-e510-468a-ac2d-28de52e7b215 tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:51:02.436449 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-85172a43-e510-468a-ac2d-28de52e7b215 tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:51:02.436881 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-85172a43-e510-468a-ac2d-28de52e7b215 tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:51:02.578184 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-85172a43-e510-468a-ac2d-28de52e7b215 tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19ccda8f7ce447c490910ffa14165c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ffa9da064c64346b5f227c28a89ea81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:51:02.586726 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-85172a43-e510-468a-ac2d-28de52e7b215 tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] 10.222.0.20 "GET /compute/v2.1/servers/4895b615-7e9b-4a58-ac74-008e7ba87aad" status: 200 len: 1753 microversion: 2.1 time: 0.166983 Jul 06 13:51:02.587284 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 319/635] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:51:02 2022] GET /compute/v2.1/servers/4895b615-7e9b-4a58-ac74-008e7ba87aad => generated 1753 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:51:02.635616 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-3629ca96-51e2-4406-affe-ba42b11030ff tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:51:02.636217 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-3629ca96-51e2-4406-affe-ba42b11030ff tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] [instance: 0a925141-db5f-4cae-bc6c-8ca4930adf73] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:51:02.638602 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG dbcounter [-] [124367] Writing DB stats nova_cell0:SELECT=2 {{(pid=124367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:51:02.644908 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-3629ca96-51e2-4406-affe-ba42b11030ff tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:51:02.645391 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-3629ca96-51e2-4406-affe-ba42b11030ff tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:51:02.646154 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-3629ca96-51e2-4406-affe-ba42b11030ff tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:51:02.646581 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-3629ca96-51e2-4406-affe-ba42b11030ff tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:51:02.776336 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-3629ca96-51e2-4406-affe-ba42b11030ff tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53d00e4198e240c8a5c2fbe8bd241b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1727f66e37f94cc6971b574c8635e078', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:51:02.784144 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-3629ca96-51e2-4406-affe-ba42b11030ff tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] 10.222.0.20 "GET /compute/v2.1/servers/0a925141-db5f-4cae-bc6c-8ca4930adf73" status: 200 len: 1566 microversion: 2.1 time: 0.152321 Jul 06 13:51:02.785201 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 317/636] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:51:02 2022] GET /compute/v2.1/servers/0a925141-db5f-4cae-bc6c-8ca4930adf73 => generated 1566 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:51:03.203101 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-f744b8a2-f59e-482c-8b53-610f59313f4e tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Calling method '>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:51:03.203774 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-f744b8a2-f59e-482c-8b53-610f59313f4e tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] [instance: ee2271a7-8fab-4455-9c3b-32159f33ad03] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:51:03.210242 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-f744b8a2-f59e-482c-8b53-610f59313f4e tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:51:03.210697 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-f744b8a2-f59e-482c-8b53-610f59313f4e tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:51:03.211462 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-f744b8a2-f59e-482c-8b53-610f59313f4e tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:51:03.211903 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-f744b8a2-f59e-482c-8b53-610f59313f4e tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:51:03.349827 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-f744b8a2-f59e-482c-8b53-610f59313f4e tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32a8191b1c184c75b428579ace2da61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bf864bb1764452e8e3a6f0d5929da9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:51:03.357479 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-f744b8a2-f59e-482c-8b53-610f59313f4e tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] 10.222.0.20 "GET /compute/v2.1/servers/ee2271a7-8fab-4455-9c3b-32159f33ad03" status: 200 len: 1265 microversion: 2.1 time: 0.158227 Jul 06 13:51:03.358061 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 320/637] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:51:03 2022] GET /compute/v2.1/servers/ee2271a7-8fab-4455-9c3b-32159f33ad03 => generated 1265 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:51:03.603625 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-077f22f3-4562-40df-9a3d-dd4e08bc77c7 tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:51:03.604251 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-077f22f3-4562-40df-9a3d-dd4e08bc77c7 tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] [instance: 4895b615-7e9b-4a58-ac74-008e7ba87aad] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:51:03.610407 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-077f22f3-4562-40df-9a3d-dd4e08bc77c7 tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:51:03.610856 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-077f22f3-4562-40df-9a3d-dd4e08bc77c7 tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:51:03.612243 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-077f22f3-4562-40df-9a3d-dd4e08bc77c7 tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:51:03.612676 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-077f22f3-4562-40df-9a3d-dd4e08bc77c7 tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:51:03.761241 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-077f22f3-4562-40df-9a3d-dd4e08bc77c7 tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19ccda8f7ce447c490910ffa14165c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ffa9da064c64346b5f227c28a89ea81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:51:03.769115 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-077f22f3-4562-40df-9a3d-dd4e08bc77c7 tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] 10.222.0.20 "GET /compute/v2.1/servers/4895b615-7e9b-4a58-ac74-008e7ba87aad" status: 200 len: 1753 microversion: 2.1 time: 0.169307 Jul 06 13:51:03.769671 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 318/638] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:51:03 2022] GET /compute/v2.1/servers/4895b615-7e9b-4a58-ac74-008e7ba87aad => generated 1753 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:51:03.802398 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-99245a89-073a-4650-9fcc-cd421ce78639 tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] Calling method '>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:51:03.803014 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-99245a89-073a-4650-9fcc-cd421ce78639 tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] [instance: 0a925141-db5f-4cae-bc6c-8ca4930adf73] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:51:03.809045 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-99245a89-073a-4650-9fcc-cd421ce78639 tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:51:03.809507 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-99245a89-073a-4650-9fcc-cd421ce78639 tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:51:03.810278 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-99245a89-073a-4650-9fcc-cd421ce78639 tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:51:03.810718 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-99245a89-073a-4650-9fcc-cd421ce78639 tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:51:03.943491 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-99245a89-073a-4650-9fcc-cd421ce78639 tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53d00e4198e240c8a5c2fbe8bd241b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1727f66e37f94cc6971b574c8635e078', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:51:03.951041 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-99245a89-073a-4650-9fcc-cd421ce78639 tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] 10.222.0.20 "GET /compute/v2.1/servers/0a925141-db5f-4cae-bc6c-8ca4930adf73" status: 200 len: 1566 microversion: 2.1 time: 0.153417 Jul 06 13:51:03.951600 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 321/639] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:51:03 2022] GET /compute/v2.1/servers/0a925141-db5f-4cae-bc6c-8ca4930adf73 => generated 1566 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:51:04.373455 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-30b1c3f6-1b78-407d-a321-e2f4f08c6cfc tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:51:04.374064 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-30b1c3f6-1b78-407d-a321-e2f4f08c6cfc tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] [instance: ee2271a7-8fab-4455-9c3b-32159f33ad03] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:51:04.380783 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-30b1c3f6-1b78-407d-a321-e2f4f08c6cfc tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:51:04.381271 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-30b1c3f6-1b78-407d-a321-e2f4f08c6cfc tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:51:04.382036 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-30b1c3f6-1b78-407d-a321-e2f4f08c6cfc tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:51:04.382470 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-30b1c3f6-1b78-407d-a321-e2f4f08c6cfc tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:51:04.518376 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-30b1c3f6-1b78-407d-a321-e2f4f08c6cfc tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32a8191b1c184c75b428579ace2da61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bf864bb1764452e8e3a6f0d5929da9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:51:04.525710 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-30b1c3f6-1b78-407d-a321-e2f4f08c6cfc tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] 10.222.0.20 "GET /compute/v2.1/servers/ee2271a7-8fab-4455-9c3b-32159f33ad03" status: 200 len: 1265 microversion: 2.1 time: 0.156101 Jul 06 13:51:04.526262 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 319/640] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:51:04 2022] GET /compute/v2.1/servers/ee2271a7-8fab-4455-9c3b-32159f33ad03 => generated 1265 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:51:04.786082 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-725cd908-47e6-4a9c-bbc4-5e77d49bd502 tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] Calling method '>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:51:04.786687 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-725cd908-47e6-4a9c-bbc4-5e77d49bd502 tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] [instance: 4895b615-7e9b-4a58-ac74-008e7ba87aad] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:51:04.793093 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-725cd908-47e6-4a9c-bbc4-5e77d49bd502 tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:51:04.793538 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-725cd908-47e6-4a9c-bbc4-5e77d49bd502 tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:51:04.794310 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-725cd908-47e6-4a9c-bbc4-5e77d49bd502 tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:51:04.794721 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-725cd908-47e6-4a9c-bbc4-5e77d49bd502 tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:51:04.938750 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-725cd908-47e6-4a9c-bbc4-5e77d49bd502 tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19ccda8f7ce447c490910ffa14165c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ffa9da064c64346b5f227c28a89ea81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:51:04.946795 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-725cd908-47e6-4a9c-bbc4-5e77d49bd502 tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] 10.222.0.20 "GET /compute/v2.1/servers/4895b615-7e9b-4a58-ac74-008e7ba87aad" status: 200 len: 1753 microversion: 2.1 time: 0.164558 Jul 06 13:51:04.947361 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 322/641] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:51:04 2022] GET /compute/v2.1/servers/4895b615-7e9b-4a58-ac74-008e7ba87aad => generated 1753 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:51:04.967472 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-c8c5993d-9da8-49e0-aa2b-19bb6586b469 tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:51:04.968110 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-c8c5993d-9da8-49e0-aa2b-19bb6586b469 tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] [instance: 0a925141-db5f-4cae-bc6c-8ca4930adf73] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:51:04.975327 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-c8c5993d-9da8-49e0-aa2b-19bb6586b469 tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:51:04.975833 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-c8c5993d-9da8-49e0-aa2b-19bb6586b469 tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:51:04.976603 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-c8c5993d-9da8-49e0-aa2b-19bb6586b469 tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:51:04.977068 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-c8c5993d-9da8-49e0-aa2b-19bb6586b469 tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:51:04.981202 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG dbcounter [-] [124367] Writing DB stats nova_cell1:SELECT=100 {{(pid=124367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:51:05.111588 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-c8c5993d-9da8-49e0-aa2b-19bb6586b469 tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53d00e4198e240c8a5c2fbe8bd241b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1727f66e37f94cc6971b574c8635e078', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:51:05.119024 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-c8c5993d-9da8-49e0-aa2b-19bb6586b469 tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] 10.222.0.20 "GET /compute/v2.1/servers/0a925141-db5f-4cae-bc6c-8ca4930adf73" status: 200 len: 1566 microversion: 2.1 time: 0.155440 Jul 06 13:51:05.119588 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 320/642] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:51:04 2022] GET /compute/v2.1/servers/0a925141-db5f-4cae-bc6c-8ca4930adf73 => generated 1566 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:51:05.542179 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-8b38fafa-66b3-4121-a187-2d2cdf72c1da tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Calling method '>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:51:05.542794 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-8b38fafa-66b3-4121-a187-2d2cdf72c1da tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] [instance: ee2271a7-8fab-4455-9c3b-32159f33ad03] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:51:05.549371 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-8b38fafa-66b3-4121-a187-2d2cdf72c1da tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:51:05.550272 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-8b38fafa-66b3-4121-a187-2d2cdf72c1da tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:51:05.551049 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-8b38fafa-66b3-4121-a187-2d2cdf72c1da tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:51:05.551485 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-8b38fafa-66b3-4121-a187-2d2cdf72c1da tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:51:05.683730 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-8b38fafa-66b3-4121-a187-2d2cdf72c1da tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32a8191b1c184c75b428579ace2da61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bf864bb1764452e8e3a6f0d5929da9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:51:05.691883 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-8b38fafa-66b3-4121-a187-2d2cdf72c1da tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] 10.222.0.20 "GET /compute/v2.1/servers/ee2271a7-8fab-4455-9c3b-32159f33ad03" status: 200 len: 1265 microversion: 2.1 time: 0.153518 Jul 06 13:51:05.692536 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 323/643] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:51:05 2022] GET /compute/v2.1/servers/ee2271a7-8fab-4455-9c3b-32159f33ad03 => generated 1265 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:51:05.964239 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-871bf4a4-23d9-4035-8d80-98f2eb00d7ff tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:51:05.964846 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-871bf4a4-23d9-4035-8d80-98f2eb00d7ff tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] [instance: 4895b615-7e9b-4a58-ac74-008e7ba87aad] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:51:05.971530 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-871bf4a4-23d9-4035-8d80-98f2eb00d7ff tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:51:05.972113 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-871bf4a4-23d9-4035-8d80-98f2eb00d7ff tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:51:05.972755 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-871bf4a4-23d9-4035-8d80-98f2eb00d7ff tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:51:05.973212 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-871bf4a4-23d9-4035-8d80-98f2eb00d7ff tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:51:06.136408 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-378c7f3d-a857-4663-b4ac-a7fdd3de2d52 tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] Calling method '>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:51:06.137108 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-378c7f3d-a857-4663-b4ac-a7fdd3de2d52 tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] [instance: 0a925141-db5f-4cae-bc6c-8ca4930adf73] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:51:06.143535 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-378c7f3d-a857-4663-b4ac-a7fdd3de2d52 tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:51:06.143989 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-378c7f3d-a857-4663-b4ac-a7fdd3de2d52 tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:51:06.144966 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-378c7f3d-a857-4663-b4ac-a7fdd3de2d52 tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:51:06.145430 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-378c7f3d-a857-4663-b4ac-a7fdd3de2d52 tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:51:06.218462 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-871bf4a4-23d9-4035-8d80-98f2eb00d7ff tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19ccda8f7ce447c490910ffa14165c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ffa9da064c64346b5f227c28a89ea81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:51:06.227391 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-871bf4a4-23d9-4035-8d80-98f2eb00d7ff tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] 10.222.0.20 "GET /compute/v2.1/servers/4895b615-7e9b-4a58-ac74-008e7ba87aad" status: 200 len: 1753 microversion: 2.1 time: 0.266954 Jul 06 13:51:06.228294 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 321/644] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:51:05 2022] GET /compute/v2.1/servers/4895b615-7e9b-4a58-ac74-008e7ba87aad => generated 1753 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:51:06.283234 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-378c7f3d-a857-4663-b4ac-a7fdd3de2d52 tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53d00e4198e240c8a5c2fbe8bd241b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1727f66e37f94cc6971b574c8635e078', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:51:06.291426 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-378c7f3d-a857-4663-b4ac-a7fdd3de2d52 tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] 10.222.0.20 "GET /compute/v2.1/servers/0a925141-db5f-4cae-bc6c-8ca4930adf73" status: 200 len: 1566 microversion: 2.1 time: 0.158422 Jul 06 13:51:06.300737 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 324/645] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:51:06 2022] GET /compute/v2.1/servers/0a925141-db5f-4cae-bc6c-8ca4930adf73 => generated 1566 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 06 13:51:06.707943 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-40d28536-5c70-4ff4-8337-f4e3fef3ce48 tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:51:06.708485 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-40d28536-5c70-4ff4-8337-f4e3fef3ce48 tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] [instance: ee2271a7-8fab-4455-9c3b-32159f33ad03] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:51:06.714838 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-40d28536-5c70-4ff4-8337-f4e3fef3ce48 tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:51:06.715338 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-40d28536-5c70-4ff4-8337-f4e3fef3ce48 tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:51:06.716163 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-40d28536-5c70-4ff4-8337-f4e3fef3ce48 tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:51:06.716648 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-40d28536-5c70-4ff4-8337-f4e3fef3ce48 tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:51:06.851472 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-40d28536-5c70-4ff4-8337-f4e3fef3ce48 tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32a8191b1c184c75b428579ace2da61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bf864bb1764452e8e3a6f0d5929da9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:51:06.858908 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-40d28536-5c70-4ff4-8337-f4e3fef3ce48 tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] 10.222.0.20 "GET /compute/v2.1/servers/ee2271a7-8fab-4455-9c3b-32159f33ad03" status: 200 len: 1265 microversion: 2.1 time: 0.155082 Jul 06 13:51:06.859465 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 322/646] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:51:06 2022] GET /compute/v2.1/servers/ee2271a7-8fab-4455-9c3b-32159f33ad03 => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:51:07.245257 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-640bfdd0-292e-40a8-ad3b-42493065d938 tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] Calling method '>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:51:07.245875 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-640bfdd0-292e-40a8-ad3b-42493065d938 tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] [instance: 4895b615-7e9b-4a58-ac74-008e7ba87aad] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:51:07.252981 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-640bfdd0-292e-40a8-ad3b-42493065d938 tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:51:07.253457 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-640bfdd0-292e-40a8-ad3b-42493065d938 tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:51:07.254283 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-640bfdd0-292e-40a8-ad3b-42493065d938 tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:51:07.254728 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-640bfdd0-292e-40a8-ad3b-42493065d938 tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:51:07.307720 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-97a7c38e-6d87-4a0f-9603-62c4f621ba92 tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:51:07.308334 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-97a7c38e-6d87-4a0f-9603-62c4f621ba92 tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] [instance: 0a925141-db5f-4cae-bc6c-8ca4930adf73] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:51:07.316159 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-97a7c38e-6d87-4a0f-9603-62c4f621ba92 tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:51:07.316611 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-97a7c38e-6d87-4a0f-9603-62c4f621ba92 tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:51:07.317418 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-97a7c38e-6d87-4a0f-9603-62c4f621ba92 tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:51:07.317857 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-97a7c38e-6d87-4a0f-9603-62c4f621ba92 tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:51:07.401548 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-640bfdd0-292e-40a8-ad3b-42493065d938 tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19ccda8f7ce447c490910ffa14165c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ffa9da064c64346b5f227c28a89ea81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:51:07.409574 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-640bfdd0-292e-40a8-ad3b-42493065d938 tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] 10.222.0.20 "GET /compute/v2.1/servers/4895b615-7e9b-4a58-ac74-008e7ba87aad" status: 200 len: 1753 microversion: 2.1 time: 0.168197 Jul 06 13:51:07.410238 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 325/647] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:51:07 2022] GET /compute/v2.1/servers/4895b615-7e9b-4a58-ac74-008e7ba87aad => generated 1753 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:51:07.450484 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-97a7c38e-6d87-4a0f-9603-62c4f621ba92 tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53d00e4198e240c8a5c2fbe8bd241b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1727f66e37f94cc6971b574c8635e078', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:51:07.457964 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-97a7c38e-6d87-4a0f-9603-62c4f621ba92 tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] 10.222.0.20 "GET /compute/v2.1/servers/0a925141-db5f-4cae-bc6c-8ca4930adf73" status: 200 len: 1566 microversion: 2.1 time: 0.154134 Jul 06 13:51:07.458517 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 323/648] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:51:07 2022] GET /compute/v2.1/servers/0a925141-db5f-4cae-bc6c-8ca4930adf73 => generated 1566 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 06 13:51:07.877432 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-2bee7c3f-06a0-4ab4-9653-73536f76b1e2 tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Calling method '>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:51:07.877996 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-2bee7c3f-06a0-4ab4-9653-73536f76b1e2 tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] [instance: ee2271a7-8fab-4455-9c3b-32159f33ad03] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:51:07.884024 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-2bee7c3f-06a0-4ab4-9653-73536f76b1e2 tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:51:07.884478 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-2bee7c3f-06a0-4ab4-9653-73536f76b1e2 tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:51:07.885305 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-2bee7c3f-06a0-4ab4-9653-73536f76b1e2 tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:51:07.885747 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-2bee7c3f-06a0-4ab4-9653-73536f76b1e2 tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:51:08.018267 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-2bee7c3f-06a0-4ab4-9653-73536f76b1e2 tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32a8191b1c184c75b428579ace2da61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bf864bb1764452e8e3a6f0d5929da9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:51:08.025903 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-2bee7c3f-06a0-4ab4-9653-73536f76b1e2 tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] 10.222.0.20 "GET /compute/v2.1/servers/ee2271a7-8fab-4455-9c3b-32159f33ad03" status: 200 len: 1265 microversion: 2.1 time: 0.153548 Jul 06 13:51:08.026469 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 326/649] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:51:07 2022] GET /compute/v2.1/servers/ee2271a7-8fab-4455-9c3b-32159f33ad03 => generated 1265 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:51:08.426937 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-ac96aaca-9f3c-4afc-873a-44f013ef44e1 tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:51:08.427543 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-ac96aaca-9f3c-4afc-873a-44f013ef44e1 tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] [instance: 4895b615-7e9b-4a58-ac74-008e7ba87aad] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:51:08.433998 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-ac96aaca-9f3c-4afc-873a-44f013ef44e1 tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:51:08.434474 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-ac96aaca-9f3c-4afc-873a-44f013ef44e1 tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:51:08.435230 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-ac96aaca-9f3c-4afc-873a-44f013ef44e1 tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:51:08.435664 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-ac96aaca-9f3c-4afc-873a-44f013ef44e1 tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:51:08.474724 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-e8574164-4706-4659-b7be-f5aa92a908dd tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] Calling method '>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:51:08.475363 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-e8574164-4706-4659-b7be-f5aa92a908dd tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] [instance: 0a925141-db5f-4cae-bc6c-8ca4930adf73] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:51:08.481749 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-e8574164-4706-4659-b7be-f5aa92a908dd tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:51:08.482201 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-e8574164-4706-4659-b7be-f5aa92a908dd tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:51:08.482963 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-e8574164-4706-4659-b7be-f5aa92a908dd tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:51:08.483396 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-e8574164-4706-4659-b7be-f5aa92a908dd tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:51:08.578355 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-ac96aaca-9f3c-4afc-873a-44f013ef44e1 tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19ccda8f7ce447c490910ffa14165c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ffa9da064c64346b5f227c28a89ea81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:51:08.587066 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-ac96aaca-9f3c-4afc-873a-44f013ef44e1 tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] 10.222.0.20 "GET /compute/v2.1/servers/4895b615-7e9b-4a58-ac74-008e7ba87aad" status: 200 len: 1753 microversion: 2.1 time: 0.164364 Jul 06 13:51:08.587638 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 324/650] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:51:08 2022] GET /compute/v2.1/servers/4895b615-7e9b-4a58-ac74-008e7ba87aad => generated 1753 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:51:08.621119 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-e8574164-4706-4659-b7be-f5aa92a908dd tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53d00e4198e240c8a5c2fbe8bd241b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1727f66e37f94cc6971b574c8635e078', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:51:08.630179 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-e8574164-4706-4659-b7be-f5aa92a908dd tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] 10.222.0.20 "GET /compute/v2.1/servers/0a925141-db5f-4cae-bc6c-8ca4930adf73" status: 200 len: 1566 microversion: 2.1 time: 0.159228 Jul 06 13:51:08.631034 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 327/651] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:51:08 2022] GET /compute/v2.1/servers/0a925141-db5f-4cae-bc6c-8ca4930adf73 => generated 1566 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 06 13:51:09.042307 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-67a96284-5ab8-4802-ba21-025d524e544d tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:51:09.042917 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-67a96284-5ab8-4802-ba21-025d524e544d tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] [instance: ee2271a7-8fab-4455-9c3b-32159f33ad03] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:51:09.048925 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-67a96284-5ab8-4802-ba21-025d524e544d tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:51:09.049408 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-67a96284-5ab8-4802-ba21-025d524e544d tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:51:09.051155 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-67a96284-5ab8-4802-ba21-025d524e544d tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:51:09.051594 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-67a96284-5ab8-4802-ba21-025d524e544d tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:51:09.185627 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-67a96284-5ab8-4802-ba21-025d524e544d tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32a8191b1c184c75b428579ace2da61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bf864bb1764452e8e3a6f0d5929da9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:51:09.193376 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-67a96284-5ab8-4802-ba21-025d524e544d tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] 10.222.0.20 "GET /compute/v2.1/servers/ee2271a7-8fab-4455-9c3b-32159f33ad03" status: 200 len: 1265 microversion: 2.1 time: 0.154781 Jul 06 13:51:09.199149 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 325/652] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:51:09 2022] GET /compute/v2.1/servers/ee2271a7-8fab-4455-9c3b-32159f33ad03 => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:51:09.309959 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [req-9f211d3f-a717-445e-9cb8-38d3fe40819e req-85933468-0580-4e7a-9009-142709097216 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ee2271a7-8fab-4455-9c3b-32159f33ad03", "name": "network-vif-plugged", "status": "completed", "tag": "45301213-2dd0-47c7-bd88-caba9757cb8d"}]} {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 06 13:51:09.318727 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [req-9f211d3f-a717-445e-9cb8-38d3fe40819e req-85933468-0580-4e7a-9009-142709097216 service nova] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:51:09.319175 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [req-9f211d3f-a717-445e-9cb8-38d3fe40819e req-85933468-0580-4e7a-9009-142709097216 service nova] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:51:09.330214 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.compute.server_external_events [req-9f211d3f-a717-445e-9cb8-38d3fe40819e req-85933468-0580-4e7a-9009-142709097216 service nova] Creating event network-vif-plugged:45301213-2dd0-47c7-bd88-caba9757cb8d for instance ee2271a7-8fab-4455-9c3b-32159f33ad03 on hv-cinder-81914 Jul 06 13:51:09.336384 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [req-9f211d3f-a717-445e-9cb8-38d3fe40819e req-85933468-0580-4e7a-9009-142709097216 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030045 Jul 06 13:51:09.336972 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 328/653] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 6 13:51:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 06 13:51:09.604291 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-449a6a56-394b-4dd5-91f1-e3ebb4f5d843 tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:51:09.605059 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-449a6a56-394b-4dd5-91f1-e3ebb4f5d843 tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] [instance: 4895b615-7e9b-4a58-ac74-008e7ba87aad] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:51:09.612625 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-449a6a56-394b-4dd5-91f1-e3ebb4f5d843 tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:51:09.613100 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-449a6a56-394b-4dd5-91f1-e3ebb4f5d843 tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:51:09.614578 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-449a6a56-394b-4dd5-91f1-e3ebb4f5d843 tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:51:09.615041 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-449a6a56-394b-4dd5-91f1-e3ebb4f5d843 tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:51:09.649796 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-7e392576-0da6-46f0-9450-6385e9b12f9e tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] Calling method '>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:51:09.651684 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-7e392576-0da6-46f0-9450-6385e9b12f9e tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] [instance: 0a925141-db5f-4cae-bc6c-8ca4930adf73] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:51:09.669083 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-7e392576-0da6-46f0-9450-6385e9b12f9e tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:51:09.669895 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-7e392576-0da6-46f0-9450-6385e9b12f9e tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:51:09.671163 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-7e392576-0da6-46f0-9450-6385e9b12f9e tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:51:09.671951 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-7e392576-0da6-46f0-9450-6385e9b12f9e tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:51:09.844156 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-449a6a56-394b-4dd5-91f1-e3ebb4f5d843 tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19ccda8f7ce447c490910ffa14165c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ffa9da064c64346b5f227c28a89ea81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:51:09.848517 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-7e392576-0da6-46f0-9450-6385e9b12f9e tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53d00e4198e240c8a5c2fbe8bd241b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1727f66e37f94cc6971b574c8635e078', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:51:09.857356 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-7e392576-0da6-46f0-9450-6385e9b12f9e tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] 10.222.0.20 "GET /compute/v2.1/servers/0a925141-db5f-4cae-bc6c-8ca4930adf73" status: 200 len: 1566 microversion: 2.1 time: 0.213328 Jul 06 13:51:09.858130 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 329/654] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:51:09 2022] GET /compute/v2.1/servers/0a925141-db5f-4cae-bc6c-8ca4930adf73 => generated 1566 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:51:09.859646 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-449a6a56-394b-4dd5-91f1-e3ebb4f5d843 tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] 10.222.0.20 "GET /compute/v2.1/servers/4895b615-7e9b-4a58-ac74-008e7ba87aad" status: 200 len: 1753 microversion: 2.1 time: 0.259022 Jul 06 13:51:09.864027 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 326/655] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:51:09 2022] GET /compute/v2.1/servers/4895b615-7e9b-4a58-ac74-008e7ba87aad => generated 1753 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:51:09.864351 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-28988353-5160-48f4-8b1f-88160f828d9c tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 06 13:51:09.865662 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-28988353-5160-48f4-8b1f-88160f828d9c tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] [instance: 74a59be2-69eb-4bdc-865c-570f5a2019df] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:51:09.872631 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-28988353-5160-48f4-8b1f-88160f828d9c tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:51:09.873122 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-28988353-5160-48f4-8b1f-88160f828d9c tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:51:09.873900 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-28988353-5160-48f4-8b1f-88160f828d9c tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:51:09.874398 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-28988353-5160-48f4-8b1f-88160f828d9c tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:51:09.901443 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.objects.instance [None req-28988353-5160-48f4-8b1f-88160f828d9c tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lazy-loading 'flavor' on Instance uuid 74a59be2-69eb-4bdc-865c-570f5a2019df {{(pid=124368) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 06 13:51:10.024189 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-28988353-5160-48f4-8b1f-88160f828d9c tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] 10.222.0.20 "POST /compute/v2.1/servers/74a59be2-69eb-4bdc-865c-570f5a2019df/action" status: 200 len: 32 microversion: 2.1 time: 0.164815 Jul 06 13:51:10.024793 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 330/656] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Jul 6 13:51:09 2022] POST /compute/v2.1/servers/74a59be2-69eb-4bdc-865c-570f5a2019df/action => generated 32 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 06 13:51:10.033653 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-892eb7b3-05d8-4dee-a26b-5e10c4cbe076 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:51:10.034917 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-892eb7b3-05d8-4dee-a26b-5e10c4cbe076 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] [instance: 74a59be2-69eb-4bdc-865c-570f5a2019df] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:51:10.040889 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-892eb7b3-05d8-4dee-a26b-5e10c4cbe076 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:51:10.041374 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-892eb7b3-05d8-4dee-a26b-5e10c4cbe076 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:51:10.042143 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-892eb7b3-05d8-4dee-a26b-5e10c4cbe076 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:51:10.042580 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-892eb7b3-05d8-4dee-a26b-5e10c4cbe076 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:51:10.170196 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-892eb7b3-05d8-4dee-a26b-5e10c4cbe076 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c83c05bec4f456d8aa7d51732ddc8af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b2a80a004e04da7ae12db9f3f87146f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:51:10.178566 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-892eb7b3-05d8-4dee-a26b-5e10c4cbe076 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] 10.222.0.20 "GET /compute/v2.1/servers/74a59be2-69eb-4bdc-865c-570f5a2019df" status: 200 len: 1735 microversion: 2.1 time: 0.148664 Jul 06 13:51:10.179130 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 327/657] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:51:10 2022] GET /compute/v2.1/servers/74a59be2-69eb-4bdc-865c-570f5a2019df => generated 1735 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:51:10.210355 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-e1821499-913b-4d3d-9ef9-338c7f93f02a tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Calling method '>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:51:10.211057 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-e1821499-913b-4d3d-9ef9-338c7f93f02a tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] [instance: ee2271a7-8fab-4455-9c3b-32159f33ad03] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:51:10.217211 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-e1821499-913b-4d3d-9ef9-338c7f93f02a tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:51:10.217675 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-e1821499-913b-4d3d-9ef9-338c7f93f02a tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:51:10.218445 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-e1821499-913b-4d3d-9ef9-338c7f93f02a tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:51:10.218908 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-e1821499-913b-4d3d-9ef9-338c7f93f02a tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:51:10.349283 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-e1821499-913b-4d3d-9ef9-338c7f93f02a tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32a8191b1c184c75b428579ace2da61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bf864bb1764452e8e3a6f0d5929da9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:51:10.356953 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-e1821499-913b-4d3d-9ef9-338c7f93f02a tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] 10.222.0.20 "GET /compute/v2.1/servers/ee2271a7-8fab-4455-9c3b-32159f33ad03" status: 200 len: 1265 microversion: 2.1 time: 0.151235 Jul 06 13:51:10.357565 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 331/658] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:51:10 2022] GET /compute/v2.1/servers/ee2271a7-8fab-4455-9c3b-32159f33ad03 => generated 1265 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:51:10.879606 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-1d24b73d-1c0e-4559-baf0-84356d25efe7 tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:51:10.880205 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-1d24b73d-1c0e-4559-baf0-84356d25efe7 tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] [instance: 4895b615-7e9b-4a58-ac74-008e7ba87aad] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:51:10.884025 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-9cf085c5-9b10-4e5b-8e93-5c76ec086fb5 tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] Calling method '>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:51:10.884633 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-9cf085c5-9b10-4e5b-8e93-5c76ec086fb5 tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] [instance: 0a925141-db5f-4cae-bc6c-8ca4930adf73] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:51:10.886826 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-1d24b73d-1c0e-4559-baf0-84356d25efe7 tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:51:10.887267 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-1d24b73d-1c0e-4559-baf0-84356d25efe7 tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:51:10.888033 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-1d24b73d-1c0e-4559-baf0-84356d25efe7 tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:51:10.888457 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-1d24b73d-1c0e-4559-baf0-84356d25efe7 tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:51:10.890986 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-9cf085c5-9b10-4e5b-8e93-5c76ec086fb5 tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:51:10.891430 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-9cf085c5-9b10-4e5b-8e93-5c76ec086fb5 tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:51:10.892190 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-9cf085c5-9b10-4e5b-8e93-5c76ec086fb5 tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:51:10.892624 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-9cf085c5-9b10-4e5b-8e93-5c76ec086fb5 tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:51:11.031722 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-9cf085c5-9b10-4e5b-8e93-5c76ec086fb5 tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53d00e4198e240c8a5c2fbe8bd241b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1727f66e37f94cc6971b574c8635e078', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:51:11.040231 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-9cf085c5-9b10-4e5b-8e93-5c76ec086fb5 tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] 10.222.0.20 "GET /compute/v2.1/servers/0a925141-db5f-4cae-bc6c-8ca4930adf73" status: 200 len: 1567 microversion: 2.1 time: 0.159859 Jul 06 13:51:11.040812 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 332/659] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:51:10 2022] GET /compute/v2.1/servers/0a925141-db5f-4cae-bc6c-8ca4930adf73 => generated 1567 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 06 13:51:11.046750 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-1d24b73d-1c0e-4559-baf0-84356d25efe7 tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19ccda8f7ce447c490910ffa14165c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ffa9da064c64346b5f227c28a89ea81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:51:11.056123 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-1d24b73d-1c0e-4559-baf0-84356d25efe7 tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] 10.222.0.20 "GET /compute/v2.1/servers/4895b615-7e9b-4a58-ac74-008e7ba87aad" status: 200 len: 1753 microversion: 2.1 time: 0.180716 Jul 06 13:51:11.056911 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 328/660] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:51:10 2022] GET /compute/v2.1/servers/4895b615-7e9b-4a58-ac74-008e7ba87aad => generated 1753 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:51:11.058657 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-733f3c7d-a4f4-4ed2-aebe-907a1408e523 tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 06 13:51:11.059231 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-733f3c7d-a4f4-4ed2-aebe-907a1408e523 tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] [instance: 0a925141-db5f-4cae-bc6c-8ca4930adf73] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:51:11.065788 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-733f3c7d-a4f4-4ed2-aebe-907a1408e523 tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:51:11.066328 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-733f3c7d-a4f4-4ed2-aebe-907a1408e523 tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:51:11.067007 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-733f3c7d-a4f4-4ed2-aebe-907a1408e523 tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:51:11.067550 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-733f3c7d-a4f4-4ed2-aebe-907a1408e523 tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:51:11.126126 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG dbcounter [-] [124368] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:51:11.156708 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-733f3c7d-a4f4-4ed2-aebe-907a1408e523 tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] 10.222.0.20 "POST /compute/v2.1/servers/0a925141-db5f-4cae-bc6c-8ca4930adf73/action" status: 202 len: 0 microversion: 2.1 time: 0.103858 Jul 06 13:51:11.157434 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 333/661] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Jul 6 13:51:11 2022] POST /compute/v2.1/servers/0a925141-db5f-4cae-bc6c-8ca4930adf73/action => generated 0 bytes in 105 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 06 13:51:11.166137 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-846aa163-b823-41f1-8860-8d28130453b4 tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:51:11.166835 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-846aa163-b823-41f1-8860-8d28130453b4 tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] [instance: 0a925141-db5f-4cae-bc6c-8ca4930adf73] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:51:11.172954 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-846aa163-b823-41f1-8860-8d28130453b4 tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:51:11.173446 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-846aa163-b823-41f1-8860-8d28130453b4 tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:51:11.174220 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-846aa163-b823-41f1-8860-8d28130453b4 tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:51:11.174906 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-846aa163-b823-41f1-8860-8d28130453b4 tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:51:11.198812 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-f44c4d47-bb06-4e3a-ac0a-c103a307f23f tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Calling method '>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:51:11.199417 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-f44c4d47-bb06-4e3a-ac0a-c103a307f23f tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] [instance: 74a59be2-69eb-4bdc-865c-570f5a2019df] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:51:11.207052 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-f44c4d47-bb06-4e3a-ac0a-c103a307f23f tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:51:11.207634 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-f44c4d47-bb06-4e3a-ac0a-c103a307f23f tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:51:11.208427 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-f44c4d47-bb06-4e3a-ac0a-c103a307f23f tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:51:11.208928 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-f44c4d47-bb06-4e3a-ac0a-c103a307f23f tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:51:11.355487 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-f44c4d47-bb06-4e3a-ac0a-c103a307f23f tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c83c05bec4f456d8aa7d51732ddc8af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b2a80a004e04da7ae12db9f3f87146f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:51:11.364395 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-f44c4d47-bb06-4e3a-ac0a-c103a307f23f tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] 10.222.0.20 "GET /compute/v2.1/servers/74a59be2-69eb-4bdc-865c-570f5a2019df" status: 200 len: 1735 microversion: 2.1 time: 0.170208 Jul 06 13:51:11.365412 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 334/662] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:51:11 2022] GET /compute/v2.1/servers/74a59be2-69eb-4bdc-865c-570f5a2019df => generated 1735 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 06 13:51:11.375290 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-645b9282-3b1c-4b0a-9a79-293a70bf11e3 tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Calling method '>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:51:11.376152 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-645b9282-3b1c-4b0a-9a79-293a70bf11e3 tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] [instance: ee2271a7-8fab-4455-9c3b-32159f33ad03] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:51:11.383271 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-645b9282-3b1c-4b0a-9a79-293a70bf11e3 tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:51:11.383730 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-645b9282-3b1c-4b0a-9a79-293a70bf11e3 tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:51:11.384511 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-645b9282-3b1c-4b0a-9a79-293a70bf11e3 tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:51:11.384951 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-645b9282-3b1c-4b0a-9a79-293a70bf11e3 tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:51:11.387010 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-846aa163-b823-41f1-8860-8d28130453b4 tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53d00e4198e240c8a5c2fbe8bd241b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1727f66e37f94cc6971b574c8635e078', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:51:11.396549 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-846aa163-b823-41f1-8860-8d28130453b4 tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] 10.222.0.20 "GET /compute/v2.1/servers/0a925141-db5f-4cae-bc6c-8ca4930adf73" status: 200 len: 1575 microversion: 2.1 time: 0.234149 Jul 06 13:51:11.397163 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 329/663] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:51:11 2022] GET /compute/v2.1/servers/0a925141-db5f-4cae-bc6c-8ca4930adf73 => generated 1575 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:51:11.562881 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-645b9282-3b1c-4b0a-9a79-293a70bf11e3 tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32a8191b1c184c75b428579ace2da61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bf864bb1764452e8e3a6f0d5929da9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:51:11.571123 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-645b9282-3b1c-4b0a-9a79-293a70bf11e3 tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] 10.222.0.20 "GET /compute/v2.1/servers/ee2271a7-8fab-4455-9c3b-32159f33ad03" status: 200 len: 1265 microversion: 2.1 time: 0.200901 Jul 06 13:51:11.571981 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 335/664] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:51:11 2022] GET /compute/v2.1/servers/ee2271a7-8fab-4455-9c3b-32159f33ad03 => generated 1265 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:51:12.073286 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-92286a48-929d-4109-8ac0-1c409d7ab8af tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:51:12.073891 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-92286a48-929d-4109-8ac0-1c409d7ab8af tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] [instance: 4895b615-7e9b-4a58-ac74-008e7ba87aad] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:51:12.080323 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-92286a48-929d-4109-8ac0-1c409d7ab8af tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:51:12.080772 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-92286a48-929d-4109-8ac0-1c409d7ab8af tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:51:12.082136 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-92286a48-929d-4109-8ac0-1c409d7ab8af tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:51:12.082136 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-92286a48-929d-4109-8ac0-1c409d7ab8af tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:51:12.322583 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-92286a48-929d-4109-8ac0-1c409d7ab8af tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19ccda8f7ce447c490910ffa14165c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ffa9da064c64346b5f227c28a89ea81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:51:12.330800 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-92286a48-929d-4109-8ac0-1c409d7ab8af tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] 10.222.0.20 "GET /compute/v2.1/servers/4895b615-7e9b-4a58-ac74-008e7ba87aad" status: 200 len: 1753 microversion: 2.1 time: 0.261341 Jul 06 13:51:12.331851 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 330/665] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:51:12 2022] GET /compute/v2.1/servers/4895b615-7e9b-4a58-ac74-008e7ba87aad => generated 1753 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:51:12.382421 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-729ec5a5-d04a-41f4-93f1-ef597c48ecc8 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Calling method '>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:51:12.383356 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-729ec5a5-d04a-41f4-93f1-ef597c48ecc8 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] [instance: 74a59be2-69eb-4bdc-865c-570f5a2019df] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:51:12.389804 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-729ec5a5-d04a-41f4-93f1-ef597c48ecc8 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:51:12.390262 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-729ec5a5-d04a-41f4-93f1-ef597c48ecc8 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:51:12.391034 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-729ec5a5-d04a-41f4-93f1-ef597c48ecc8 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:51:12.391478 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-729ec5a5-d04a-41f4-93f1-ef597c48ecc8 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:51:12.414119 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-3c3b6414-d822-4167-b266-405911b1b0ec tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:51:12.414730 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-3c3b6414-d822-4167-b266-405911b1b0ec tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] [instance: 0a925141-db5f-4cae-bc6c-8ca4930adf73] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:51:12.420630 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-3c3b6414-d822-4167-b266-405911b1b0ec tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:51:12.421342 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-3c3b6414-d822-4167-b266-405911b1b0ec tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:51:12.422122 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-3c3b6414-d822-4167-b266-405911b1b0ec tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:51:12.422557 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-3c3b6414-d822-4167-b266-405911b1b0ec tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:51:12.525976 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-729ec5a5-d04a-41f4-93f1-ef597c48ecc8 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c83c05bec4f456d8aa7d51732ddc8af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b2a80a004e04da7ae12db9f3f87146f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:51:12.534307 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-729ec5a5-d04a-41f4-93f1-ef597c48ecc8 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] 10.222.0.20 "GET /compute/v2.1/servers/74a59be2-69eb-4bdc-865c-570f5a2019df" status: 200 len: 1735 microversion: 2.1 time: 0.156524 Jul 06 13:51:12.535001 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 336/666] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:51:12 2022] GET /compute/v2.1/servers/74a59be2-69eb-4bdc-865c-570f5a2019df => generated 1735 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:51:12.587650 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-fd7f507b-bf72-4ef6-9e85-ff10d6378188 tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Calling method '>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:51:12.588186 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-fd7f507b-bf72-4ef6-9e85-ff10d6378188 tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] [instance: ee2271a7-8fab-4455-9c3b-32159f33ad03] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:51:12.594110 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-fd7f507b-bf72-4ef6-9e85-ff10d6378188 tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:51:12.594566 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-fd7f507b-bf72-4ef6-9e85-ff10d6378188 tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:51:12.595335 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-fd7f507b-bf72-4ef6-9e85-ff10d6378188 tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:51:12.595770 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-fd7f507b-bf72-4ef6-9e85-ff10d6378188 tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:51:12.633827 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-3c3b6414-d822-4167-b266-405911b1b0ec tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53d00e4198e240c8a5c2fbe8bd241b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1727f66e37f94cc6971b574c8635e078', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:51:12.643674 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-3c3b6414-d822-4167-b266-405911b1b0ec tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] 10.222.0.20 "GET /compute/v2.1/servers/0a925141-db5f-4cae-bc6c-8ca4930adf73" status: 200 len: 1517 microversion: 2.1 time: 0.233038 Jul 06 13:51:12.644695 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 331/667] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:51:12 2022] GET /compute/v2.1/servers/0a925141-db5f-4cae-bc6c-8ca4930adf73 => generated 1517 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 06 13:51:12.734989 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-fd7f507b-bf72-4ef6-9e85-ff10d6378188 tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32a8191b1c184c75b428579ace2da61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bf864bb1764452e8e3a6f0d5929da9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:51:12.743487 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-fd7f507b-bf72-4ef6-9e85-ff10d6378188 tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] 10.222.0.20 "GET /compute/v2.1/servers/ee2271a7-8fab-4455-9c3b-32159f33ad03" status: 200 len: 1452 microversion: 2.1 time: 0.159777 Jul 06 13:51:12.744074 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 337/668] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:51:12 2022] GET /compute/v2.1/servers/ee2271a7-8fab-4455-9c3b-32159f33ad03 => generated 1452 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 06 13:51:12.759314 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-2452b267-1910-4187-b742-b6e5181830b8 tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:51:12.759924 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-2452b267-1910-4187-b742-b6e5181830b8 tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] [instance: ee2271a7-8fab-4455-9c3b-32159f33ad03] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:51:12.766248 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-2452b267-1910-4187-b742-b6e5181830b8 tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:51:12.766711 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-2452b267-1910-4187-b742-b6e5181830b8 tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:51:12.767455 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-2452b267-1910-4187-b742-b6e5181830b8 tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:51:12.767886 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-2452b267-1910-4187-b742-b6e5181830b8 tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:51:12.896783 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-2452b267-1910-4187-b742-b6e5181830b8 tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32a8191b1c184c75b428579ace2da61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bf864bb1764452e8e3a6f0d5929da9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:51:12.904365 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-2452b267-1910-4187-b742-b6e5181830b8 tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] 10.222.0.20 "GET /compute/v2.1/servers/ee2271a7-8fab-4455-9c3b-32159f33ad03" status: 200 len: 1452 microversion: 2.1 time: 0.148975 Jul 06 13:51:12.904926 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 332/669] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:51:12 2022] GET /compute/v2.1/servers/ee2271a7-8fab-4455-9c3b-32159f33ad03 => generated 1452 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:51:13.290292 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [req-72913e91-65ef-49f4-96cb-64e03fb887fb req-76e2b704-899b-4951-8233-c0d980b8c933 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0a925141-db5f-4cae-bc6c-8ca4930adf73", "name": "network-vif-unplugged", "status": "completed", "tag": "e0490198-5029-4543-9a66-8d41adcd3783"}]} {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 06 13:51:13.301397 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [req-72913e91-65ef-49f4-96cb-64e03fb887fb req-76e2b704-899b-4951-8233-c0d980b8c933 service nova] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:51:13.302063 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [req-72913e91-65ef-49f4-96cb-64e03fb887fb req-76e2b704-899b-4951-8233-c0d980b8c933 service nova] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:51:13.314350 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.compute.server_external_events [req-72913e91-65ef-49f4-96cb-64e03fb887fb req-76e2b704-899b-4951-8233-c0d980b8c933 service nova] Unable to find a host for instance 0a925141-db5f-4cae-bc6c-8ca4930adf73. Dropping event network-vif-unplugged {{(pid=124368) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jul 06 13:51:13.315638 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [req-72913e91-65ef-49f4-96cb-64e03fb887fb req-76e2b704-899b-4951-8233-c0d980b8c933 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.029233 Jul 06 13:51:13.316683 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 338/670] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 6 13:51:13 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 31 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Jul 06 13:51:13.350449 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-a45ebd8e-c15c-45d4-9d1b-d31232b352cf tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:51:13.351065 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-a45ebd8e-c15c-45d4-9d1b-d31232b352cf tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] [instance: 4895b615-7e9b-4a58-ac74-008e7ba87aad] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:51:13.361674 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-a45ebd8e-c15c-45d4-9d1b-d31232b352cf tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:51:13.362571 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-a45ebd8e-c15c-45d4-9d1b-d31232b352cf tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:51:13.363812 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-a45ebd8e-c15c-45d4-9d1b-d31232b352cf tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:51:13.364607 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-a45ebd8e-c15c-45d4-9d1b-d31232b352cf tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:51:13.556049 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-09dc8c00-e5eb-43dd-b70f-01e0e706d98d tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Calling method '>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:51:13.560655 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-09dc8c00-e5eb-43dd-b70f-01e0e706d98d tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] [instance: 74a59be2-69eb-4bdc-865c-570f5a2019df] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:51:13.578052 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-09dc8c00-e5eb-43dd-b70f-01e0e706d98d tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:51:13.578506 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-09dc8c00-e5eb-43dd-b70f-01e0e706d98d tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:51:13.579291 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-09dc8c00-e5eb-43dd-b70f-01e0e706d98d tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:51:13.579729 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-09dc8c00-e5eb-43dd-b70f-01e0e706d98d tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:51:13.617370 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-a45ebd8e-c15c-45d4-9d1b-d31232b352cf tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19ccda8f7ce447c490910ffa14165c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ffa9da064c64346b5f227c28a89ea81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:51:13.627478 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-a45ebd8e-c15c-45d4-9d1b-d31232b352cf tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] 10.222.0.20 "GET /compute/v2.1/servers/4895b615-7e9b-4a58-ac74-008e7ba87aad" status: 200 len: 1753 microversion: 2.1 time: 0.281555 Jul 06 13:51:13.629060 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 333/671] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:51:13 2022] GET /compute/v2.1/servers/4895b615-7e9b-4a58-ac74-008e7ba87aad => generated 1753 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:51:13.662480 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-fec7571f-5a64-42e5-9921-9a929e133c40 tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:51:13.663168 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-fec7571f-5a64-42e5-9921-9a929e133c40 tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] [instance: 0a925141-db5f-4cae-bc6c-8ca4930adf73] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:51:13.669448 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-fec7571f-5a64-42e5-9921-9a929e133c40 tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:51:13.670110 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-fec7571f-5a64-42e5-9921-9a929e133c40 tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:51:13.670887 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-fec7571f-5a64-42e5-9921-9a929e133c40 tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:51:13.671326 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-fec7571f-5a64-42e5-9921-9a929e133c40 tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:51:13.725454 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-09dc8c00-e5eb-43dd-b70f-01e0e706d98d tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c83c05bec4f456d8aa7d51732ddc8af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b2a80a004e04da7ae12db9f3f87146f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:51:13.733540 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-09dc8c00-e5eb-43dd-b70f-01e0e706d98d tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] 10.222.0.20 "GET /compute/v2.1/servers/74a59be2-69eb-4bdc-865c-570f5a2019df" status: 200 len: 1735 microversion: 2.1 time: 0.185381 Jul 06 13:51:13.734310 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 339/672] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:51:13 2022] GET /compute/v2.1/servers/74a59be2-69eb-4bdc-865c-570f5a2019df => generated 1735 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 06 13:51:13.968843 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-fec7571f-5a64-42e5-9921-9a929e133c40 tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53d00e4198e240c8a5c2fbe8bd241b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1727f66e37f94cc6971b574c8635e078', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:51:13.977534 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-fec7571f-5a64-42e5-9921-9a929e133c40 tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] 10.222.0.20 "GET /compute/v2.1/servers/0a925141-db5f-4cae-bc6c-8ca4930adf73" status: 200 len: 1573 microversion: 2.1 time: 0.319831 Jul 06 13:51:13.978362 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 334/673] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:51:13 2022] GET /compute/v2.1/servers/0a925141-db5f-4cae-bc6c-8ca4930adf73 => generated 1573 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 06 13:51:14.647875 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-012b9d3c-28c7-45f5-8dbd-f6a8ea3ec2ca tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] Calling method '>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:51:14.648721 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-012b9d3c-28c7-45f5-8dbd-f6a8ea3ec2ca tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] [instance: 4895b615-7e9b-4a58-ac74-008e7ba87aad] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:51:14.659309 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-012b9d3c-28c7-45f5-8dbd-f6a8ea3ec2ca tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:51:14.660243 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-012b9d3c-28c7-45f5-8dbd-f6a8ea3ec2ca tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:51:14.661352 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-012b9d3c-28c7-45f5-8dbd-f6a8ea3ec2ca tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:51:14.661889 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-012b9d3c-28c7-45f5-8dbd-f6a8ea3ec2ca tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:51:14.752502 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-0932ef63-dc93-417c-a28a-b7f576cb4105 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:51:14.753761 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-0932ef63-dc93-417c-a28a-b7f576cb4105 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] [instance: 74a59be2-69eb-4bdc-865c-570f5a2019df] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:51:14.760628 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-0932ef63-dc93-417c-a28a-b7f576cb4105 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:51:14.761248 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-0932ef63-dc93-417c-a28a-b7f576cb4105 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:51:14.768481 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-0932ef63-dc93-417c-a28a-b7f576cb4105 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:51:14.768939 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-0932ef63-dc93-417c-a28a-b7f576cb4105 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:51:14.809741 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-012b9d3c-28c7-45f5-8dbd-f6a8ea3ec2ca tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19ccda8f7ce447c490910ffa14165c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ffa9da064c64346b5f227c28a89ea81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:51:14.818497 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-012b9d3c-28c7-45f5-8dbd-f6a8ea3ec2ca tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] 10.222.0.20 "GET /compute/v2.1/servers/4895b615-7e9b-4a58-ac74-008e7ba87aad" status: 200 len: 1753 microversion: 2.1 time: 0.175961 Jul 06 13:51:14.819069 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 340/674] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:51:14 2022] GET /compute/v2.1/servers/4895b615-7e9b-4a58-ac74-008e7ba87aad => generated 1753 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:51:14.994519 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-4d5e341f-5497-4c5c-9d89-03f4b526bfa2 tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] Calling method '>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:51:14.995192 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-4d5e341f-5497-4c5c-9d89-03f4b526bfa2 tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] [instance: 0a925141-db5f-4cae-bc6c-8ca4930adf73] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:51:15.001303 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-4d5e341f-5497-4c5c-9d89-03f4b526bfa2 tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:51:15.001748 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-4d5e341f-5497-4c5c-9d89-03f4b526bfa2 tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:51:15.002618 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-4d5e341f-5497-4c5c-9d89-03f4b526bfa2 tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:51:15.003142 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-4d5e341f-5497-4c5c-9d89-03f4b526bfa2 tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:51:15.062774 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-0932ef63-dc93-417c-a28a-b7f576cb4105 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c83c05bec4f456d8aa7d51732ddc8af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b2a80a004e04da7ae12db9f3f87146f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:51:15.071002 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-0932ef63-dc93-417c-a28a-b7f576cb4105 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] 10.222.0.20 "GET /compute/v2.1/servers/74a59be2-69eb-4bdc-865c-570f5a2019df" status: 200 len: 1735 microversion: 2.1 time: 0.322759 Jul 06 13:51:15.071810 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 335/675] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:51:14 2022] GET /compute/v2.1/servers/74a59be2-69eb-4bdc-865c-570f5a2019df => generated 1735 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:51:15.147587 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-4d5e341f-5497-4c5c-9d89-03f4b526bfa2 tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53d00e4198e240c8a5c2fbe8bd241b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1727f66e37f94cc6971b574c8635e078', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:51:15.156179 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-4d5e341f-5497-4c5c-9d89-03f4b526bfa2 tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] 10.222.0.20 "GET /compute/v2.1/servers/0a925141-db5f-4cae-bc6c-8ca4930adf73" status: 200 len: 1573 microversion: 2.1 time: 0.165380 Jul 06 13:51:15.157681 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 341/676] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:51:14 2022] GET /compute/v2.1/servers/0a925141-db5f-4cae-bc6c-8ca4930adf73 => generated 1573 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 06 13:51:15.517336 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [req-ec2ea1fc-e18a-43a1-9055-8a5ab0a3c197 req-e0151905-b432-4610-865b-3276ac239179 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ee2271a7-8fab-4455-9c3b-32159f33ad03", "tag": "45301213-2dd0-47c7-bd88-caba9757cb8d"}]} {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 06 13:51:15.525388 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [req-ec2ea1fc-e18a-43a1-9055-8a5ab0a3c197 req-e0151905-b432-4610-865b-3276ac239179 service nova] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:51:15.525841 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [req-ec2ea1fc-e18a-43a1-9055-8a5ab0a3c197 req-e0151905-b432-4610-865b-3276ac239179 service nova] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:51:15.537988 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.compute.server_external_events [req-ec2ea1fc-e18a-43a1-9055-8a5ab0a3c197 req-e0151905-b432-4610-865b-3276ac239179 service nova] Creating event network-changed:45301213-2dd0-47c7-bd88-caba9757cb8d for instance ee2271a7-8fab-4455-9c3b-32159f33ad03 on hv-cinder-81914 Jul 06 13:51:15.544978 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [req-ec2ea1fc-e18a-43a1-9055-8a5ab0a3c197 req-e0151905-b432-4610-865b-3276ac239179 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084911 Jul 06 13:51:15.545609 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 336/677] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 6 13:51:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 06 13:51:15.835836 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-a89aec9a-31f9-4f54-8671-682273dd4237 tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] Calling method '>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:51:15.836208 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-a89aec9a-31f9-4f54-8671-682273dd4237 tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] [instance: 4895b615-7e9b-4a58-ac74-008e7ba87aad] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:51:15.843982 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-a89aec9a-31f9-4f54-8671-682273dd4237 tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:51:15.844564 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-a89aec9a-31f9-4f54-8671-682273dd4237 tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:51:15.845389 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-a89aec9a-31f9-4f54-8671-682273dd4237 tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:51:15.845837 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-a89aec9a-31f9-4f54-8671-682273dd4237 tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:51:15.988882 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-a89aec9a-31f9-4f54-8671-682273dd4237 tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19ccda8f7ce447c490910ffa14165c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ffa9da064c64346b5f227c28a89ea81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:51:15.997018 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-a89aec9a-31f9-4f54-8671-682273dd4237 tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] 10.222.0.20 "GET /compute/v2.1/servers/4895b615-7e9b-4a58-ac74-008e7ba87aad" status: 200 len: 1756 microversion: 2.1 time: 0.165766 Jul 06 13:51:15.997683 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 342/678] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:51:15 2022] GET /compute/v2.1/servers/4895b615-7e9b-4a58-ac74-008e7ba87aad => generated 1756 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:51:16.089077 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-14595d8b-8d44-436b-b9bf-5190b0bc4494 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:51:16.089786 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-14595d8b-8d44-436b-b9bf-5190b0bc4494 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] [instance: 74a59be2-69eb-4bdc-865c-570f5a2019df] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:51:16.095833 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-14595d8b-8d44-436b-b9bf-5190b0bc4494 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:51:16.096278 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-14595d8b-8d44-436b-b9bf-5190b0bc4494 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:51:16.097848 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-14595d8b-8d44-436b-b9bf-5190b0bc4494 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:51:16.098409 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-14595d8b-8d44-436b-b9bf-5190b0bc4494 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:51:16.116527 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG dbcounter [-] [124367] Writing DB stats nova_cell1:SELECT=100 {{(pid=124367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:51:16.173924 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-1b093436-611b-4348-87f6-54babff546fe tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] Calling method '>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:51:16.174519 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-1b093436-611b-4348-87f6-54babff546fe tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] [instance: 0a925141-db5f-4cae-bc6c-8ca4930adf73] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:51:16.181340 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-1b093436-611b-4348-87f6-54babff546fe tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:51:16.181802 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-1b093436-611b-4348-87f6-54babff546fe tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:51:16.182589 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-1b093436-611b-4348-87f6-54babff546fe tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:51:16.183061 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-1b093436-611b-4348-87f6-54babff546fe tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:51:16.242792 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-14595d8b-8d44-436b-b9bf-5190b0bc4494 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c83c05bec4f456d8aa7d51732ddc8af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b2a80a004e04da7ae12db9f3f87146f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:51:16.251544 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-14595d8b-8d44-436b-b9bf-5190b0bc4494 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] 10.222.0.20 "GET /compute/v2.1/servers/74a59be2-69eb-4bdc-865c-570f5a2019df" status: 200 len: 1735 microversion: 2.1 time: 0.167131 Jul 06 13:51:16.252199 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 337/679] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:51:16 2022] GET /compute/v2.1/servers/74a59be2-69eb-4bdc-865c-570f5a2019df => generated 1735 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:51:16.329494 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-1b093436-611b-4348-87f6-54babff546fe tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53d00e4198e240c8a5c2fbe8bd241b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1727f66e37f94cc6971b574c8635e078', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:51:16.338653 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-1b093436-611b-4348-87f6-54babff546fe tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] 10.222.0.20 "GET /compute/v2.1/servers/0a925141-db5f-4cae-bc6c-8ca4930adf73" status: 200 len: 1573 microversion: 2.1 time: 0.168586 Jul 06 13:51:16.339447 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 343/680] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:51:16 2022] GET /compute/v2.1/servers/0a925141-db5f-4cae-bc6c-8ca4930adf73 => generated 1573 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 06 13:51:17.267979 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-8837a0e8-b8e7-4c7e-bec1-e6acf4cc0906 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:51:17.268689 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-8837a0e8-b8e7-4c7e-bec1-e6acf4cc0906 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] [instance: 74a59be2-69eb-4bdc-865c-570f5a2019df] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:51:17.275511 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-8837a0e8-b8e7-4c7e-bec1-e6acf4cc0906 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:51:17.275992 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-8837a0e8-b8e7-4c7e-bec1-e6acf4cc0906 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:51:17.276772 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-8837a0e8-b8e7-4c7e-bec1-e6acf4cc0906 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:51:17.277265 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-8837a0e8-b8e7-4c7e-bec1-e6acf4cc0906 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:51:17.357812 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-7bb34937-c2c7-473a-a0dd-e72b536b03e3 tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] Calling method '>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:51:17.358450 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-7bb34937-c2c7-473a-a0dd-e72b536b03e3 tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] [instance: 0a925141-db5f-4cae-bc6c-8ca4930adf73] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:51:17.366165 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-7bb34937-c2c7-473a-a0dd-e72b536b03e3 tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:51:17.366622 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-7bb34937-c2c7-473a-a0dd-e72b536b03e3 tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:51:17.367398 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-7bb34937-c2c7-473a-a0dd-e72b536b03e3 tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:51:17.367837 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-7bb34937-c2c7-473a-a0dd-e72b536b03e3 tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:51:17.410332 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-8837a0e8-b8e7-4c7e-bec1-e6acf4cc0906 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c83c05bec4f456d8aa7d51732ddc8af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b2a80a004e04da7ae12db9f3f87146f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:51:17.418328 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-8837a0e8-b8e7-4c7e-bec1-e6acf4cc0906 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] 10.222.0.20 "GET /compute/v2.1/servers/74a59be2-69eb-4bdc-865c-570f5a2019df" status: 200 len: 1735 microversion: 2.1 time: 0.154117 Jul 06 13:51:17.418918 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 338/681] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:51:17 2022] GET /compute/v2.1/servers/74a59be2-69eb-4bdc-865c-570f5a2019df => generated 1735 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:51:17.501251 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-7bb34937-c2c7-473a-a0dd-e72b536b03e3 tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53d00e4198e240c8a5c2fbe8bd241b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1727f66e37f94cc6971b574c8635e078', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:51:17.508659 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-7bb34937-c2c7-473a-a0dd-e72b536b03e3 tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] 10.222.0.20 "GET /compute/v2.1/servers/0a925141-db5f-4cae-bc6c-8ca4930adf73" status: 200 len: 1573 microversion: 2.1 time: 0.154735 Jul 06 13:51:17.509322 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 344/682] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:51:17 2022] GET /compute/v2.1/servers/0a925141-db5f-4cae-bc6c-8ca4930adf73 => generated 1573 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 06 13:51:18.435619 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-9e6f5825-27a7-4704-904c-8a4c2ad37066 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:51:18.436258 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-9e6f5825-27a7-4704-904c-8a4c2ad37066 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] [instance: 74a59be2-69eb-4bdc-865c-570f5a2019df] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:51:18.443627 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-9e6f5825-27a7-4704-904c-8a4c2ad37066 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:51:18.444080 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-9e6f5825-27a7-4704-904c-8a4c2ad37066 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:51:18.444847 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-9e6f5825-27a7-4704-904c-8a4c2ad37066 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:51:18.445314 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-9e6f5825-27a7-4704-904c-8a4c2ad37066 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:51:18.524798 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-fa87fa64-95ea-404c-a173-3b264ec7985a tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] Calling method '>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:51:18.525549 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-fa87fa64-95ea-404c-a173-3b264ec7985a tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] [instance: 0a925141-db5f-4cae-bc6c-8ca4930adf73] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:51:18.532051 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-fa87fa64-95ea-404c-a173-3b264ec7985a tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:51:18.532498 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-fa87fa64-95ea-404c-a173-3b264ec7985a tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:51:18.533304 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-fa87fa64-95ea-404c-a173-3b264ec7985a tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:51:18.533739 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-fa87fa64-95ea-404c-a173-3b264ec7985a tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:51:18.585628 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-9e6f5825-27a7-4704-904c-8a4c2ad37066 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c83c05bec4f456d8aa7d51732ddc8af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b2a80a004e04da7ae12db9f3f87146f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:51:18.593636 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-9e6f5825-27a7-4704-904c-8a4c2ad37066 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] 10.222.0.20 "GET /compute/v2.1/servers/74a59be2-69eb-4bdc-865c-570f5a2019df" status: 200 len: 1735 microversion: 2.1 time: 0.161841 Jul 06 13:51:18.594201 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 339/683] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:51:18 2022] GET /compute/v2.1/servers/74a59be2-69eb-4bdc-865c-570f5a2019df => generated 1735 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:51:18.665157 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-fa87fa64-95ea-404c-a173-3b264ec7985a tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53d00e4198e240c8a5c2fbe8bd241b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1727f66e37f94cc6971b574c8635e078', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:51:18.673263 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-fa87fa64-95ea-404c-a173-3b264ec7985a tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] 10.222.0.20 "GET /compute/v2.1/servers/0a925141-db5f-4cae-bc6c-8ca4930adf73" status: 200 len: 1573 microversion: 2.1 time: 0.152242 Jul 06 13:51:18.673839 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 345/684] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:51:18 2022] GET /compute/v2.1/servers/0a925141-db5f-4cae-bc6c-8ca4930adf73 => generated 1573 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 06 13:51:19.611152 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-7f20091b-faa3-4527-a65a-f4ea578f3811 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:51:19.611679 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-7f20091b-faa3-4527-a65a-f4ea578f3811 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] [instance: 74a59be2-69eb-4bdc-865c-570f5a2019df] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:51:19.618167 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-7f20091b-faa3-4527-a65a-f4ea578f3811 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:51:19.618612 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-7f20091b-faa3-4527-a65a-f4ea578f3811 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:51:19.619363 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-7f20091b-faa3-4527-a65a-f4ea578f3811 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:51:19.619791 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-7f20091b-faa3-4527-a65a-f4ea578f3811 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:51:19.692274 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-9886c127-1312-4c4c-8676-b30c73036084 tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] Calling method '>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:51:19.692810 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-9886c127-1312-4c4c-8676-b30c73036084 tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] [instance: 0a925141-db5f-4cae-bc6c-8ca4930adf73] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:51:19.697378 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG dbcounter [-] [124368] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=124368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:51:19.700939 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-9886c127-1312-4c4c-8676-b30c73036084 tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:51:19.701424 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-9886c127-1312-4c4c-8676-b30c73036084 tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:51:19.702198 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-9886c127-1312-4c4c-8676-b30c73036084 tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:51:19.702630 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-9886c127-1312-4c4c-8676-b30c73036084 tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:51:19.750127 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-7f20091b-faa3-4527-a65a-f4ea578f3811 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c83c05bec4f456d8aa7d51732ddc8af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b2a80a004e04da7ae12db9f3f87146f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:51:19.759053 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-7f20091b-faa3-4527-a65a-f4ea578f3811 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] 10.222.0.20 "GET /compute/v2.1/servers/74a59be2-69eb-4bdc-865c-570f5a2019df" status: 200 len: 1735 microversion: 2.1 time: 0.152047 Jul 06 13:51:19.759627 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 340/685] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:51:19 2022] GET /compute/v2.1/servers/74a59be2-69eb-4bdc-865c-570f5a2019df => generated 1735 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:51:19.837592 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-9886c127-1312-4c4c-8676-b30c73036084 tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53d00e4198e240c8a5c2fbe8bd241b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1727f66e37f94cc6971b574c8635e078', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:51:19.844949 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-9886c127-1312-4c4c-8676-b30c73036084 tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] 10.222.0.20 "GET /compute/v2.1/servers/0a925141-db5f-4cae-bc6c-8ca4930adf73" status: 200 len: 1573 microversion: 2.1 time: 0.157620 Jul 06 13:51:19.845546 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 346/686] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:51:19 2022] GET /compute/v2.1/servers/0a925141-db5f-4cae-bc6c-8ca4930adf73 => generated 1573 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 06 13:51:20.777106 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-65afa3cb-a987-4fb3-8dee-d1a399ec8cb6 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:51:20.777717 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-65afa3cb-a987-4fb3-8dee-d1a399ec8cb6 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] [instance: 74a59be2-69eb-4bdc-865c-570f5a2019df] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:51:20.780019 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG dbcounter [-] [124367] Writing DB stats nova_api:SELECT=81 {{(pid=124367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:51:20.786492 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-65afa3cb-a987-4fb3-8dee-d1a399ec8cb6 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:51:20.786942 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-65afa3cb-a987-4fb3-8dee-d1a399ec8cb6 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:51:20.787705 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-65afa3cb-a987-4fb3-8dee-d1a399ec8cb6 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:51:20.788140 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-65afa3cb-a987-4fb3-8dee-d1a399ec8cb6 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:51:20.862602 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-4d792d6c-8127-45e5-8eb3-70115e31f02f tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] Calling method '>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:51:20.863324 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-4d792d6c-8127-45e5-8eb3-70115e31f02f tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] [instance: 0a925141-db5f-4cae-bc6c-8ca4930adf73] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:51:20.869739 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-4d792d6c-8127-45e5-8eb3-70115e31f02f tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:51:20.870183 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-4d792d6c-8127-45e5-8eb3-70115e31f02f tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:51:20.870942 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-4d792d6c-8127-45e5-8eb3-70115e31f02f tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:51:20.871374 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-4d792d6c-8127-45e5-8eb3-70115e31f02f tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:51:20.918669 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-65afa3cb-a987-4fb3-8dee-d1a399ec8cb6 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c83c05bec4f456d8aa7d51732ddc8af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b2a80a004e04da7ae12db9f3f87146f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:51:20.927349 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-65afa3cb-a987-4fb3-8dee-d1a399ec8cb6 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] 10.222.0.20 "GET /compute/v2.1/servers/74a59be2-69eb-4bdc-865c-570f5a2019df" status: 200 len: 1735 microversion: 2.1 time: 0.154130 Jul 06 13:51:20.927912 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 341/687] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:51:20 2022] GET /compute/v2.1/servers/74a59be2-69eb-4bdc-865c-570f5a2019df => generated 1735 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:51:21.003352 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-4d792d6c-8127-45e5-8eb3-70115e31f02f tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53d00e4198e240c8a5c2fbe8bd241b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1727f66e37f94cc6971b574c8635e078', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:51:21.010760 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-4d792d6c-8127-45e5-8eb3-70115e31f02f tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] 10.222.0.20 "GET /compute/v2.1/servers/0a925141-db5f-4cae-bc6c-8ca4930adf73" status: 200 len: 1573 microversion: 2.1 time: 0.152062 Jul 06 13:51:21.011363 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 347/688] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:51:20 2022] GET /compute/v2.1/servers/0a925141-db5f-4cae-bc6c-8ca4930adf73 => generated 1573 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 06 13:51:21.944509 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-bafbbe41-50a9-43f9-9062-1c87c2f7bcf4 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:51:21.945146 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-bafbbe41-50a9-43f9-9062-1c87c2f7bcf4 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] [instance: 74a59be2-69eb-4bdc-865c-570f5a2019df] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:51:21.951483 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-bafbbe41-50a9-43f9-9062-1c87c2f7bcf4 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:51:21.951930 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-bafbbe41-50a9-43f9-9062-1c87c2f7bcf4 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:51:21.952685 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-bafbbe41-50a9-43f9-9062-1c87c2f7bcf4 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:51:21.953184 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-bafbbe41-50a9-43f9-9062-1c87c2f7bcf4 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:51:22.028159 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-863d6ef7-3788-47d4-8549-14c682f02d45 tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] Calling method '>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:51:22.028777 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-863d6ef7-3788-47d4-8549-14c682f02d45 tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] [instance: 0a925141-db5f-4cae-bc6c-8ca4930adf73] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:51:22.036285 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-863d6ef7-3788-47d4-8549-14c682f02d45 tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:51:22.036741 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-863d6ef7-3788-47d4-8549-14c682f02d45 tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:51:22.037541 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-863d6ef7-3788-47d4-8549-14c682f02d45 tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:51:22.037982 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-863d6ef7-3788-47d4-8549-14c682f02d45 tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:51:22.084356 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-bafbbe41-50a9-43f9-9062-1c87c2f7bcf4 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c83c05bec4f456d8aa7d51732ddc8af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b2a80a004e04da7ae12db9f3f87146f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:51:22.093416 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-bafbbe41-50a9-43f9-9062-1c87c2f7bcf4 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] 10.222.0.20 "GET /compute/v2.1/servers/74a59be2-69eb-4bdc-865c-570f5a2019df" status: 200 len: 1735 microversion: 2.1 time: 0.152899 Jul 06 13:51:22.093991 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 342/689] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:51:21 2022] GET /compute/v2.1/servers/74a59be2-69eb-4bdc-865c-570f5a2019df => generated 1735 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 06 13:51:22.174317 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-863d6ef7-3788-47d4-8549-14c682f02d45 tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53d00e4198e240c8a5c2fbe8bd241b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1727f66e37f94cc6971b574c8635e078', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:51:22.182028 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-863d6ef7-3788-47d4-8549-14c682f02d45 tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] 10.222.0.20 "GET /compute/v2.1/servers/0a925141-db5f-4cae-bc6c-8ca4930adf73" status: 200 len: 1573 microversion: 2.1 time: 0.157823 Jul 06 13:51:22.182594 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 348/690] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:51:22 2022] GET /compute/v2.1/servers/0a925141-db5f-4cae-bc6c-8ca4930adf73 => generated 1573 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 06 13:51:23.111101 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-ef952f1d-c4af-40ac-a23a-b634eada961c tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:51:23.111699 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-ef952f1d-c4af-40ac-a23a-b634eada961c tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] [instance: 74a59be2-69eb-4bdc-865c-570f5a2019df] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:51:23.118692 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-ef952f1d-c4af-40ac-a23a-b634eada961c tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:51:23.119132 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-ef952f1d-c4af-40ac-a23a-b634eada961c tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:51:23.119882 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-ef952f1d-c4af-40ac-a23a-b634eada961c tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:51:23.120307 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-ef952f1d-c4af-40ac-a23a-b634eada961c tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:51:23.198675 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-ed656499-760c-4d33-a8fe-a0ebbc6184fd tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] Calling method '>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:51:23.199401 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-ed656499-760c-4d33-a8fe-a0ebbc6184fd tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] [instance: 0a925141-db5f-4cae-bc6c-8ca4930adf73] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:51:23.206005 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-ed656499-760c-4d33-a8fe-a0ebbc6184fd tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:51:23.206389 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-ed656499-760c-4d33-a8fe-a0ebbc6184fd tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:51:23.207375 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-ed656499-760c-4d33-a8fe-a0ebbc6184fd tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:51:23.207798 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-ed656499-760c-4d33-a8fe-a0ebbc6184fd tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:51:23.253708 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-ef952f1d-c4af-40ac-a23a-b634eada961c tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c83c05bec4f456d8aa7d51732ddc8af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b2a80a004e04da7ae12db9f3f87146f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:51:23.261868 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-ef952f1d-c4af-40ac-a23a-b634eada961c tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] 10.222.0.20 "GET /compute/v2.1/servers/74a59be2-69eb-4bdc-865c-570f5a2019df" status: 200 len: 1735 microversion: 2.1 time: 0.154623 Jul 06 13:51:23.262619 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 343/691] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:51:23 2022] GET /compute/v2.1/servers/74a59be2-69eb-4bdc-865c-570f5a2019df => generated 1735 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 06 13:51:23.339132 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-ed656499-760c-4d33-a8fe-a0ebbc6184fd tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53d00e4198e240c8a5c2fbe8bd241b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1727f66e37f94cc6971b574c8635e078', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:51:23.348501 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-ed656499-760c-4d33-a8fe-a0ebbc6184fd tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] 10.222.0.20 "GET /compute/v2.1/servers/0a925141-db5f-4cae-bc6c-8ca4930adf73" status: 200 len: 1573 microversion: 2.1 time: 0.152910 Jul 06 13:51:23.349225 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 349/692] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:51:23 2022] GET /compute/v2.1/servers/0a925141-db5f-4cae-bc6c-8ca4930adf73 => generated 1573 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 06 13:51:24.279162 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-f3de475b-639c-4203-894c-940ce7a4e1e6 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:51:24.279801 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-f3de475b-639c-4203-894c-940ce7a4e1e6 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] [instance: 74a59be2-69eb-4bdc-865c-570f5a2019df] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:51:24.286398 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-f3de475b-639c-4203-894c-940ce7a4e1e6 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:51:24.286848 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-f3de475b-639c-4203-894c-940ce7a4e1e6 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:51:24.287609 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-f3de475b-639c-4203-894c-940ce7a4e1e6 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:51:24.288044 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-f3de475b-639c-4203-894c-940ce7a4e1e6 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:51:24.366243 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-b41728d1-e71a-4948-9769-47c34c051ff9 tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] Calling method '>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:51:24.366994 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-b41728d1-e71a-4948-9769-47c34c051ff9 tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] [instance: 0a925141-db5f-4cae-bc6c-8ca4930adf73] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:51:24.373561 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-b41728d1-e71a-4948-9769-47c34c051ff9 tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:51:24.374066 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-b41728d1-e71a-4948-9769-47c34c051ff9 tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:51:24.374853 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-b41728d1-e71a-4948-9769-47c34c051ff9 tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:51:24.375287 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-b41728d1-e71a-4948-9769-47c34c051ff9 tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:51:24.396186 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG dbcounter [-] [124368] Writing DB stats nova_cell1:UPDATE=1,nova_cell1:SELECT=98,nova_cell1:INSERT=1 {{(pid=124368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:51:24.422429 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-f3de475b-639c-4203-894c-940ce7a4e1e6 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c83c05bec4f456d8aa7d51732ddc8af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b2a80a004e04da7ae12db9f3f87146f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:51:24.431196 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-f3de475b-639c-4203-894c-940ce7a4e1e6 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] 10.222.0.20 "GET /compute/v2.1/servers/74a59be2-69eb-4bdc-865c-570f5a2019df" status: 200 len: 1735 microversion: 2.1 time: 0.155878 Jul 06 13:51:24.431765 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 344/693] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:51:24 2022] GET /compute/v2.1/servers/74a59be2-69eb-4bdc-865c-570f5a2019df => generated 1735 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:51:24.514007 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-b41728d1-e71a-4948-9769-47c34c051ff9 tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53d00e4198e240c8a5c2fbe8bd241b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1727f66e37f94cc6971b574c8635e078', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:51:24.522017 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-b41728d1-e71a-4948-9769-47c34c051ff9 tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] 10.222.0.20 "GET /compute/v2.1/servers/0a925141-db5f-4cae-bc6c-8ca4930adf73" status: 200 len: 1573 microversion: 2.1 time: 0.160255 Jul 06 13:51:24.522598 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 350/694] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:51:24 2022] GET /compute/v2.1/servers/0a925141-db5f-4cae-bc6c-8ca4930adf73 => generated 1573 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 06 13:51:25.448141 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-f5e1abb4-a7ca-4aed-b33c-1b0701954fab tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:51:25.448804 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-f5e1abb4-a7ca-4aed-b33c-1b0701954fab tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] [instance: 74a59be2-69eb-4bdc-865c-570f5a2019df] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:51:25.455189 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-f5e1abb4-a7ca-4aed-b33c-1b0701954fab tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:51:25.455633 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-f5e1abb4-a7ca-4aed-b33c-1b0701954fab tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:51:25.456394 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-f5e1abb4-a7ca-4aed-b33c-1b0701954fab tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:51:25.456857 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-f5e1abb4-a7ca-4aed-b33c-1b0701954fab tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:51:25.539052 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-e3ef17c0-1b48-437e-869e-3c556915d1db tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] Calling method '>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:51:25.539674 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-e3ef17c0-1b48-437e-869e-3c556915d1db tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] [instance: 0a925141-db5f-4cae-bc6c-8ca4930adf73] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:51:25.546237 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-e3ef17c0-1b48-437e-869e-3c556915d1db tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:51:25.546609 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-e3ef17c0-1b48-437e-869e-3c556915d1db tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:51:25.547375 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-e3ef17c0-1b48-437e-869e-3c556915d1db tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:51:25.547814 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-e3ef17c0-1b48-437e-869e-3c556915d1db tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:51:25.594442 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-f5e1abb4-a7ca-4aed-b33c-1b0701954fab tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c83c05bec4f456d8aa7d51732ddc8af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b2a80a004e04da7ae12db9f3f87146f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:51:25.602633 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-f5e1abb4-a7ca-4aed-b33c-1b0701954fab tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] 10.222.0.20 "GET /compute/v2.1/servers/74a59be2-69eb-4bdc-865c-570f5a2019df" status: 200 len: 1735 microversion: 2.1 time: 0.158333 Jul 06 13:51:25.603199 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 345/695] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:51:25 2022] GET /compute/v2.1/servers/74a59be2-69eb-4bdc-865c-570f5a2019df => generated 1735 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:51:25.682836 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-e3ef17c0-1b48-437e-869e-3c556915d1db tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53d00e4198e240c8a5c2fbe8bd241b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1727f66e37f94cc6971b574c8635e078', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:51:25.690394 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-e3ef17c0-1b48-437e-869e-3c556915d1db tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] 10.222.0.20 "GET /compute/v2.1/servers/0a925141-db5f-4cae-bc6c-8ca4930adf73" status: 200 len: 1573 microversion: 2.1 time: 0.155512 Jul 06 13:51:25.690963 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 351/696] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:51:25 2022] GET /compute/v2.1/servers/0a925141-db5f-4cae-bc6c-8ca4930adf73 => generated 1573 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 06 13:51:26.619865 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-65549399-cb58-4b21-9cee-fc4b8e92a12e tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:51:26.620489 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-65549399-cb58-4b21-9cee-fc4b8e92a12e tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] [instance: 74a59be2-69eb-4bdc-865c-570f5a2019df] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:51:26.627161 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-65549399-cb58-4b21-9cee-fc4b8e92a12e tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:51:26.627603 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-65549399-cb58-4b21-9cee-fc4b8e92a12e tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:51:26.628627 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-65549399-cb58-4b21-9cee-fc4b8e92a12e tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:51:26.629089 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-65549399-cb58-4b21-9cee-fc4b8e92a12e tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:51:26.708902 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-938c76f4-93e0-4f8f-83c8-0e98ab5a6ef0 tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] Calling method '>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:51:26.709680 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-938c76f4-93e0-4f8f-83c8-0e98ab5a6ef0 tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] [instance: 0a925141-db5f-4cae-bc6c-8ca4930adf73] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:51:26.716036 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-938c76f4-93e0-4f8f-83c8-0e98ab5a6ef0 tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:51:26.716753 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-938c76f4-93e0-4f8f-83c8-0e98ab5a6ef0 tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:51:26.717559 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-938c76f4-93e0-4f8f-83c8-0e98ab5a6ef0 tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:51:26.717998 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-938c76f4-93e0-4f8f-83c8-0e98ab5a6ef0 tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:51:26.766274 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-65549399-cb58-4b21-9cee-fc4b8e92a12e tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c83c05bec4f456d8aa7d51732ddc8af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b2a80a004e04da7ae12db9f3f87146f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:51:26.774699 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-65549399-cb58-4b21-9cee-fc4b8e92a12e tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] 10.222.0.20 "GET /compute/v2.1/servers/74a59be2-69eb-4bdc-865c-570f5a2019df" status: 200 len: 1735 microversion: 2.1 time: 0.158648 Jul 06 13:51:26.775270 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 346/697] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:51:26 2022] GET /compute/v2.1/servers/74a59be2-69eb-4bdc-865c-570f5a2019df => generated 1735 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:51:26.847788 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-938c76f4-93e0-4f8f-83c8-0e98ab5a6ef0 tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53d00e4198e240c8a5c2fbe8bd241b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1727f66e37f94cc6971b574c8635e078', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:51:26.856014 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-938c76f4-93e0-4f8f-83c8-0e98ab5a6ef0 tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] 10.222.0.20 "GET /compute/v2.1/servers/0a925141-db5f-4cae-bc6c-8ca4930adf73" status: 200 len: 1573 microversion: 2.1 time: 0.151800 Jul 06 13:51:26.856582 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 352/698] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:51:26 2022] GET /compute/v2.1/servers/0a925141-db5f-4cae-bc6c-8ca4930adf73 => generated 1573 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:51:27.792043 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-f245cd4d-229e-4580-9c00-16da27ca9945 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:51:27.792657 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-f245cd4d-229e-4580-9c00-16da27ca9945 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] [instance: 74a59be2-69eb-4bdc-865c-570f5a2019df] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:51:27.800077 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-f245cd4d-229e-4580-9c00-16da27ca9945 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:51:27.800536 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-f245cd4d-229e-4580-9c00-16da27ca9945 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:51:27.801332 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-f245cd4d-229e-4580-9c00-16da27ca9945 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:51:27.801771 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-f245cd4d-229e-4580-9c00-16da27ca9945 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:51:27.874225 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-0cf7d119-ae5d-4dd3-9f84-433d2006e86d tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] Calling method '>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:51:27.875632 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-0cf7d119-ae5d-4dd3-9f84-433d2006e86d tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] [instance: 0a925141-db5f-4cae-bc6c-8ca4930adf73] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:51:27.882780 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-0cf7d119-ae5d-4dd3-9f84-433d2006e86d tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:51:27.883506 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-0cf7d119-ae5d-4dd3-9f84-433d2006e86d tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:51:27.884513 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-0cf7d119-ae5d-4dd3-9f84-433d2006e86d tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:51:27.885914 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-0cf7d119-ae5d-4dd3-9f84-433d2006e86d tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:51:27.943018 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-f245cd4d-229e-4580-9c00-16da27ca9945 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c83c05bec4f456d8aa7d51732ddc8af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b2a80a004e04da7ae12db9f3f87146f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:51:27.954102 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-f245cd4d-229e-4580-9c00-16da27ca9945 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] 10.222.0.20 "GET /compute/v2.1/servers/74a59be2-69eb-4bdc-865c-570f5a2019df" status: 200 len: 1735 microversion: 2.1 time: 0.165779 Jul 06 13:51:27.966317 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 347/699] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:51:27 2022] GET /compute/v2.1/servers/74a59be2-69eb-4bdc-865c-570f5a2019df => generated 1735 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:51:28.040131 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [req-64b5b36e-ade7-4bcd-92dd-029cb3f1ed95 req-b6eab772-d7af-45b0-aeb3-770f3320eed6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0a925141-db5f-4cae-bc6c-8ca4930adf73", "name": "network-vif-plugged", "status": "completed", "tag": "e0490198-5029-4543-9a66-8d41adcd3783"}]} {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 06 13:51:28.044955 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-0cf7d119-ae5d-4dd3-9f84-433d2006e86d tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53d00e4198e240c8a5c2fbe8bd241b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1727f66e37f94cc6971b574c8635e078', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:51:28.048215 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [req-64b5b36e-ade7-4bcd-92dd-029cb3f1ed95 req-b6eab772-d7af-45b0-aeb3-770f3320eed6 service nova] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:51:28.048859 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [req-64b5b36e-ade7-4bcd-92dd-029cb3f1ed95 req-b6eab772-d7af-45b0-aeb3-770f3320eed6 service nova] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:51:28.053239 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-0cf7d119-ae5d-4dd3-9f84-433d2006e86d tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] 10.222.0.20 "GET /compute/v2.1/servers/0a925141-db5f-4cae-bc6c-8ca4930adf73" status: 200 len: 1573 microversion: 2.1 time: 0.183773 Jul 06 13:51:28.053812 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 353/700] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:51:27 2022] GET /compute/v2.1/servers/0a925141-db5f-4cae-bc6c-8ca4930adf73 => generated 1573 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 06 13:51:28.060702 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.compute.server_external_events [req-64b5b36e-ade7-4bcd-92dd-029cb3f1ed95 req-b6eab772-d7af-45b0-aeb3-770f3320eed6 service nova] Creating event network-vif-plugged:e0490198-5029-4543-9a66-8d41adcd3783 for instance 0a925141-db5f-4cae-bc6c-8ca4930adf73 on hv-cinder-81914 Jul 06 13:51:28.065630 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [req-64b5b36e-ade7-4bcd-92dd-029cb3f1ed95 req-b6eab772-d7af-45b0-aeb3-770f3320eed6 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097755 Jul 06 13:51:28.066206 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 348/701] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 6 13:51:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 06 13:51:28.973294 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-bf6820f9-0fed-4553-a4e9-475a8a5a731d tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Calling method '>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:51:28.974318 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-bf6820f9-0fed-4553-a4e9-475a8a5a731d tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] [instance: 74a59be2-69eb-4bdc-865c-570f5a2019df] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:51:28.980265 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-bf6820f9-0fed-4553-a4e9-475a8a5a731d tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:51:28.980717 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-bf6820f9-0fed-4553-a4e9-475a8a5a731d tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:51:28.981501 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-bf6820f9-0fed-4553-a4e9-475a8a5a731d tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:51:28.981938 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-bf6820f9-0fed-4553-a4e9-475a8a5a731d tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:51:29.071573 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-4430804a-86e2-4d57-bc2f-ad77b71ca613 tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:51:29.072382 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-4430804a-86e2-4d57-bc2f-ad77b71ca613 tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] [instance: 0a925141-db5f-4cae-bc6c-8ca4930adf73] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:51:29.079523 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-4430804a-86e2-4d57-bc2f-ad77b71ca613 tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:51:29.079989 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-4430804a-86e2-4d57-bc2f-ad77b71ca613 tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:51:29.080838 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-4430804a-86e2-4d57-bc2f-ad77b71ca613 tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:51:29.081374 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-4430804a-86e2-4d57-bc2f-ad77b71ca613 tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:51:29.113579 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-bf6820f9-0fed-4553-a4e9-475a8a5a731d tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c83c05bec4f456d8aa7d51732ddc8af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b2a80a004e04da7ae12db9f3f87146f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:51:29.122195 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-bf6820f9-0fed-4553-a4e9-475a8a5a731d tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] 10.222.0.20 "GET /compute/v2.1/servers/74a59be2-69eb-4bdc-865c-570f5a2019df" status: 200 len: 1735 microversion: 2.1 time: 0.152754 Jul 06 13:51:29.122772 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 354/702] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:51:28 2022] GET /compute/v2.1/servers/74a59be2-69eb-4bdc-865c-570f5a2019df => generated 1735 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:51:29.216206 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-4430804a-86e2-4d57-bc2f-ad77b71ca613 tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53d00e4198e240c8a5c2fbe8bd241b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1727f66e37f94cc6971b574c8635e078', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:51:29.224227 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-4430804a-86e2-4d57-bc2f-ad77b71ca613 tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] 10.222.0.20 "GET /compute/v2.1/servers/0a925141-db5f-4cae-bc6c-8ca4930adf73" status: 200 len: 1573 microversion: 2.1 time: 0.157580 Jul 06 13:51:29.224789 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 349/703] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:51:29 2022] GET /compute/v2.1/servers/0a925141-db5f-4cae-bc6c-8ca4930adf73 => generated 1573 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 06 13:51:30.140246 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-bd2fe92f-147e-4ebf-bd4e-90b12215c711 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Calling method '>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:51:30.140857 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-bd2fe92f-147e-4ebf-bd4e-90b12215c711 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] [instance: 74a59be2-69eb-4bdc-865c-570f5a2019df] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:51:30.147930 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-bd2fe92f-147e-4ebf-bd4e-90b12215c711 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:51:30.148388 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-bd2fe92f-147e-4ebf-bd4e-90b12215c711 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:51:30.149204 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-bd2fe92f-147e-4ebf-bd4e-90b12215c711 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:51:30.149645 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-bd2fe92f-147e-4ebf-bd4e-90b12215c711 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:51:30.241622 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-665515ad-80f9-4650-8948-598b71e9ab78 tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:51:30.242235 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-665515ad-80f9-4650-8948-598b71e9ab78 tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] [instance: 0a925141-db5f-4cae-bc6c-8ca4930adf73] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:51:30.249196 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-665515ad-80f9-4650-8948-598b71e9ab78 tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:51:30.249656 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-665515ad-80f9-4650-8948-598b71e9ab78 tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:51:30.250439 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-665515ad-80f9-4650-8948-598b71e9ab78 tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:51:30.250872 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-665515ad-80f9-4650-8948-598b71e9ab78 tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:51:30.283342 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-bd2fe92f-147e-4ebf-bd4e-90b12215c711 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c83c05bec4f456d8aa7d51732ddc8af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b2a80a004e04da7ae12db9f3f87146f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:51:30.291892 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-bd2fe92f-147e-4ebf-bd4e-90b12215c711 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] 10.222.0.20 "GET /compute/v2.1/servers/74a59be2-69eb-4bdc-865c-570f5a2019df" status: 200 len: 1715 microversion: 2.1 time: 0.155816 Jul 06 13:51:30.292713 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 355/704] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:51:30 2022] GET /compute/v2.1/servers/74a59be2-69eb-4bdc-865c-570f5a2019df => generated 1715 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:51:30.347677 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-7cc5b853-6508-4d26-bc0d-b5baa43d8a9c tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Calling method '>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:51:30.348172 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-7cc5b853-6508-4d26-bc0d-b5baa43d8a9c tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] [instance: 74a59be2-69eb-4bdc-865c-570f5a2019df] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:51:30.354259 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-7cc5b853-6508-4d26-bc0d-b5baa43d8a9c tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:51:30.354704 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-7cc5b853-6508-4d26-bc0d-b5baa43d8a9c tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:51:30.355473 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-7cc5b853-6508-4d26-bc0d-b5baa43d8a9c tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:51:30.355907 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-7cc5b853-6508-4d26-bc0d-b5baa43d8a9c tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:51:30.388860 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-665515ad-80f9-4650-8948-598b71e9ab78 tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53d00e4198e240c8a5c2fbe8bd241b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1727f66e37f94cc6971b574c8635e078', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:51:30.396483 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-665515ad-80f9-4650-8948-598b71e9ab78 tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] 10.222.0.20 "GET /compute/v2.1/servers/0a925141-db5f-4cae-bc6c-8ca4930adf73" status: 200 len: 1573 microversion: 2.1 time: 0.159206 Jul 06 13:51:30.396960 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 350/705] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:51:30 2022] GET /compute/v2.1/servers/0a925141-db5f-4cae-bc6c-8ca4930adf73 => generated 1573 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:51:30.479769 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.wsgi [None req-7cc5b853-6508-4d26-bc0d-b5baa43d8a9c tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] HTTP exception thrown: Cannot 'detach_volume' instance 74a59be2-69eb-4bdc-865c-570f5a2019df while it is in vm_state rescued Jul 06 13:51:30.481395 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-7cc5b853-6508-4d26-bc0d-b5baa43d8a9c tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Request method failure captured: Jul 06 13:51:30.481395 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: request: DELETE /compute/v2.1/servers/74a59be2-69eb-4bdc-865c-570f5a2019df/os-volume_attachments/7f526dcf-d898-4258-a1c6-c22cc15925e3 HTTP/1.1 Jul 06 13:51:30.481395 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: Accept: application/json Jul 06 13:51:30.481395 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: Accept-Encoding: identity Jul 06 13:51:30.481395 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: Connection: close Jul 06 13:51:30.481395 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: Content-Length: 0 Jul 06 13:51:30.481395 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: Content-Type: application/json Jul 06 13:51:30.481395 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: Host: 10.222.0.20 Jul 06 13:51:30.481395 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: Openstack-System-Scope: None Jul 06 13:51:30.481395 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: User-Agent: python-urllib3/1.26.9 Jul 06 13:51:30.481395 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Auth-Token: gAAAAABixZH75p1b2ILOi45fcNF92-zTsRsIgZ35DgQcq749C0w1kkYHYWHbuoMJGGkHW9WPBjYh0zxzWH474VrSUUR4tFNhBBNpjbmin3OznzgbylsUH2zxuJOhwhiPNwMppgS72cUuSxmI0bW6Nxx2svX__3EGBU7RgRf-kZZLsUGvLTS4iek Jul 06 13:51:30.481395 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Domain-Id: None Jul 06 13:51:30.481395 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Domain-Name: None Jul 06 13:51:30.481395 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Identity-Status: Confirmed Jul 06 13:51:30.481395 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Is-Admin-Project: True Jul 06 13:51:30.481395 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Project-Domain-Id: default Jul 06 13:51:30.481395 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Project-Domain-Name: Default Jul 06 13:51:30.481395 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Project-Id: 3b2a80a004e04da7ae12db9f3f87146f Jul 06 13:51:30.481395 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-428270635 Jul 06 13:51:30.481395 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Role: reader,member Jul 06 13:51:30.481395 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Roles: reader,member Jul 06 13:51:30.482995 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_3b2a80a004e04da7ae12db9f3f87146f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/3b2a80a004e04da7ae12db9f3f87146f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/3b2a80a004e04da7ae12db9f3f87146f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/3b2a80a004e04da7ae12db9f3f87146f"}]}] Jul 06 13:51:30.482995 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Tenant: tempest-ServerRescueNegativeTestJSON-428270635 Jul 06 13:51:30.482995 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Tenant-Id: 3b2a80a004e04da7ae12db9f3f87146f Jul 06 13:51:30.482995 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-428270635 Jul 06 13:51:30.482995 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-User: tempest-ServerRescueNegativeTestJSON-428270635-project Jul 06 13:51:30.482995 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-User-Domain-Id: default Jul 06 13:51:30.482995 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-User-Domain-Name: Default Jul 06 13:51:30.482995 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-User-Id: 0c83c05bec4f456d8aa7d51732ddc8af Jul 06 13:51:30.482995 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-User-Name: tempest-ServerRescueNegativeTestJSON-428270635-project Jul 06 13:51:30.482995 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: method: > Jul 06 13:51:30.482995 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: exception: Cannot 'detach_volume' instance 74a59be2-69eb-4bdc-865c-570f5a2019df while it is in vm_state rescued Jul 06 13:51:30.483868 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: action_args: {'server_id': '74a59be2-69eb-4bdc-865c-570f5a2019df', 'id': '7f526dcf-d898-4258-a1c6-c22cc15925e3'} Jul 06 13:51:30.483868 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 06 13:51:30.483868 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 06 13:51:30.483868 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jul 06 13:51:30.483868 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jul 06 13:51:30.483868 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 06 13:51:30.483868 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 06 13:51:30.483868 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 06 13:51:30.483868 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 06 13:51:30.483868 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 74a59be2-69eb-4bdc-865c-570f5a2019df in vm_state rescued. Cannot detach_volume while the instance is in this state. Jul 06 13:51:30.483868 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi Jul 06 13:51:30.483868 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 06 13:51:30.483868 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi Jul 06 13:51:30.483868 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 06 13:51:30.483868 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 06 13:51:30.483868 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 06 13:51:30.483868 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 06 13:51:30.483868 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 06 13:51:30.483868 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 06 13:51:30.483868 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 06 13:51:30.485520 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Jul 06 13:51:30.485520 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 06 13:51:30.485520 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 06 13:51:30.485520 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 06 13:51:30.485520 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 74a59be2-69eb-4bdc-865c-570f5a2019df while it is in vm_state rescued Jul 06 13:51:30.485520 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi Jul 06 13:51:30.485520 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 06 13:51:30.485520 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi Jul 06 13:51:30.485520 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 06 13:51:30.485520 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 06 13:51:30.485520 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 06 13:51:30.485520 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 06 13:51:30.485520 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 06 13:51:30.485520 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 74a59be2-69eb-4bdc-865c-570f5a2019df while it is in vm_state rescued Jul 06 13:51:30.485520 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi Jul 06 13:51:30.485520 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-7cc5b853-6508-4d26-bc0d-b5baa43d8a9c tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Returning 409 to user: Cannot 'detach_volume' instance 74a59be2-69eb-4bdc-865c-570f5a2019df while it is in vm_state rescued {{(pid=124368) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 06 13:51:30.486827 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-7cc5b853-6508-4d26-bc0d-b5baa43d8a9c tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] 10.222.0.20 "DELETE /compute/v2.1/servers/74a59be2-69eb-4bdc-865c-570f5a2019df/os-volume_attachments/7f526dcf-d898-4258-a1c6-c22cc15925e3" status: 409 len: 152 microversion: 2.1 time: 0.139054 Jul 06 13:51:30.486827 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 356/706] 10.222.0.20 () {58 vars in 1415 bytes} [Wed Jul 6 13:51:30 2022] DELETE /compute/v2.1/servers/74a59be2-69eb-4bdc-865c-570f5a2019df/os-volume_attachments/7f526dcf-d898-4258-a1c6-c22cc15925e3 => generated 152 bytes in 140 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Jul 06 13:51:30.492315 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-7bc4e906-02ab-49da-98bb-ed5a5edc1ad4 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 06 13:51:30.492843 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-7bc4e906-02ab-49da-98bb-ed5a5edc1ad4 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] [instance: 74a59be2-69eb-4bdc-865c-570f5a2019df] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:51:30.498798 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-7bc4e906-02ab-49da-98bb-ed5a5edc1ad4 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:51:30.499245 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-7bc4e906-02ab-49da-98bb-ed5a5edc1ad4 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:51:30.500003 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-7bc4e906-02ab-49da-98bb-ed5a5edc1ad4 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:51:30.500442 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-7bc4e906-02ab-49da-98bb-ed5a5edc1ad4 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:51:30.565273 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-7bc4e906-02ab-49da-98bb-ed5a5edc1ad4 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] 10.222.0.20 "POST /compute/v2.1/servers/74a59be2-69eb-4bdc-865c-570f5a2019df/action" status: 202 len: 0 microversion: 2.1 time: 0.077046 Jul 06 13:51:30.565927 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 351/707] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Jul 6 13:51:30 2022] POST /compute/v2.1/servers/74a59be2-69eb-4bdc-865c-570f5a2019df/action => generated 0 bytes in 79 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 06 13:51:30.574717 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-a15e4694-e004-45e9-aa52-2553d66a3137 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Calling method '>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:51:30.575323 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-a15e4694-e004-45e9-aa52-2553d66a3137 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] [instance: 74a59be2-69eb-4bdc-865c-570f5a2019df] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:51:30.582196 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-a15e4694-e004-45e9-aa52-2553d66a3137 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:51:30.582647 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-a15e4694-e004-45e9-aa52-2553d66a3137 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:51:30.583398 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-a15e4694-e004-45e9-aa52-2553d66a3137 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:51:30.583830 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-a15e4694-e004-45e9-aa52-2553d66a3137 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:51:30.709639 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-f001eeee-dd2a-4f92-a9b8-9ba15a3f8887 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:51:30.710436 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-f001eeee-dd2a-4f92-a9b8-9ba15a3f8887 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] [instance: 85dc896f-7a07-400c-abc8-cc2d27bda2db] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:51:30.718077 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-f001eeee-dd2a-4f92-a9b8-9ba15a3f8887 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:51:30.718551 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-f001eeee-dd2a-4f92-a9b8-9ba15a3f8887 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:51:30.719424 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-f001eeee-dd2a-4f92-a9b8-9ba15a3f8887 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:51:30.719759 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-f001eeee-dd2a-4f92-a9b8-9ba15a3f8887 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:51:30.722238 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-a15e4694-e004-45e9-aa52-2553d66a3137 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c83c05bec4f456d8aa7d51732ddc8af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b2a80a004e04da7ae12db9f3f87146f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:51:30.730668 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-a15e4694-e004-45e9-aa52-2553d66a3137 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] 10.222.0.20 "GET /compute/v2.1/servers/74a59be2-69eb-4bdc-865c-570f5a2019df" status: 200 len: 1723 microversion: 2.1 time: 0.159665 Jul 06 13:51:30.731233 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 357/708] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:51:30 2022] GET /compute/v2.1/servers/74a59be2-69eb-4bdc-865c-570f5a2019df => generated 1723 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:51:30.745081 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-f001eeee-dd2a-4f92-a9b8-9ba15a3f8887 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] 10.222.0.20 "GET /compute/v2.1/servers/85dc896f-7a07-400c-abc8-cc2d27bda2db/ips" status: 200 len: 149 microversion: 2.1 time: 0.141028 Jul 06 13:51:30.745627 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 352/709] 10.222.0.20 () {58 vars in 1247 bytes} [Wed Jul 6 13:51:30 2022] GET /compute/v2.1/servers/85dc896f-7a07-400c-abc8-cc2d27bda2db/ips => generated 149 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 06 13:51:30.755836 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-5d0b3e96-e375-4bcf-9ae4-55bc97d86635 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "56776123-3d65-4f21-8214-ad1c2ba18e6b"}} {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 06 13:51:30.756956 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-5d0b3e96-e375-4bcf-9ae4-55bc97d86635 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] [instance: 85dc896f-7a07-400c-abc8-cc2d27bda2db] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:51:30.762910 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-5d0b3e96-e375-4bcf-9ae4-55bc97d86635 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:51:30.763360 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-5d0b3e96-e375-4bcf-9ae4-55bc97d86635 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:51:30.764123 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-5d0b3e96-e375-4bcf-9ae4-55bc97d86635 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:51:30.764559 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-5d0b3e96-e375-4bcf-9ae4-55bc97d86635 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:51:30.840784 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.wsgi [None req-5d0b3e96-e375-4bcf-9ae4-55bc97d86635 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] HTTP exception thrown: Invalid volume: volume 56776123-3d65-4f21-8214-ad1c2ba18e6b is already attached to instances: 5cf73c2b-28f6-49f1-a119-224c05679d2c Jul 06 13:51:30.842414 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-5d0b3e96-e375-4bcf-9ae4-55bc97d86635 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Request method failure captured: Jul 06 13:51:30.842414 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: request: POST /compute/v2.1/servers/85dc896f-7a07-400c-abc8-cc2d27bda2db/os-volume_attachments HTTP/1.1 Jul 06 13:51:30.842414 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: Accept: application/json Jul 06 13:51:30.842414 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: Accept-Encoding: identity Jul 06 13:51:30.842414 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: Connection: close Jul 06 13:51:30.842414 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: Content-Length: 74 Jul 06 13:51:30.842414 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: Content-Type: application/json Jul 06 13:51:30.842414 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: Host: 10.222.0.20 Jul 06 13:51:30.842414 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: Openstack-System-Scope: None Jul 06 13:51:30.842414 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: User-Agent: python-urllib3/1.26.9 Jul 06 13:51:30.842414 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Auth-Token: gAAAAABixZH4I4dgmb0Q3wbjrFWrBMh6OmJtrlg6lZ88SjHzAtW3fxMyo3s0_pJVvHdnPyxERhBQTWBNewTHA0QeJRzzLbnn4Csb1lAz3C9NjKcuSHUaArYBZ7P3u01dtbqramyieBExBREkl13A9tBRRuVoPmOumXVJ74UVBAMWWamo1ttSwGg Jul 06 13:51:30.842414 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Domain-Id: None Jul 06 13:51:30.842414 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Domain-Name: None Jul 06 13:51:30.842414 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Identity-Status: Confirmed Jul 06 13:51:30.842414 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Is-Admin-Project: True Jul 06 13:51:30.842414 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Project-Domain-Id: default Jul 06 13:51:30.842414 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Project-Domain-Name: Default Jul 06 13:51:30.842414 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Project-Id: bd85f2a57a0847debf5aaf81aab7a638 Jul 06 13:51:30.842414 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Project-Name: tempest-AttachVolumeNegativeTest-1016924223 Jul 06 13:51:30.842414 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Role: reader,member Jul 06 13:51:30.842414 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Roles: reader,member Jul 06 13:51:30.843965 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_bd85f2a57a0847debf5aaf81aab7a638"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/bd85f2a57a0847debf5aaf81aab7a638"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/bd85f2a57a0847debf5aaf81aab7a638"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/bd85f2a57a0847debf5aaf81aab7a638"}]}] Jul 06 13:51:30.843965 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Tenant: tempest-AttachVolumeNegativeTest-1016924223 Jul 06 13:51:30.843965 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Tenant-Id: bd85f2a57a0847debf5aaf81aab7a638 Jul 06 13:51:30.843965 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1016924223 Jul 06 13:51:30.843965 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-User: tempest-AttachVolumeNegativeTest-1016924223-project Jul 06 13:51:30.843965 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-User-Domain-Id: default Jul 06 13:51:30.843965 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-User-Domain-Name: Default Jul 06 13:51:30.843965 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-User-Id: 7b572a8f465048558fc969b85b2aec5b Jul 06 13:51:30.843965 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-User-Name: tempest-AttachVolumeNegativeTest-1016924223-project Jul 06 13:51:30.843965 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: Jul 06 13:51:30.843965 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: {"volumeAttachment": {"volumeId": "56776123-3d65-4f21-8214-ad1c2ba18e6b"}} Jul 06 13:51:30.843965 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: method: > Jul 06 13:51:30.845041 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: exception: Invalid volume: volume 56776123-3d65-4f21-8214-ad1c2ba18e6b is already attached to instances: 5cf73c2b-28f6-49f1-a119-224c05679d2c Jul 06 13:51:30.845041 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: action_args: {'server_id': '85dc896f-7a07-400c-abc8-cc2d27bda2db', 'body': {'volumeAttachment': {'volumeId': '56776123-3d65-4f21-8214-ad1c2ba18e6b'}}} Jul 06 13:51:30.845041 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 06 13:51:30.845041 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 06 13:51:30.845041 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 06 13:51:30.845041 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 06 13:51:30.845041 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 06 13:51:30.845041 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 06 13:51:30.845041 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 06 13:51:30.845041 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 06 13:51:30.845041 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jul 06 13:51:30.845041 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jul 06 13:51:30.845041 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jul 06 13:51:30.845041 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jul 06 13:51:30.845041 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 56776123-3d65-4f21-8214-ad1c2ba18e6b is already attached to instances: 5cf73c2b-28f6-49f1-a119-224c05679d2c Jul 06 13:51:30.845041 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi Jul 06 13:51:30.845041 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 06 13:51:30.845041 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi Jul 06 13:51:30.845041 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 06 13:51:30.846455 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 06 13:51:30.846455 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 06 13:51:30.846455 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 06 13:51:30.846455 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 06 13:51:30.846455 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 06 13:51:30.846455 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 06 13:51:30.846455 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 06 13:51:30.846455 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 06 13:51:30.846455 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 06 13:51:30.846455 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 06 13:51:30.846455 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 06 13:51:30.846455 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 06 13:51:30.846455 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jul 06 13:51:30.846455 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 06 13:51:30.846455 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 56776123-3d65-4f21-8214-ad1c2ba18e6b is already attached to instances: 5cf73c2b-28f6-49f1-a119-224c05679d2c Jul 06 13:51:30.846455 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi Jul 06 13:51:30.846455 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 06 13:51:30.846455 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi Jul 06 13:51:30.846455 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 06 13:51:30.846455 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 06 13:51:30.847937 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 06 13:51:30.847937 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 06 13:51:30.847937 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 06 13:51:30.847937 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 56776123-3d65-4f21-8214-ad1c2ba18e6b is already attached to instances: 5cf73c2b-28f6-49f1-a119-224c05679d2c Jul 06 13:51:30.847937 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi Jul 06 13:51:30.847937 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-5d0b3e96-e375-4bcf-9ae4-55bc97d86635 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Returning 400 to user: Invalid volume: volume 56776123-3d65-4f21-8214-ad1c2ba18e6b is already attached to instances: 5cf73c2b-28f6-49f1-a119-224c05679d2c {{(pid=124368) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 06 13:51:30.847937 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-5d0b3e96-e375-4bcf-9ae4-55bc97d86635 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] 10.222.0.20 "POST /compute/v2.1/servers/85dc896f-7a07-400c-abc8-cc2d27bda2db/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.091907 Jul 06 13:51:30.847937 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 358/710] 10.222.0.20 () {60 vars in 1322 bytes} [Wed Jul 6 13:51:30 2022] POST /compute/v2.1/servers/85dc896f-7a07-400c-abc8-cc2d27bda2db/os-volume_attachments => generated 174 bytes in 93 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 06 13:51:30.853325 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-da14aeaa-b914-4236-80b2-5e0885fe675b tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:51:30.853823 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-da14aeaa-b914-4236-80b2-5e0885fe675b tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] [instance: 85dc896f-7a07-400c-abc8-cc2d27bda2db] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:51:30.859761 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-da14aeaa-b914-4236-80b2-5e0885fe675b tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:51:30.860218 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-da14aeaa-b914-4236-80b2-5e0885fe675b tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:51:30.860984 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-da14aeaa-b914-4236-80b2-5e0885fe675b tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:51:30.861442 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-da14aeaa-b914-4236-80b2-5e0885fe675b tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:51:30.885815 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-da14aeaa-b914-4236-80b2-5e0885fe675b tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] [instance: 85dc896f-7a07-400c-abc8-cc2d27bda2db] Going to try to terminate instance {{(pid=124367) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 06 13:51:30.899659 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG dbcounter [-] [124367] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:51:30.958891 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-da14aeaa-b914-4236-80b2-5e0885fe675b tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] 10.222.0.20 "DELETE /compute/v2.1/servers/85dc896f-7a07-400c-abc8-cc2d27bda2db" status: 204 len: 0 microversion: 2.1 time: 0.108340 Jul 06 13:51:30.959379 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 353/711] 10.222.0.20 () {58 vars in 1238 bytes} [Wed Jul 6 13:51:30 2022] DELETE /compute/v2.1/servers/85dc896f-7a07-400c-abc8-cc2d27bda2db => generated 0 bytes in 111 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 06 13:51:30.967380 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-ccf35124-9d0c-4fac-baa2-edf3e3e9e40b tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Calling method '>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:51:30.967990 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-ccf35124-9d0c-4fac-baa2-edf3e3e9e40b tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] [instance: 85dc896f-7a07-400c-abc8-cc2d27bda2db] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:51:30.975459 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-ccf35124-9d0c-4fac-baa2-edf3e3e9e40b tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:51:30.975902 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-ccf35124-9d0c-4fac-baa2-edf3e3e9e40b tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:51:30.976662 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-ccf35124-9d0c-4fac-baa2-edf3e3e9e40b tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:51:30.977156 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-ccf35124-9d0c-4fac-baa2-edf3e3e9e40b tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:51:31.106037 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-ccf35124-9d0c-4fac-baa2-edf3e3e9e40b tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b572a8f465048558fc969b85b2aec5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd85f2a57a0847debf5aaf81aab7a638', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:51:31.113373 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-ccf35124-9d0c-4fac-baa2-edf3e3e9e40b tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] 10.222.0.20 "GET /compute/v2.1/servers/85dc896f-7a07-400c-abc8-cc2d27bda2db" status: 200 len: 1680 microversion: 2.1 time: 0.149763 Jul 06 13:51:31.114014 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 359/712] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:51:30 2022] GET /compute/v2.1/servers/85dc896f-7a07-400c-abc8-cc2d27bda2db => generated 1680 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:51:31.413811 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-7abcba71-2aca-454a-bf4a-7b9c8d63d50c tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:51:31.414500 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-7abcba71-2aca-454a-bf4a-7b9c8d63d50c tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] [instance: 0a925141-db5f-4cae-bc6c-8ca4930adf73] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:51:31.421092 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-7abcba71-2aca-454a-bf4a-7b9c8d63d50c tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:51:31.421541 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-7abcba71-2aca-454a-bf4a-7b9c8d63d50c tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:51:31.422292 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-7abcba71-2aca-454a-bf4a-7b9c8d63d50c tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:51:31.422717 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-7abcba71-2aca-454a-bf4a-7b9c8d63d50c tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:51:31.553145 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-7abcba71-2aca-454a-bf4a-7b9c8d63d50c tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53d00e4198e240c8a5c2fbe8bd241b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1727f66e37f94cc6971b574c8635e078', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:51:31.560554 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-7abcba71-2aca-454a-bf4a-7b9c8d63d50c tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] 10.222.0.20 "GET /compute/v2.1/servers/0a925141-db5f-4cae-bc6c-8ca4930adf73" status: 200 len: 1573 microversion: 2.1 time: 0.151257 Jul 06 13:51:31.561122 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 354/713] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:51:31 2022] GET /compute/v2.1/servers/0a925141-db5f-4cae-bc6c-8ca4930adf73 => generated 1573 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:51:31.748554 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-7b921e89-0bb2-40ea-97ed-ea7205e75094 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Calling method '>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:51:31.749293 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-7b921e89-0bb2-40ea-97ed-ea7205e75094 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] [instance: 74a59be2-69eb-4bdc-865c-570f5a2019df] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:51:31.755702 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-7b921e89-0bb2-40ea-97ed-ea7205e75094 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:51:31.756159 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-7b921e89-0bb2-40ea-97ed-ea7205e75094 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:51:31.756930 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-7b921e89-0bb2-40ea-97ed-ea7205e75094 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:51:31.757405 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-7b921e89-0bb2-40ea-97ed-ea7205e75094 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:51:31.886313 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-7b921e89-0bb2-40ea-97ed-ea7205e75094 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c83c05bec4f456d8aa7d51732ddc8af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b2a80a004e04da7ae12db9f3f87146f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:51:31.894192 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-7b921e89-0bb2-40ea-97ed-ea7205e75094 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] 10.222.0.20 "GET /compute/v2.1/servers/74a59be2-69eb-4bdc-865c-570f5a2019df" status: 200 len: 1723 microversion: 2.1 time: 0.149518 Jul 06 13:51:31.894765 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 360/714] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:51:31 2022] GET /compute/v2.1/servers/74a59be2-69eb-4bdc-865c-570f5a2019df => generated 1723 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:51:32.131358 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-bc81f782-b704-4c9c-a54d-b3e931cff75d tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:51:32.131906 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-bc81f782-b704-4c9c-a54d-b3e931cff75d tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] [instance: 85dc896f-7a07-400c-abc8-cc2d27bda2db] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:51:32.137909 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-bc81f782-b704-4c9c-a54d-b3e931cff75d tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:51:32.138354 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-bc81f782-b704-4c9c-a54d-b3e931cff75d tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:51:32.139107 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-bc81f782-b704-4c9c-a54d-b3e931cff75d tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:51:32.139533 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-bc81f782-b704-4c9c-a54d-b3e931cff75d tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:51:32.269827 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-bc81f782-b704-4c9c-a54d-b3e931cff75d tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b572a8f465048558fc969b85b2aec5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd85f2a57a0847debf5aaf81aab7a638', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:51:32.278327 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-bc81f782-b704-4c9c-a54d-b3e931cff75d tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] 10.222.0.20 "GET /compute/v2.1/servers/85dc896f-7a07-400c-abc8-cc2d27bda2db" status: 200 len: 1680 microversion: 2.1 time: 0.151553 Jul 06 13:51:32.278880 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 355/715] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:51:32 2022] GET /compute/v2.1/servers/85dc896f-7a07-400c-abc8-cc2d27bda2db => generated 1680 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:51:32.577756 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-48cf2864-e3c9-4c5c-8e06-5148a68f6011 tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] Calling method '>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:51:32.578394 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-48cf2864-e3c9-4c5c-8e06-5148a68f6011 tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] [instance: 0a925141-db5f-4cae-bc6c-8ca4930adf73] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:51:32.584559 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-48cf2864-e3c9-4c5c-8e06-5148a68f6011 tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:51:32.585021 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-48cf2864-e3c9-4c5c-8e06-5148a68f6011 tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:51:32.585819 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-48cf2864-e3c9-4c5c-8e06-5148a68f6011 tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:51:32.586251 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-48cf2864-e3c9-4c5c-8e06-5148a68f6011 tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:51:32.723656 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-48cf2864-e3c9-4c5c-8e06-5148a68f6011 tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53d00e4198e240c8a5c2fbe8bd241b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1727f66e37f94cc6971b574c8635e078', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:51:32.732142 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-48cf2864-e3c9-4c5c-8e06-5148a68f6011 tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] 10.222.0.20 "GET /compute/v2.1/servers/0a925141-db5f-4cae-bc6c-8ca4930adf73" status: 200 len: 1573 microversion: 2.1 time: 0.157968 Jul 06 13:51:32.732897 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 361/716] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:51:32 2022] GET /compute/v2.1/servers/0a925141-db5f-4cae-bc6c-8ca4930adf73 => generated 1573 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:51:32.913123 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-5c799b99-6782-4118-b9ca-10056f0a008e tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:51:32.913644 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-5c799b99-6782-4118-b9ca-10056f0a008e tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] [instance: 74a59be2-69eb-4bdc-865c-570f5a2019df] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:51:32.920268 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-5c799b99-6782-4118-b9ca-10056f0a008e tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:51:32.920825 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-5c799b99-6782-4118-b9ca-10056f0a008e tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:51:32.921728 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-5c799b99-6782-4118-b9ca-10056f0a008e tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:51:32.922167 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-5c799b99-6782-4118-b9ca-10056f0a008e tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:51:33.063037 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-5c799b99-6782-4118-b9ca-10056f0a008e tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c83c05bec4f456d8aa7d51732ddc8af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b2a80a004e04da7ae12db9f3f87146f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:51:33.071019 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-5c799b99-6782-4118-b9ca-10056f0a008e tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] 10.222.0.20 "GET /compute/v2.1/servers/74a59be2-69eb-4bdc-865c-570f5a2019df" status: 200 len: 1723 microversion: 2.1 time: 0.162723 Jul 06 13:51:33.071604 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 356/717] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:51:32 2022] GET /compute/v2.1/servers/74a59be2-69eb-4bdc-865c-570f5a2019df => generated 1723 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:51:33.298633 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-a85159d6-d168-4414-9bec-d9bdb23ed810 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Calling method '>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:51:33.299756 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-a85159d6-d168-4414-9bec-d9bdb23ed810 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] [instance: 85dc896f-7a07-400c-abc8-cc2d27bda2db] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:51:33.307191 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-a85159d6-d168-4414-9bec-d9bdb23ed810 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:51:33.307643 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-a85159d6-d168-4414-9bec-d9bdb23ed810 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:51:33.308423 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-a85159d6-d168-4414-9bec-d9bdb23ed810 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:51:33.308860 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-a85159d6-d168-4414-9bec-d9bdb23ed810 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:51:33.417642 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-5c60e097-47f9-432e-8282-978bdcc2873b tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:51:33.418130 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-5c60e097-47f9-432e-8282-978bdcc2873b tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] [instance: 546a77fd-66e1-4d89-afa3-58d632b09186] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:51:33.424092 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-5c60e097-47f9-432e-8282-978bdcc2873b tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:51:33.424784 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-5c60e097-47f9-432e-8282-978bdcc2873b tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:51:33.425573 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-5c60e097-47f9-432e-8282-978bdcc2873b tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:51:33.426002 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-5c60e097-47f9-432e-8282-978bdcc2873b tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:51:33.448901 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-a85159d6-d168-4414-9bec-d9bdb23ed810 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b572a8f465048558fc969b85b2aec5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd85f2a57a0847debf5aaf81aab7a638', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:51:33.456499 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-a85159d6-d168-4414-9bec-d9bdb23ed810 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] 10.222.0.20 "GET /compute/v2.1/servers/85dc896f-7a07-400c-abc8-cc2d27bda2db" status: 200 len: 1680 microversion: 2.1 time: 0.161757 Jul 06 13:51:33.457077 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 362/718] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:51:33 2022] GET /compute/v2.1/servers/85dc896f-7a07-400c-abc8-cc2d27bda2db => generated 1680 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:51:33.546531 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.objects.instance [None req-5c60e097-47f9-432e-8282-978bdcc2873b tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lazy-loading 'services' on Instance uuid 546a77fd-66e1-4d89-afa3-58d632b09186 {{(pid=124367) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 06 13:51:33.670193 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-5c60e097-47f9-432e-8282-978bdcc2873b tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] 10.222.0.20 "DELETE /compute/v2.1/servers/546a77fd-66e1-4d89-afa3-58d632b09186/os-volume_attachments/1ec4acf0-fb51-4260-93d3-0b67fe07f21b" status: 202 len: 0 microversion: 2.1 time: 0.369194 Jul 06 13:51:33.670782 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 357/719] 10.222.0.20 () {58 vars in 1415 bytes} [Wed Jul 6 13:51:33 2022] DELETE /compute/v2.1/servers/546a77fd-66e1-4d89-afa3-58d632b09186/os-volume_attachments/1ec4acf0-fb51-4260-93d3-0b67fe07f21b => generated 0 bytes in 371 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 06 13:51:33.845970 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-0fb91d26-f99b-4a78-8d7e-2c434a6e9f9a tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] Calling method '>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:51:33.846585 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-0fb91d26-f99b-4a78-8d7e-2c434a6e9f9a tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] [instance: 0a925141-db5f-4cae-bc6c-8ca4930adf73] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:51:33.853249 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-0fb91d26-f99b-4a78-8d7e-2c434a6e9f9a tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:51:33.853696 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-0fb91d26-f99b-4a78-8d7e-2c434a6e9f9a tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:51:33.854445 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-0fb91d26-f99b-4a78-8d7e-2c434a6e9f9a tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:51:33.854877 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-0fb91d26-f99b-4a78-8d7e-2c434a6e9f9a tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:51:34.056655 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-0fb91d26-f99b-4a78-8d7e-2c434a6e9f9a tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53d00e4198e240c8a5c2fbe8bd241b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1727f66e37f94cc6971b574c8635e078', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:51:34.064538 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-0fb91d26-f99b-4a78-8d7e-2c434a6e9f9a tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] 10.222.0.20 "GET /compute/v2.1/servers/0a925141-db5f-4cae-bc6c-8ca4930adf73" status: 200 len: 1560 microversion: 2.1 time: 0.318508 Jul 06 13:51:34.065158 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 363/720] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:51:33 2022] GET /compute/v2.1/servers/0a925141-db5f-4cae-bc6c-8ca4930adf73 => generated 1560 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:51:34.089212 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-eef96965-741d-4d39-9162-99afd4dcdc95 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:51:34.089826 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-eef96965-741d-4d39-9162-99afd4dcdc95 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] [instance: 74a59be2-69eb-4bdc-865c-570f5a2019df] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:51:34.096405 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-eef96965-741d-4d39-9162-99afd4dcdc95 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:51:34.096830 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-eef96965-741d-4d39-9162-99afd4dcdc95 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:51:34.097650 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-eef96965-741d-4d39-9162-99afd4dcdc95 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:51:34.098185 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-eef96965-741d-4d39-9162-99afd4dcdc95 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:51:34.350054 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-eef96965-741d-4d39-9162-99afd4dcdc95 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c83c05bec4f456d8aa7d51732ddc8af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b2a80a004e04da7ae12db9f3f87146f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:51:34.357808 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-eef96965-741d-4d39-9162-99afd4dcdc95 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] 10.222.0.20 "GET /compute/v2.1/servers/74a59be2-69eb-4bdc-865c-570f5a2019df" status: 200 len: 1723 microversion: 2.1 time: 0.273369 Jul 06 13:51:34.358370 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 358/721] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:51:34 2022] GET /compute/v2.1/servers/74a59be2-69eb-4bdc-865c-570f5a2019df => generated 1723 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:51:34.473160 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-05167a4e-3ef9-4fa7-bcb1-d9c212f91274 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Calling method '>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:51:34.473994 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-05167a4e-3ef9-4fa7-bcb1-d9c212f91274 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] [instance: 85dc896f-7a07-400c-abc8-cc2d27bda2db] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:51:34.480522 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-05167a4e-3ef9-4fa7-bcb1-d9c212f91274 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:51:34.481279 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-05167a4e-3ef9-4fa7-bcb1-d9c212f91274 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:51:34.482179 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-05167a4e-3ef9-4fa7-bcb1-d9c212f91274 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:51:34.482559 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-05167a4e-3ef9-4fa7-bcb1-d9c212f91274 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:51:34.908331 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-05167a4e-3ef9-4fa7-bcb1-d9c212f91274 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b572a8f465048558fc969b85b2aec5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd85f2a57a0847debf5aaf81aab7a638', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:51:34.916312 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-05167a4e-3ef9-4fa7-bcb1-d9c212f91274 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] 10.222.0.20 "GET /compute/v2.1/servers/85dc896f-7a07-400c-abc8-cc2d27bda2db" status: 200 len: 1680 microversion: 2.1 time: 0.446999 Jul 06 13:51:34.917322 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 364/722] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:51:34 2022] GET /compute/v2.1/servers/85dc896f-7a07-400c-abc8-cc2d27bda2db => generated 1680 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:51:35.243872 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [req-b18b29b4-e250-41e2-80d0-93a4c8315f2d req-a09448c9-e2a3-43cf-93a3-16ccfccf312f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "85dc896f-7a07-400c-abc8-cc2d27bda2db", "name": "network-vif-deleted", "tag": "e9e85219-187e-4978-bd5f-5875bc364c0e"}]} {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 06 13:51:35.253495 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [req-b18b29b4-e250-41e2-80d0-93a4c8315f2d req-a09448c9-e2a3-43cf-93a3-16ccfccf312f service nova] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:51:35.254409 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [req-b18b29b4-e250-41e2-80d0-93a4c8315f2d req-a09448c9-e2a3-43cf-93a3-16ccfccf312f service nova] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:51:35.268453 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.compute.server_external_events [req-b18b29b4-e250-41e2-80d0-93a4c8315f2d req-a09448c9-e2a3-43cf-93a3-16ccfccf312f service nova] Creating event network-vif-deleted:e9e85219-187e-4978-bd5f-5875bc364c0e for instance 85dc896f-7a07-400c-abc8-cc2d27bda2db on hv-cinder-81914 Jul 06 13:51:35.276083 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [req-b18b29b4-e250-41e2-80d0-93a4c8315f2d req-a09448c9-e2a3-43cf-93a3-16ccfccf312f service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035794 Jul 06 13:51:35.276686 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 359/723] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 6 13:51:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 06 13:51:35.375296 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-d4344013-0f3d-4eea-8924-918f3f0cb67b tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Calling method '>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:51:35.375939 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-d4344013-0f3d-4eea-8924-918f3f0cb67b tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] [instance: 74a59be2-69eb-4bdc-865c-570f5a2019df] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:51:35.382591 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-d4344013-0f3d-4eea-8924-918f3f0cb67b tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:51:35.383054 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-d4344013-0f3d-4eea-8924-918f3f0cb67b tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:51:35.383864 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-d4344013-0f3d-4eea-8924-918f3f0cb67b tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:51:35.384487 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-d4344013-0f3d-4eea-8924-918f3f0cb67b tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:51:35.533048 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-d4344013-0f3d-4eea-8924-918f3f0cb67b tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c83c05bec4f456d8aa7d51732ddc8af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b2a80a004e04da7ae12db9f3f87146f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:51:35.542113 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-d4344013-0f3d-4eea-8924-918f3f0cb67b tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] 10.222.0.20 "GET /compute/v2.1/servers/74a59be2-69eb-4bdc-865c-570f5a2019df" status: 200 len: 1723 microversion: 2.1 time: 0.170510 Jul 06 13:51:35.543241 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 365/724] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:51:35 2022] GET /compute/v2.1/servers/74a59be2-69eb-4bdc-865c-570f5a2019df => generated 1723 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:51:35.883750 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-6b3b254a-ed3b-4d96-a52c-14b00254bb2d tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 06 13:51:35.890062 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-6b3b254a-ed3b-4d96-a52c-14b00254bb2d tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:51:35.890586 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-6b3b254a-ed3b-4d96-a52c-14b00254bb2d tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:51:35.914461 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-6b3b254a-ed3b-4d96-a52c-14b00254bb2d tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] [instance: 546a77fd-66e1-4d89-afa3-58d632b09186] Going to try to stop instance {{(pid=124367) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jul 06 13:51:35.939663 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-0ccc1e71-295a-46b8-a367-d2c7da8be1af tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Calling method '>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:51:35.940286 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-0ccc1e71-295a-46b8-a367-d2c7da8be1af tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] [instance: 85dc896f-7a07-400c-abc8-cc2d27bda2db] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:51:35.947972 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-0ccc1e71-295a-46b8-a367-d2c7da8be1af tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:51:35.948504 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-0ccc1e71-295a-46b8-a367-d2c7da8be1af tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:51:35.949390 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-0ccc1e71-295a-46b8-a367-d2c7da8be1af tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:51:35.949926 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-0ccc1e71-295a-46b8-a367-d2c7da8be1af tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:51:35.983909 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-6b3b254a-ed3b-4d96-a52c-14b00254bb2d tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] 10.222.0.20 "POST /compute/v2.1/servers/546a77fd-66e1-4d89-afa3-58d632b09186/action" status: 202 len: 0 microversion: 2.1 time: 0.104556 Jul 06 13:51:35.985242 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 360/725] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Jul 6 13:51:35 2022] POST /compute/v2.1/servers/546a77fd-66e1-4d89-afa3-58d632b09186/action => generated 0 bytes in 107 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 06 13:51:35.993312 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-0ccc1e71-295a-46b8-a367-d2c7da8be1af tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:51:35.993748 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-0ccc1e71-295a-46b8-a367-d2c7da8be1af tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:51:35.994221 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.objects.instance [None req-0ccc1e71-295a-46b8-a367-d2c7da8be1af tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lazy-loading 'fault' on Instance uuid 85dc896f-7a07-400c-abc8-cc2d27bda2db {{(pid=124368) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 06 13:51:35.995416 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-a700a16b-1974-4ba7-9483-7b5fc8b81956 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:51:35.996380 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-a700a16b-1974-4ba7-9483-7b5fc8b81956 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] [instance: 546a77fd-66e1-4d89-afa3-58d632b09186] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:51:36.005138 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-a700a16b-1974-4ba7-9483-7b5fc8b81956 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:51:36.005777 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-a700a16b-1974-4ba7-9483-7b5fc8b81956 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:51:36.006673 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-a700a16b-1974-4ba7-9483-7b5fc8b81956 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:51:36.007118 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-a700a16b-1974-4ba7-9483-7b5fc8b81956 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:51:36.035351 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-0ccc1e71-295a-46b8-a367-d2c7da8be1af tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b572a8f465048558fc969b85b2aec5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd85f2a57a0847debf5aaf81aab7a638', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:51:36.044005 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG dbcounter [-] [124368] Writing DB stats nova_cell1:SELECT=100 {{(pid=124368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:51:36.046952 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-0ccc1e71-295a-46b8-a367-d2c7da8be1af tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] 10.222.0.20 "GET /compute/v2.1/servers/85dc896f-7a07-400c-abc8-cc2d27bda2db" status: 200 len: 1330 microversion: 2.1 time: 0.111141 Jul 06 13:51:36.047780 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 366/726] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:51:35 2022] GET /compute/v2.1/servers/85dc896f-7a07-400c-abc8-cc2d27bda2db => generated 1330 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 06 13:51:36.169743 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-a700a16b-1974-4ba7-9483-7b5fc8b81956 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d7cacb73c8342579d9f990b0193487c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05df572327d54bd99595974b75898052', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:51:36.179433 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-a700a16b-1974-4ba7-9483-7b5fc8b81956 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] 10.222.0.20 "GET /compute/v2.1/servers/546a77fd-66e1-4d89-afa3-58d632b09186" status: 200 len: 1677 microversion: 2.1 time: 0.188476 Jul 06 13:51:36.180413 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 361/727] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:51:35 2022] GET /compute/v2.1/servers/546a77fd-66e1-4d89-afa3-58d632b09186 => generated 1677 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:51:36.560079 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-c6370c45-00a7-4e52-bb41-980d26c0d66f tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Calling method '>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:51:36.560688 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-c6370c45-00a7-4e52-bb41-980d26c0d66f tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] [instance: 74a59be2-69eb-4bdc-865c-570f5a2019df] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:51:36.567126 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-c6370c45-00a7-4e52-bb41-980d26c0d66f tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:51:36.567730 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-c6370c45-00a7-4e52-bb41-980d26c0d66f tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:51:36.568490 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-c6370c45-00a7-4e52-bb41-980d26c0d66f tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:51:36.568923 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-c6370c45-00a7-4e52-bb41-980d26c0d66f tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:51:36.702366 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-c6370c45-00a7-4e52-bb41-980d26c0d66f tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c83c05bec4f456d8aa7d51732ddc8af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b2a80a004e04da7ae12db9f3f87146f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:51:36.711910 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-c6370c45-00a7-4e52-bb41-980d26c0d66f tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] 10.222.0.20 "GET /compute/v2.1/servers/74a59be2-69eb-4bdc-865c-570f5a2019df" status: 200 len: 1723 microversion: 2.1 time: 0.155960 Jul 06 13:51:36.712504 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 367/728] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:51:36 2022] GET /compute/v2.1/servers/74a59be2-69eb-4bdc-865c-570f5a2019df => generated 1723 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:51:37.068241 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-047f1ebd-7a48-4585-b983-52bf6da52153 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:51:37.068947 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-047f1ebd-7a48-4585-b983-52bf6da52153 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] [instance: 85dc896f-7a07-400c-abc8-cc2d27bda2db] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:51:37.075518 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-047f1ebd-7a48-4585-b983-52bf6da52153 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:51:37.075967 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-047f1ebd-7a48-4585-b983-52bf6da52153 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:51:37.076728 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-047f1ebd-7a48-4585-b983-52bf6da52153 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:51:37.077202 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-047f1ebd-7a48-4585-b983-52bf6da52153 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:51:37.109833 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-047f1ebd-7a48-4585-b983-52bf6da52153 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:51:37.110281 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-047f1ebd-7a48-4585-b983-52bf6da52153 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:51:37.110736 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.objects.instance [None req-047f1ebd-7a48-4585-b983-52bf6da52153 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lazy-loading 'fault' on Instance uuid 85dc896f-7a07-400c-abc8-cc2d27bda2db {{(pid=124367) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 06 13:51:37.151781 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-047f1ebd-7a48-4585-b983-52bf6da52153 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b572a8f465048558fc969b85b2aec5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd85f2a57a0847debf5aaf81aab7a638', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:51:37.159005 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-047f1ebd-7a48-4585-b983-52bf6da52153 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] 10.222.0.20 "GET /compute/v2.1/servers/85dc896f-7a07-400c-abc8-cc2d27bda2db" status: 200 len: 1330 microversion: 2.1 time: 0.095876 Jul 06 13:51:37.159559 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 362/729] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:51:37 2022] GET /compute/v2.1/servers/85dc896f-7a07-400c-abc8-cc2d27bda2db => generated 1330 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:51:37.196146 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-3869cb8e-4991-4f84-821e-f745901427de tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Calling method '>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:51:37.196759 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-3869cb8e-4991-4f84-821e-f745901427de tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] [instance: 546a77fd-66e1-4d89-afa3-58d632b09186] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:51:37.202683 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-3869cb8e-4991-4f84-821e-f745901427de tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:51:37.203136 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-3869cb8e-4991-4f84-821e-f745901427de tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:51:37.203897 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-3869cb8e-4991-4f84-821e-f745901427de tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:51:37.204337 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-3869cb8e-4991-4f84-821e-f745901427de tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:51:37.330574 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-3869cb8e-4991-4f84-821e-f745901427de tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d7cacb73c8342579d9f990b0193487c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05df572327d54bd99595974b75898052', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:51:37.338143 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-3869cb8e-4991-4f84-821e-f745901427de tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] 10.222.0.20 "GET /compute/v2.1/servers/546a77fd-66e1-4d89-afa3-58d632b09186" status: 200 len: 1677 microversion: 2.1 time: 0.146434 Jul 06 13:51:37.338707 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 368/730] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:51:37 2022] GET /compute/v2.1/servers/546a77fd-66e1-4d89-afa3-58d632b09186 => generated 1677 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:51:37.730127 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-4a32a799-c219-41e9-8cc8-ee999dfd5120 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:51:37.730655 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-4a32a799-c219-41e9-8cc8-ee999dfd5120 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] [instance: 74a59be2-69eb-4bdc-865c-570f5a2019df] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:51:37.736521 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-4a32a799-c219-41e9-8cc8-ee999dfd5120 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:51:37.736964 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-4a32a799-c219-41e9-8cc8-ee999dfd5120 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:51:37.737746 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-4a32a799-c219-41e9-8cc8-ee999dfd5120 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:51:37.738175 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-4a32a799-c219-41e9-8cc8-ee999dfd5120 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:51:37.866081 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-4a32a799-c219-41e9-8cc8-ee999dfd5120 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c83c05bec4f456d8aa7d51732ddc8af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b2a80a004e04da7ae12db9f3f87146f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:51:37.874834 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-4a32a799-c219-41e9-8cc8-ee999dfd5120 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] 10.222.0.20 "GET /compute/v2.1/servers/74a59be2-69eb-4bdc-865c-570f5a2019df" status: 200 len: 1723 microversion: 2.1 time: 0.148529 Jul 06 13:51:37.875447 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 363/731] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:51:37 2022] GET /compute/v2.1/servers/74a59be2-69eb-4bdc-865c-570f5a2019df => generated 1723 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 06 13:51:38.176046 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-615c4615-5d8e-47c4-aaff-63a22a79feca tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Calling method '>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:51:38.177109 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-615c4615-5d8e-47c4-aaff-63a22a79feca tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] [instance: 85dc896f-7a07-400c-abc8-cc2d27bda2db] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:51:38.183510 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-615c4615-5d8e-47c4-aaff-63a22a79feca tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:51:38.183961 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-615c4615-5d8e-47c4-aaff-63a22a79feca tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:51:38.184725 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-615c4615-5d8e-47c4-aaff-63a22a79feca tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:51:38.185213 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-615c4615-5d8e-47c4-aaff-63a22a79feca tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:51:38.216571 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-615c4615-5d8e-47c4-aaff-63a22a79feca tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:51:38.217039 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-615c4615-5d8e-47c4-aaff-63a22a79feca tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:51:38.217495 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.objects.instance [None req-615c4615-5d8e-47c4-aaff-63a22a79feca tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lazy-loading 'fault' on Instance uuid 85dc896f-7a07-400c-abc8-cc2d27bda2db {{(pid=124368) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 06 13:51:38.257772 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-615c4615-5d8e-47c4-aaff-63a22a79feca tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b572a8f465048558fc969b85b2aec5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd85f2a57a0847debf5aaf81aab7a638', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:51:38.265062 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-615c4615-5d8e-47c4-aaff-63a22a79feca tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] 10.222.0.20 "GET /compute/v2.1/servers/85dc896f-7a07-400c-abc8-cc2d27bda2db" status: 200 len: 1330 microversion: 2.1 time: 0.093301 Jul 06 13:51:38.265625 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 369/732] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:51:38 2022] GET /compute/v2.1/servers/85dc896f-7a07-400c-abc8-cc2d27bda2db => generated 1330 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:51:38.354945 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-defc2491-853f-4adb-b4e8-e1ef4786601c tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:51:38.355554 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-defc2491-853f-4adb-b4e8-e1ef4786601c tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] [instance: 546a77fd-66e1-4d89-afa3-58d632b09186] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:51:38.361906 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-defc2491-853f-4adb-b4e8-e1ef4786601c tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:51:38.362348 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-defc2491-853f-4adb-b4e8-e1ef4786601c tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:51:38.363099 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-defc2491-853f-4adb-b4e8-e1ef4786601c tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:51:38.363672 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-defc2491-853f-4adb-b4e8-e1ef4786601c tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:51:38.490920 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-defc2491-853f-4adb-b4e8-e1ef4786601c tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d7cacb73c8342579d9f990b0193487c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05df572327d54bd99595974b75898052', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:51:38.498364 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-defc2491-853f-4adb-b4e8-e1ef4786601c tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] 10.222.0.20 "GET /compute/v2.1/servers/546a77fd-66e1-4d89-afa3-58d632b09186" status: 200 len: 1677 microversion: 2.1 time: 0.147203 Jul 06 13:51:38.498919 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 364/733] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:51:38 2022] GET /compute/v2.1/servers/546a77fd-66e1-4d89-afa3-58d632b09186 => generated 1677 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:51:38.891760 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-54bfc827-5a3c-4806-bf69-989065b32590 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Calling method '>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:51:38.892367 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-54bfc827-5a3c-4806-bf69-989065b32590 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] [instance: 74a59be2-69eb-4bdc-865c-570f5a2019df] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:51:38.898919 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-54bfc827-5a3c-4806-bf69-989065b32590 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:51:38.899370 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-54bfc827-5a3c-4806-bf69-989065b32590 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:51:38.900124 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-54bfc827-5a3c-4806-bf69-989065b32590 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:51:38.900561 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-54bfc827-5a3c-4806-bf69-989065b32590 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:51:39.030880 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-54bfc827-5a3c-4806-bf69-989065b32590 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c83c05bec4f456d8aa7d51732ddc8af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b2a80a004e04da7ae12db9f3f87146f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:51:39.038829 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-54bfc827-5a3c-4806-bf69-989065b32590 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] 10.222.0.20 "GET /compute/v2.1/servers/74a59be2-69eb-4bdc-865c-570f5a2019df" status: 200 len: 1729 microversion: 2.1 time: 0.150885 Jul 06 13:51:39.039384 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 370/734] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:51:38 2022] GET /compute/v2.1/servers/74a59be2-69eb-4bdc-865c-570f5a2019df => generated 1729 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:51:39.055846 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-184fdf22-8cec-4020-9f9e-a3e4632b34db tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:51:39.056217 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-184fdf22-8cec-4020-9f9e-a3e4632b34db tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] [instance: 74a59be2-69eb-4bdc-865c-570f5a2019df] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:51:39.062259 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-184fdf22-8cec-4020-9f9e-a3e4632b34db tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:51:39.062702 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-184fdf22-8cec-4020-9f9e-a3e4632b34db tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:51:39.063465 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-184fdf22-8cec-4020-9f9e-a3e4632b34db tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:51:39.063902 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-184fdf22-8cec-4020-9f9e-a3e4632b34db tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:51:39.140562 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-184fdf22-8cec-4020-9f9e-a3e4632b34db tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] 10.222.0.20 "GET /compute/v2.1/servers/74a59be2-69eb-4bdc-865c-570f5a2019df/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.089106 Jul 06 13:51:39.141192 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 365/735] 10.222.0.20 () {58 vars in 1274 bytes} [Wed Jul 6 13:51:39 2022] GET /compute/v2.1/servers/74a59be2-69eb-4bdc-865c-570f5a2019df/os-interface => generated 284 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 06 13:51:39.282541 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-8e62d4b1-44c8-49d4-ad38-7942be37d841 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Calling method '>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:51:39.283145 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-8e62d4b1-44c8-49d4-ad38-7942be37d841 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] [instance: 85dc896f-7a07-400c-abc8-cc2d27bda2db] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:51:39.289583 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-8e62d4b1-44c8-49d4-ad38-7942be37d841 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:51:39.290043 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-8e62d4b1-44c8-49d4-ad38-7942be37d841 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:51:39.290829 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-8e62d4b1-44c8-49d4-ad38-7942be37d841 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:51:39.291266 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-8e62d4b1-44c8-49d4-ad38-7942be37d841 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:51:39.326917 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-8e62d4b1-44c8-49d4-ad38-7942be37d841 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:51:39.327386 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-8e62d4b1-44c8-49d4-ad38-7942be37d841 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:51:39.327845 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.objects.instance [None req-8e62d4b1-44c8-49d4-ad38-7942be37d841 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lazy-loading 'fault' on Instance uuid 85dc896f-7a07-400c-abc8-cc2d27bda2db {{(pid=124368) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 06 13:51:39.369765 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-8e62d4b1-44c8-49d4-ad38-7942be37d841 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b572a8f465048558fc969b85b2aec5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd85f2a57a0847debf5aaf81aab7a638', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:51:39.377351 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-8e62d4b1-44c8-49d4-ad38-7942be37d841 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] 10.222.0.20 "GET /compute/v2.1/servers/85dc896f-7a07-400c-abc8-cc2d27bda2db" status: 200 len: 1330 microversion: 2.1 time: 0.098676 Jul 06 13:51:39.377932 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 371/736] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:51:39 2022] GET /compute/v2.1/servers/85dc896f-7a07-400c-abc8-cc2d27bda2db => generated 1330 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 06 13:51:39.516000 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-92aad1f0-b837-42c5-8f27-34fca779cb44 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:51:39.516713 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-92aad1f0-b837-42c5-8f27-34fca779cb44 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] [instance: 546a77fd-66e1-4d89-afa3-58d632b09186] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:51:39.523498 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-92aad1f0-b837-42c5-8f27-34fca779cb44 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:51:39.523698 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-92aad1f0-b837-42c5-8f27-34fca779cb44 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:51:39.524365 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-92aad1f0-b837-42c5-8f27-34fca779cb44 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:51:39.524800 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-92aad1f0-b837-42c5-8f27-34fca779cb44 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:51:39.752504 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-92aad1f0-b837-42c5-8f27-34fca779cb44 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d7cacb73c8342579d9f990b0193487c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05df572327d54bd99595974b75898052', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:51:39.760618 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-92aad1f0-b837-42c5-8f27-34fca779cb44 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] 10.222.0.20 "GET /compute/v2.1/servers/546a77fd-66e1-4d89-afa3-58d632b09186" status: 200 len: 1677 microversion: 2.1 time: 0.248918 Jul 06 13:51:39.761209 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 366/737] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:51:39 2022] GET /compute/v2.1/servers/546a77fd-66e1-4d89-afa3-58d632b09186 => generated 1677 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:51:40.113475 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [req-3bb453ff-f896-4729-b0aa-a9e839db2f35 req-614848af-7f01-4095-accb-e5709d6c3333 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "74a59be2-69eb-4bdc-865c-570f5a2019df", "tag": "d9803c72-57aa-4aaf-b69c-e5ca48b8a2ca"}]} {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 06 13:51:40.122066 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [req-3bb453ff-f896-4729-b0aa-a9e839db2f35 req-614848af-7f01-4095-accb-e5709d6c3333 service nova] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:51:40.122744 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [req-3bb453ff-f896-4729-b0aa-a9e839db2f35 req-614848af-7f01-4095-accb-e5709d6c3333 service nova] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:51:40.133446 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.compute.server_external_events [req-3bb453ff-f896-4729-b0aa-a9e839db2f35 req-614848af-7f01-4095-accb-e5709d6c3333 service nova] Creating event network-changed:d9803c72-57aa-4aaf-b69c-e5ca48b8a2ca for instance 74a59be2-69eb-4bdc-865c-570f5a2019df on hv-cinder-81914 Jul 06 13:51:40.138677 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [req-3bb453ff-f896-4729-b0aa-a9e839db2f35 req-614848af-7f01-4095-accb-e5709d6c3333 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029135 Jul 06 13:51:40.139357 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 372/738] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 6 13:51:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 06 13:51:40.395608 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-c8d87f04-2417-423d-9bd7-f7e806c05a23 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:51:40.396237 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-c8d87f04-2417-423d-9bd7-f7e806c05a23 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] [instance: 85dc896f-7a07-400c-abc8-cc2d27bda2db] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:51:40.402233 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-c8d87f04-2417-423d-9bd7-f7e806c05a23 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:51:40.402698 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-c8d87f04-2417-423d-9bd7-f7e806c05a23 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:51:40.403500 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-c8d87f04-2417-423d-9bd7-f7e806c05a23 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:51:40.403940 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-c8d87f04-2417-423d-9bd7-f7e806c05a23 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:51:40.419874 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.wsgi [None req-c8d87f04-2417-423d-9bd7-f7e806c05a23 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] HTTP exception thrown: Instance 85dc896f-7a07-400c-abc8-cc2d27bda2db could not be found. Jul 06 13:51:40.421540 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-c8d87f04-2417-423d-9bd7-f7e806c05a23 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Request method failure captured: Jul 06 13:51:40.421540 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: request: GET /compute/v2.1/servers/85dc896f-7a07-400c-abc8-cc2d27bda2db HTTP/1.1 Jul 06 13:51:40.421540 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: Accept: application/json Jul 06 13:51:40.421540 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: Accept-Encoding: identity Jul 06 13:51:40.421540 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: Connection: close Jul 06 13:51:40.421540 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: Content-Length: 0 Jul 06 13:51:40.421540 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: Content-Type: application/json Jul 06 13:51:40.421540 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: Host: 10.222.0.20 Jul 06 13:51:40.421540 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: Openstack-System-Scope: None Jul 06 13:51:40.421540 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: User-Agent: python-urllib3/1.26.9 Jul 06 13:51:40.421540 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: X-Auth-Token: gAAAAABixZH4I4dgmb0Q3wbjrFWrBMh6OmJtrlg6lZ88SjHzAtW3fxMyo3s0_pJVvHdnPyxERhBQTWBNewTHA0QeJRzzLbnn4Csb1lAz3C9NjKcuSHUaArYBZ7P3u01dtbqramyieBExBREkl13A9tBRRuVoPmOumXVJ74UVBAMWWamo1ttSwGg Jul 06 13:51:40.421540 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: X-Domain-Id: None Jul 06 13:51:40.421540 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: X-Domain-Name: None Jul 06 13:51:40.421540 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: X-Identity-Status: Confirmed Jul 06 13:51:40.421540 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: X-Is-Admin-Project: True Jul 06 13:51:40.421540 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: X-Project-Domain-Id: default Jul 06 13:51:40.421540 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: X-Project-Domain-Name: Default Jul 06 13:51:40.421540 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: X-Project-Id: bd85f2a57a0847debf5aaf81aab7a638 Jul 06 13:51:40.421540 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: X-Project-Name: tempest-AttachVolumeNegativeTest-1016924223 Jul 06 13:51:40.421540 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: X-Role: reader,member Jul 06 13:51:40.421540 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: X-Roles: reader,member Jul 06 13:51:40.423125 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_bd85f2a57a0847debf5aaf81aab7a638"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/bd85f2a57a0847debf5aaf81aab7a638"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/bd85f2a57a0847debf5aaf81aab7a638"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/bd85f2a57a0847debf5aaf81aab7a638"}]}] Jul 06 13:51:40.423125 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: X-Tenant: tempest-AttachVolumeNegativeTest-1016924223 Jul 06 13:51:40.423125 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: X-Tenant-Id: bd85f2a57a0847debf5aaf81aab7a638 Jul 06 13:51:40.423125 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1016924223 Jul 06 13:51:40.423125 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: X-User: tempest-AttachVolumeNegativeTest-1016924223-project Jul 06 13:51:40.423125 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: X-User-Domain-Id: default Jul 06 13:51:40.423125 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: X-User-Domain-Name: Default Jul 06 13:51:40.423125 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: X-User-Id: 7b572a8f465048558fc969b85b2aec5b Jul 06 13:51:40.423125 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: X-User-Name: tempest-AttachVolumeNegativeTest-1016924223-project Jul 06 13:51:40.423125 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: method: > Jul 06 13:51:40.423125 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: exception: Instance 85dc896f-7a07-400c-abc8-cc2d27bda2db could not be found. Jul 06 13:51:40.423125 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: action_args: {'id': '85dc896f-7a07-400c-abc8-cc2d27bda2db'} Jul 06 13:51:40.424006 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 06 13:51:40.424006 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 06 13:51:40.424006 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 06 13:51:40.424006 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 06 13:51:40.424006 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 06 13:51:40.424006 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 06 13:51:40.424006 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 06 13:51:40.424006 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 06 13:51:40.424006 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 06 13:51:40.424006 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 06 13:51:40.424006 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 85dc896f-7a07-400c-abc8-cc2d27bda2db could not be found. Jul 06 13:51:40.424006 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi Jul 06 13:51:40.424006 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 06 13:51:40.424006 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi Jul 06 13:51:40.424006 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 06 13:51:40.424006 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 06 13:51:40.424006 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 06 13:51:40.424006 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 06 13:51:40.424006 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 06 13:51:40.424006 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 06 13:51:40.425809 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 06 13:51:40.425809 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 06 13:51:40.425809 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 06 13:51:40.425809 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 06 13:51:40.425809 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 06 13:51:40.425809 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 06 13:51:40.425809 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 06 13:51:40.425809 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 85dc896f-7a07-400c-abc8-cc2d27bda2db could not be found. Jul 06 13:51:40.425809 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi Jul 06 13:51:40.425809 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 06 13:51:40.425809 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi Jul 06 13:51:40.425809 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 06 13:51:40.425809 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 06 13:51:40.425809 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 06 13:51:40.425809 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 06 13:51:40.425809 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 06 13:51:40.425809 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 85dc896f-7a07-400c-abc8-cc2d27bda2db could not be found. Jul 06 13:51:40.425809 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi Jul 06 13:51:40.428345 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-c8d87f04-2417-423d-9bd7-f7e806c05a23 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Returning 404 to user: Instance 85dc896f-7a07-400c-abc8-cc2d27bda2db could not be found. {{(pid=124367) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 06 13:51:40.428345 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-c8d87f04-2417-423d-9bd7-f7e806c05a23 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] 10.222.0.20 "GET /compute/v2.1/servers/85dc896f-7a07-400c-abc8-cc2d27bda2db" status: 404 len: 111 microversion: 2.1 time: 0.032139 Jul 06 13:51:40.428345 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 367/739] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:51:40 2022] GET /compute/v2.1/servers/85dc896f-7a07-400c-abc8-cc2d27bda2db => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 06 13:51:40.434035 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-d97b1997-53d9-440f-9526-61002fa0ecb0 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Calling method '.version_select at 0x7ffbc40dcc10>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:51:40.469295 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-d97b1997-53d9-440f-9526-61002fa0ecb0 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-699048258" status: 202 len: 0 microversion: 2.1 time: 0.039832 Jul 06 13:51:40.475125 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 373/740] 10.222.0.20 () {58 vars in 1217 bytes} [Wed Jul 6 13:51:40 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-699048258 => generated 0 bytes in 46 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 06 13:51:40.776784 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-d84723ff-bc30-4ec7-8839-bc15d0cf5926 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:51:40.777526 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-d84723ff-bc30-4ec7-8839-bc15d0cf5926 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] [instance: 546a77fd-66e1-4d89-afa3-58d632b09186] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:51:40.784020 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-d84723ff-bc30-4ec7-8839-bc15d0cf5926 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:51:40.784734 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-d84723ff-bc30-4ec7-8839-bc15d0cf5926 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:51:40.786292 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-d84723ff-bc30-4ec7-8839-bc15d0cf5926 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:51:40.786789 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-d84723ff-bc30-4ec7-8839-bc15d0cf5926 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:51:40.925615 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-d84723ff-bc30-4ec7-8839-bc15d0cf5926 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d7cacb73c8342579d9f990b0193487c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05df572327d54bd99595974b75898052', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:51:40.930182 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG dbcounter [-] [124367] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=124367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:51:40.935260 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-d84723ff-bc30-4ec7-8839-bc15d0cf5926 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] 10.222.0.20 "GET /compute/v2.1/servers/546a77fd-66e1-4d89-afa3-58d632b09186" status: 200 len: 1677 microversion: 2.1 time: 0.162328 Jul 06 13:51:40.935823 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 368/741] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:51:40 2022] GET /compute/v2.1/servers/546a77fd-66e1-4d89-afa3-58d632b09186 => generated 1677 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:51:41.203626 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-58424ac2-c0c9-48e7-957c-d045d2a115a6 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Calling method '>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:51:41.204243 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-58424ac2-c0c9-48e7-957c-d045d2a115a6 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] [instance: 5cf73c2b-28f6-49f1-a119-224c05679d2c] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:51:41.211610 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-58424ac2-c0c9-48e7-957c-d045d2a115a6 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:51:41.212057 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-58424ac2-c0c9-48e7-957c-d045d2a115a6 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:51:41.212816 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-58424ac2-c0c9-48e7-957c-d045d2a115a6 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:51:41.213277 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-58424ac2-c0c9-48e7-957c-d045d2a115a6 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:51:41.291013 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.objects.instance [None req-58424ac2-c0c9-48e7-957c-d045d2a115a6 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lazy-loading 'services' on Instance uuid 5cf73c2b-28f6-49f1-a119-224c05679d2c {{(pid=124368) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 06 13:51:41.403942 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-58424ac2-c0c9-48e7-957c-d045d2a115a6 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] 10.222.0.20 "DELETE /compute/v2.1/servers/5cf73c2b-28f6-49f1-a119-224c05679d2c/os-volume_attachments/56776123-3d65-4f21-8214-ad1c2ba18e6b" status: 202 len: 0 microversion: 2.1 time: 0.204618 Jul 06 13:51:41.404573 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 374/742] 10.222.0.20 () {58 vars in 1415 bytes} [Wed Jul 6 13:51:41 2022] DELETE /compute/v2.1/servers/5cf73c2b-28f6-49f1-a119-224c05679d2c/os-volume_attachments/56776123-3d65-4f21-8214-ad1c2ba18e6b => generated 0 bytes in 206 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 06 13:51:41.414213 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-8914f583-da20-42a5-af0a-b277effd596c tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:51:41.415137 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-8914f583-da20-42a5-af0a-b277effd596c tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] [instance: 5cf73c2b-28f6-49f1-a119-224c05679d2c] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:51:41.421536 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-8914f583-da20-42a5-af0a-b277effd596c tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:51:41.421987 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-8914f583-da20-42a5-af0a-b277effd596c tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:51:41.422749 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-8914f583-da20-42a5-af0a-b277effd596c tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:51:41.423246 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-8914f583-da20-42a5-af0a-b277effd596c tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:51:41.454853 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-8914f583-da20-42a5-af0a-b277effd596c tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] 10.222.0.20 "GET /compute/v2.1/servers/5cf73c2b-28f6-49f1-a119-224c05679d2c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045536 Jul 06 13:51:41.455409 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 369/743] 10.222.0.20 () {58 vars in 1301 bytes} [Wed Jul 6 13:51:41 2022] GET /compute/v2.1/servers/5cf73c2b-28f6-49f1-a119-224c05679d2c/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 06 13:51:41.955185 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-e51dbe84-3905-48d1-95ae-bbdaa62177d2 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Calling method '>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:51:41.955880 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-e51dbe84-3905-48d1-95ae-bbdaa62177d2 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] [instance: 546a77fd-66e1-4d89-afa3-58d632b09186] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:51:41.963517 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-e51dbe84-3905-48d1-95ae-bbdaa62177d2 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:51:41.963994 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-e51dbe84-3905-48d1-95ae-bbdaa62177d2 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:51:41.964774 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-e51dbe84-3905-48d1-95ae-bbdaa62177d2 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:51:41.965244 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-e51dbe84-3905-48d1-95ae-bbdaa62177d2 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:51:42.104502 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-e51dbe84-3905-48d1-95ae-bbdaa62177d2 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d7cacb73c8342579d9f990b0193487c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05df572327d54bd99595974b75898052', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:51:42.112154 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-e51dbe84-3905-48d1-95ae-bbdaa62177d2 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] 10.222.0.20 "GET /compute/v2.1/servers/546a77fd-66e1-4d89-afa3-58d632b09186" status: 200 len: 1677 microversion: 2.1 time: 0.161652 Jul 06 13:51:42.112719 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 375/744] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:51:41 2022] GET /compute/v2.1/servers/546a77fd-66e1-4d89-afa3-58d632b09186 => generated 1677 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:51:42.153328 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [req-675b5a8a-bc94-41bd-a160-09c466183fe5 req-18991b84-817b-41bf-8524-8dc44ab1bbc6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "74a59be2-69eb-4bdc-865c-570f5a2019df", "tag": "d9803c72-57aa-4aaf-b69c-e5ca48b8a2ca"}]} {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 06 13:51:42.162297 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [req-675b5a8a-bc94-41bd-a160-09c466183fe5 req-18991b84-817b-41bf-8524-8dc44ab1bbc6 service nova] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:51:42.162731 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [req-675b5a8a-bc94-41bd-a160-09c466183fe5 req-18991b84-817b-41bf-8524-8dc44ab1bbc6 service nova] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:51:42.173405 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.compute.server_external_events [req-675b5a8a-bc94-41bd-a160-09c466183fe5 req-18991b84-817b-41bf-8524-8dc44ab1bbc6 service nova] Creating event network-changed:d9803c72-57aa-4aaf-b69c-e5ca48b8a2ca for instance 74a59be2-69eb-4bdc-865c-570f5a2019df on hv-cinder-81914 Jul 06 13:51:42.179356 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [req-675b5a8a-bc94-41bd-a160-09c466183fe5 req-18991b84-817b-41bf-8524-8dc44ab1bbc6 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029547 Jul 06 13:51:42.179933 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 370/745] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 6 13:51:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 06 13:51:42.467373 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-4cc80744-213a-4410-b144-70e951f4b4c6 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Calling method '>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:51:42.468496 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-4cc80744-213a-4410-b144-70e951f4b4c6 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] [instance: 5cf73c2b-28f6-49f1-a119-224c05679d2c] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:51:42.475222 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-4cc80744-213a-4410-b144-70e951f4b4c6 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:51:42.475673 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-4cc80744-213a-4410-b144-70e951f4b4c6 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:51:42.476452 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-4cc80744-213a-4410-b144-70e951f4b4c6 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:51:42.476891 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-4cc80744-213a-4410-b144-70e951f4b4c6 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:51:42.507654 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-4cc80744-213a-4410-b144-70e951f4b4c6 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] 10.222.0.20 "GET /compute/v2.1/servers/5cf73c2b-28f6-49f1-a119-224c05679d2c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044111 Jul 06 13:51:42.508137 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 376/746] 10.222.0.20 () {58 vars in 1301 bytes} [Wed Jul 6 13:51:42 2022] GET /compute/v2.1/servers/5cf73c2b-28f6-49f1-a119-224c05679d2c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 06 13:51:43.130739 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-b0b77109-aed8-41ca-a1f0-246945dcfe07 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:51:43.131447 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-b0b77109-aed8-41ca-a1f0-246945dcfe07 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] [instance: 546a77fd-66e1-4d89-afa3-58d632b09186] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:51:43.137786 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-b0b77109-aed8-41ca-a1f0-246945dcfe07 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:51:43.138242 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-b0b77109-aed8-41ca-a1f0-246945dcfe07 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:51:43.139007 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-b0b77109-aed8-41ca-a1f0-246945dcfe07 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:51:43.139447 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-b0b77109-aed8-41ca-a1f0-246945dcfe07 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:51:43.271503 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-b0b77109-aed8-41ca-a1f0-246945dcfe07 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d7cacb73c8342579d9f990b0193487c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05df572327d54bd99595974b75898052', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:51:43.279055 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-b0b77109-aed8-41ca-a1f0-246945dcfe07 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] 10.222.0.20 "GET /compute/v2.1/servers/546a77fd-66e1-4d89-afa3-58d632b09186" status: 200 len: 1677 microversion: 2.1 time: 0.153144 Jul 06 13:51:43.279615 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 371/747] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:51:43 2022] GET /compute/v2.1/servers/546a77fd-66e1-4d89-afa3-58d632b09186 => generated 1677 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:51:43.519153 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-c17936ac-df96-4e1e-876d-ac0c504eb0aa tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Calling method '>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:51:43.520442 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-c17936ac-df96-4e1e-876d-ac0c504eb0aa tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] [instance: 5cf73c2b-28f6-49f1-a119-224c05679d2c] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:51:43.527342 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-c17936ac-df96-4e1e-876d-ac0c504eb0aa tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:51:43.527787 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-c17936ac-df96-4e1e-876d-ac0c504eb0aa tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:51:43.528551 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-c17936ac-df96-4e1e-876d-ac0c504eb0aa tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:51:43.528984 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-c17936ac-df96-4e1e-876d-ac0c504eb0aa tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:51:43.561164 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-c17936ac-df96-4e1e-876d-ac0c504eb0aa tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] 10.222.0.20 "GET /compute/v2.1/servers/5cf73c2b-28f6-49f1-a119-224c05679d2c/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045761 Jul 06 13:51:43.561640 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 377/748] 10.222.0.20 () {58 vars in 1301 bytes} [Wed Jul 6 13:51:43 2022] GET /compute/v2.1/servers/5cf73c2b-28f6-49f1-a119-224c05679d2c/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 06 13:51:43.619529 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-48a898d7-caf1-4475-895a-ea48563d1c88 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:51:43.620027 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-48a898d7-caf1-4475-895a-ea48563d1c88 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] [instance: 5cf73c2b-28f6-49f1-a119-224c05679d2c] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:51:43.626094 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-48a898d7-caf1-4475-895a-ea48563d1c88 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:51:43.626545 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-48a898d7-caf1-4475-895a-ea48563d1c88 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:51:43.627301 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-48a898d7-caf1-4475-895a-ea48563d1c88 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:51:43.627738 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-48a898d7-caf1-4475-895a-ea48563d1c88 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:51:43.652488 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-48a898d7-caf1-4475-895a-ea48563d1c88 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] [instance: 5cf73c2b-28f6-49f1-a119-224c05679d2c] Going to try to terminate instance {{(pid=124367) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 06 13:51:43.738484 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-48a898d7-caf1-4475-895a-ea48563d1c88 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] 10.222.0.20 "DELETE /compute/v2.1/servers/5cf73c2b-28f6-49f1-a119-224c05679d2c" status: 204 len: 0 microversion: 2.1 time: 0.122168 Jul 06 13:51:43.739583 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 372/749] 10.222.0.20 () {58 vars in 1238 bytes} [Wed Jul 6 13:51:43 2022] DELETE /compute/v2.1/servers/5cf73c2b-28f6-49f1-a119-224c05679d2c => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 06 13:51:43.750065 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-9e829194-6049-4941-b2ca-1281ab1e2614 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Calling method '>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:51:43.751041 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-9e829194-6049-4941-b2ca-1281ab1e2614 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] [instance: 5cf73c2b-28f6-49f1-a119-224c05679d2c] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:51:43.759713 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-9e829194-6049-4941-b2ca-1281ab1e2614 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:51:43.760393 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-9e829194-6049-4941-b2ca-1281ab1e2614 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:51:43.761628 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-9e829194-6049-4941-b2ca-1281ab1e2614 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:51:43.762296 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-9e829194-6049-4941-b2ca-1281ab1e2614 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:51:43.897165 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-9e829194-6049-4941-b2ca-1281ab1e2614 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b572a8f465048558fc969b85b2aec5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd85f2a57a0847debf5aaf81aab7a638', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:51:43.904673 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-9e829194-6049-4941-b2ca-1281ab1e2614 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] 10.222.0.20 "GET /compute/v2.1/servers/5cf73c2b-28f6-49f1-a119-224c05679d2c" status: 200 len: 1682 microversion: 2.1 time: 0.160862 Jul 06 13:51:43.905271 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 378/750] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:51:43 2022] GET /compute/v2.1/servers/5cf73c2b-28f6-49f1-a119-224c05679d2c => generated 1682 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:51:44.296807 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-05c423b2-35ab-4587-af6b-89a9b30f3df8 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:51:44.297530 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-05c423b2-35ab-4587-af6b-89a9b30f3df8 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] [instance: 546a77fd-66e1-4d89-afa3-58d632b09186] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:51:44.304584 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-05c423b2-35ab-4587-af6b-89a9b30f3df8 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:51:44.305064 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-05c423b2-35ab-4587-af6b-89a9b30f3df8 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:51:44.305833 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-05c423b2-35ab-4587-af6b-89a9b30f3df8 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:51:44.306267 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-05c423b2-35ab-4587-af6b-89a9b30f3df8 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:51:44.436904 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-05c423b2-35ab-4587-af6b-89a9b30f3df8 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d7cacb73c8342579d9f990b0193487c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05df572327d54bd99595974b75898052', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:51:44.445279 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-05c423b2-35ab-4587-af6b-89a9b30f3df8 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] 10.222.0.20 "GET /compute/v2.1/servers/546a77fd-66e1-4d89-afa3-58d632b09186" status: 200 len: 1677 microversion: 2.1 time: 0.152649 Jul 06 13:51:44.445842 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 373/751] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:51:44 2022] GET /compute/v2.1/servers/546a77fd-66e1-4d89-afa3-58d632b09186 => generated 1677 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:51:44.922589 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-f6de772f-bb4f-4937-9340-2941a113b027 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Calling method '>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:51:44.923101 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-f6de772f-bb4f-4937-9340-2941a113b027 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] [instance: 5cf73c2b-28f6-49f1-a119-224c05679d2c] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:51:44.930482 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-f6de772f-bb4f-4937-9340-2941a113b027 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:51:44.930929 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-f6de772f-bb4f-4937-9340-2941a113b027 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:51:44.931688 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-f6de772f-bb4f-4937-9340-2941a113b027 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:51:44.932119 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-f6de772f-bb4f-4937-9340-2941a113b027 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:51:45.064161 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-f6de772f-bb4f-4937-9340-2941a113b027 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b572a8f465048558fc969b85b2aec5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd85f2a57a0847debf5aaf81aab7a638', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:51:45.071866 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-f6de772f-bb4f-4937-9340-2941a113b027 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] 10.222.0.20 "GET /compute/v2.1/servers/5cf73c2b-28f6-49f1-a119-224c05679d2c" status: 200 len: 1682 microversion: 2.1 time: 0.153162 Jul 06 13:51:45.072472 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 379/752] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:51:44 2022] GET /compute/v2.1/servers/5cf73c2b-28f6-49f1-a119-224c05679d2c => generated 1682 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:51:45.462659 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-bd419355-801e-4f7d-b92e-49b7f9ea0fb4 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:51:45.463262 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-bd419355-801e-4f7d-b92e-49b7f9ea0fb4 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] [instance: 546a77fd-66e1-4d89-afa3-58d632b09186] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:51:45.469625 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-bd419355-801e-4f7d-b92e-49b7f9ea0fb4 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:51:45.470073 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-bd419355-801e-4f7d-b92e-49b7f9ea0fb4 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:51:45.470841 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-bd419355-801e-4f7d-b92e-49b7f9ea0fb4 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:51:45.471272 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-bd419355-801e-4f7d-b92e-49b7f9ea0fb4 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:51:45.724800 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-bd419355-801e-4f7d-b92e-49b7f9ea0fb4 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d7cacb73c8342579d9f990b0193487c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05df572327d54bd99595974b75898052', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:51:45.732204 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-bd419355-801e-4f7d-b92e-49b7f9ea0fb4 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] 10.222.0.20 "GET /compute/v2.1/servers/546a77fd-66e1-4d89-afa3-58d632b09186" status: 200 len: 1677 microversion: 2.1 time: 0.273327 Jul 06 13:51:45.732771 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 374/753] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:51:45 2022] GET /compute/v2.1/servers/546a77fd-66e1-4d89-afa3-58d632b09186 => generated 1677 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:51:46.089164 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-98ec4be7-d597-4cf8-988b-a6b2c35a60b9 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Calling method '>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:51:46.089778 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-98ec4be7-d597-4cf8-988b-a6b2c35a60b9 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] [instance: 5cf73c2b-28f6-49f1-a119-224c05679d2c] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:51:46.096516 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-98ec4be7-d597-4cf8-988b-a6b2c35a60b9 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:51:46.098017 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-98ec4be7-d597-4cf8-988b-a6b2c35a60b9 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:51:46.099184 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-98ec4be7-d597-4cf8-988b-a6b2c35a60b9 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:51:46.099705 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-98ec4be7-d597-4cf8-988b-a6b2c35a60b9 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:51:46.159188 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [req-1e624460-1b35-42e9-89bb-19da5c3aea67 req-af25be00-6117-482e-b963-b10a26c48a02 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5cf73c2b-28f6-49f1-a119-224c05679d2c", "name": "network-vif-deleted", "tag": "eb26a6ef-8459-409e-986c-7f71a4f52683"}]} {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 06 13:51:46.169860 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-98ec4be7-d597-4cf8-988b-a6b2c35a60b9 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b572a8f465048558fc969b85b2aec5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd85f2a57a0847debf5aaf81aab7a638', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:51:46.170888 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [req-1e624460-1b35-42e9-89bb-19da5c3aea67 req-af25be00-6117-482e-b963-b10a26c48a02 service nova] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:51:46.171336 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [req-1e624460-1b35-42e9-89bb-19da5c3aea67 req-af25be00-6117-482e-b963-b10a26c48a02 service nova] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:51:46.181784 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-98ec4be7-d597-4cf8-988b-a6b2c35a60b9 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] 10.222.0.20 "GET /compute/v2.1/servers/5cf73c2b-28f6-49f1-a119-224c05679d2c" status: 200 len: 1614 microversion: 2.1 time: 0.096332 Jul 06 13:51:46.182725 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 380/754] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:51:46 2022] GET /compute/v2.1/servers/5cf73c2b-28f6-49f1-a119-224c05679d2c => generated 1614 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:51:46.185984 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.compute.server_external_events [req-1e624460-1b35-42e9-89bb-19da5c3aea67 req-af25be00-6117-482e-b963-b10a26c48a02 service nova] Creating event network-vif-deleted:eb26a6ef-8459-409e-986c-7f71a4f52683 for instance 5cf73c2b-28f6-49f1-a119-224c05679d2c on hv-cinder-81914 Jul 06 13:51:46.190908 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [req-1e624460-1b35-42e9-89bb-19da5c3aea67 req-af25be00-6117-482e-b963-b10a26c48a02 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035964 Jul 06 13:51:46.192533 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 375/755] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 6 13:51:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 06 13:51:46.749870 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-83243c27-866d-479b-81f3-3ab5e9fc6348 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Calling method '>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:51:46.750617 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-83243c27-866d-479b-81f3-3ab5e9fc6348 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] [instance: 546a77fd-66e1-4d89-afa3-58d632b09186] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:51:46.758088 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-83243c27-866d-479b-81f3-3ab5e9fc6348 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:51:46.758631 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-83243c27-866d-479b-81f3-3ab5e9fc6348 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:51:46.759349 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-83243c27-866d-479b-81f3-3ab5e9fc6348 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:51:46.759804 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-83243c27-866d-479b-81f3-3ab5e9fc6348 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:51:46.900111 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-83243c27-866d-479b-81f3-3ab5e9fc6348 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d7cacb73c8342579d9f990b0193487c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05df572327d54bd99595974b75898052', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:51:46.907940 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-83243c27-866d-479b-81f3-3ab5e9fc6348 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] 10.222.0.20 "GET /compute/v2.1/servers/546a77fd-66e1-4d89-afa3-58d632b09186" status: 200 len: 1677 microversion: 2.1 time: 0.162843 Jul 06 13:51:46.908522 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 381/756] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:51:46 2022] GET /compute/v2.1/servers/546a77fd-66e1-4d89-afa3-58d632b09186 => generated 1677 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:51:47.199348 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-09734ad4-6633-4756-b9a5-dd8f6ba97deb tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:51:47.200050 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-09734ad4-6633-4756-b9a5-dd8f6ba97deb tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] [instance: 5cf73c2b-28f6-49f1-a119-224c05679d2c] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:51:47.207149 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-09734ad4-6633-4756-b9a5-dd8f6ba97deb tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:51:47.207594 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-09734ad4-6633-4756-b9a5-dd8f6ba97deb tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:51:47.208363 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-09734ad4-6633-4756-b9a5-dd8f6ba97deb tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:51:47.208804 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-09734ad4-6633-4756-b9a5-dd8f6ba97deb tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:51:47.221748 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.wsgi [None req-09734ad4-6633-4756-b9a5-dd8f6ba97deb tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] HTTP exception thrown: Instance 5cf73c2b-28f6-49f1-a119-224c05679d2c could not be found. Jul 06 13:51:47.224221 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-09734ad4-6633-4756-b9a5-dd8f6ba97deb tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Request method failure captured: Jul 06 13:51:47.224221 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: request: GET /compute/v2.1/servers/5cf73c2b-28f6-49f1-a119-224c05679d2c HTTP/1.1 Jul 06 13:51:47.224221 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: Accept: application/json Jul 06 13:51:47.224221 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: Accept-Encoding: identity Jul 06 13:51:47.224221 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: Connection: close Jul 06 13:51:47.224221 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: Content-Length: 0 Jul 06 13:51:47.224221 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: Content-Type: application/json Jul 06 13:51:47.224221 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: Host: 10.222.0.20 Jul 06 13:51:47.224221 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: Openstack-System-Scope: None Jul 06 13:51:47.224221 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: User-Agent: python-urllib3/1.26.9 Jul 06 13:51:47.224221 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: X-Auth-Token: gAAAAABixZH4I4dgmb0Q3wbjrFWrBMh6OmJtrlg6lZ88SjHzAtW3fxMyo3s0_pJVvHdnPyxERhBQTWBNewTHA0QeJRzzLbnn4Csb1lAz3C9NjKcuSHUaArYBZ7P3u01dtbqramyieBExBREkl13A9tBRRuVoPmOumXVJ74UVBAMWWamo1ttSwGg Jul 06 13:51:47.224221 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: X-Domain-Id: None Jul 06 13:51:47.224221 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: X-Domain-Name: None Jul 06 13:51:47.224221 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: X-Identity-Status: Confirmed Jul 06 13:51:47.224221 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: X-Is-Admin-Project: True Jul 06 13:51:47.224221 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: X-Project-Domain-Id: default Jul 06 13:51:47.224221 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: X-Project-Domain-Name: Default Jul 06 13:51:47.224221 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: X-Project-Id: bd85f2a57a0847debf5aaf81aab7a638 Jul 06 13:51:47.224221 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: X-Project-Name: tempest-AttachVolumeNegativeTest-1016924223 Jul 06 13:51:47.224221 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: X-Role: reader,member Jul 06 13:51:47.224221 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: X-Roles: reader,member Jul 06 13:51:47.225774 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_bd85f2a57a0847debf5aaf81aab7a638"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/bd85f2a57a0847debf5aaf81aab7a638"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/bd85f2a57a0847debf5aaf81aab7a638"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/bd85f2a57a0847debf5aaf81aab7a638"}]}] Jul 06 13:51:47.225774 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: X-Tenant: tempest-AttachVolumeNegativeTest-1016924223 Jul 06 13:51:47.225774 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: X-Tenant-Id: bd85f2a57a0847debf5aaf81aab7a638 Jul 06 13:51:47.225774 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1016924223 Jul 06 13:51:47.225774 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: X-User: tempest-AttachVolumeNegativeTest-1016924223-project Jul 06 13:51:47.225774 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: X-User-Domain-Id: default Jul 06 13:51:47.225774 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: X-User-Domain-Name: Default Jul 06 13:51:47.225774 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: X-User-Id: 7b572a8f465048558fc969b85b2aec5b Jul 06 13:51:47.225774 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: X-User-Name: tempest-AttachVolumeNegativeTest-1016924223-project Jul 06 13:51:47.225774 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: method: > Jul 06 13:51:47.225774 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: exception: Instance 5cf73c2b-28f6-49f1-a119-224c05679d2c could not be found. Jul 06 13:51:47.225774 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: action_args: {'id': '5cf73c2b-28f6-49f1-a119-224c05679d2c'} Jul 06 13:51:47.226634 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 06 13:51:47.226634 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 06 13:51:47.226634 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 06 13:51:47.226634 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 06 13:51:47.226634 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 06 13:51:47.226634 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 06 13:51:47.226634 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 06 13:51:47.226634 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 06 13:51:47.226634 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 06 13:51:47.226634 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 06 13:51:47.226634 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5cf73c2b-28f6-49f1-a119-224c05679d2c could not be found. Jul 06 13:51:47.226634 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi Jul 06 13:51:47.226634 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 06 13:51:47.226634 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi Jul 06 13:51:47.226634 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 06 13:51:47.226634 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 06 13:51:47.226634 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 06 13:51:47.226634 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 06 13:51:47.226634 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 06 13:51:47.226634 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 06 13:51:47.228010 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 06 13:51:47.228010 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 06 13:51:47.228010 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 06 13:51:47.228010 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 06 13:51:47.228010 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 06 13:51:47.228010 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 06 13:51:47.228010 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 06 13:51:47.228010 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5cf73c2b-28f6-49f1-a119-224c05679d2c could not be found. Jul 06 13:51:47.228010 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi Jul 06 13:51:47.228010 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 06 13:51:47.228010 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi Jul 06 13:51:47.228010 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 06 13:51:47.228010 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 06 13:51:47.228010 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 06 13:51:47.228010 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 06 13:51:47.228010 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 06 13:51:47.228010 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5cf73c2b-28f6-49f1-a119-224c05679d2c could not be found. Jul 06 13:51:47.228010 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi Jul 06 13:51:47.229307 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-09734ad4-6633-4756-b9a5-dd8f6ba97deb tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Returning 404 to user: Instance 5cf73c2b-28f6-49f1-a119-224c05679d2c could not be found. {{(pid=124367) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 06 13:51:47.229307 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-09734ad4-6633-4756-b9a5-dd8f6ba97deb tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] 10.222.0.20 "GET /compute/v2.1/servers/5cf73c2b-28f6-49f1-a119-224c05679d2c" status: 404 len: 111 microversion: 2.1 time: 0.030551 Jul 06 13:51:47.229307 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 376/757] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:51:47 2022] GET /compute/v2.1/servers/5cf73c2b-28f6-49f1-a119-224c05679d2c => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 06 13:51:47.234358 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-c55b6144-8595-4bac-92a6-ead8ac12ead1 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Calling method '.version_select at 0x7ffbbf7d6310>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:51:47.252042 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-c55b6144-8595-4bac-92a6-ead8ac12ead1 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-577538698" status: 202 len: 0 microversion: 2.1 time: 0.021307 Jul 06 13:51:47.252528 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 382/758] 10.222.0.20 () {58 vars in 1217 bytes} [Wed Jul 6 13:51:47 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-577538698 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 06 13:51:47.927273 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-a1e2efda-927c-47d1-8931-5d59c78e9cbb tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:51:47.927983 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-a1e2efda-927c-47d1-8931-5d59c78e9cbb tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] [instance: 546a77fd-66e1-4d89-afa3-58d632b09186] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:51:47.934223 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-a1e2efda-927c-47d1-8931-5d59c78e9cbb tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:51:47.934765 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-a1e2efda-927c-47d1-8931-5d59c78e9cbb tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:51:47.935600 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-a1e2efda-927c-47d1-8931-5d59c78e9cbb tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:51:47.936100 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-a1e2efda-927c-47d1-8931-5d59c78e9cbb tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:51:48.174691 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-a1e2efda-927c-47d1-8931-5d59c78e9cbb tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d7cacb73c8342579d9f990b0193487c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05df572327d54bd99595974b75898052', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:51:48.182262 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-a1e2efda-927c-47d1-8931-5d59c78e9cbb tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] 10.222.0.20 "GET /compute/v2.1/servers/546a77fd-66e1-4d89-afa3-58d632b09186" status: 200 len: 1677 microversion: 2.1 time: 0.260704 Jul 06 13:51:48.182833 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 377/759] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:51:47 2022] GET /compute/v2.1/servers/546a77fd-66e1-4d89-afa3-58d632b09186 => generated 1677 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:51:48.225944 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-42bcb3c8-605f-479b-b1f1-e6a879a67544 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Action: 'create', calling method: .version_select at 0x7ffbbf7e64c0>, body: {"keypair": {"name": "tempest-keypair-1745217203", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL4rL+SCz2epcsRq2+rtqi+mGH9gd0u55t8zY1liKqrYr1bIgcSmS8xfnzSjmP3dOt7KLMabK1cfYMA1ZPHUOooaqso+8qVBFnBml/cgf3fwwJV6IC/UeUSqXAjQtC+0Xw=="}} {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 06 13:51:48.245171 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.quota [None req-42bcb3c8-605f-479b-b1f1-e6a879a67544 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Getting quotas for project bd85f2a57a0847debf5aaf81aab7a638. Resources: {'key_pairs'} {{(pid=124368) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 06 13:51:48.248931 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.quota [None req-42bcb3c8-605f-479b-b1f1-e6a879a67544 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Getting quotas for user 7b572a8f465048558fc969b85b2aec5b and project bd85f2a57a0847debf5aaf81aab7a638. Resources: {'key_pairs'} {{(pid=124368) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 06 13:51:48.271592 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-42bcb3c8-605f-479b-b1f1-e6a879a67544 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.049675 Jul 06 13:51:48.272183 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 383/760] 10.222.0.20 () {60 vars in 1158 bytes} [Wed Jul 6 13:51:48 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 06 13:51:49.199848 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-dadece5f-2168-42e6-bc66-6c38af9224f5 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:51:49.201136 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-dadece5f-2168-42e6-bc66-6c38af9224f5 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] [instance: 546a77fd-66e1-4d89-afa3-58d632b09186] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:51:49.208104 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-dadece5f-2168-42e6-bc66-6c38af9224f5 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:51:49.208558 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-dadece5f-2168-42e6-bc66-6c38af9224f5 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:51:49.209363 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-dadece5f-2168-42e6-bc66-6c38af9224f5 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:51:49.209806 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-dadece5f-2168-42e6-bc66-6c38af9224f5 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:51:49.344240 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-dadece5f-2168-42e6-bc66-6c38af9224f5 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d7cacb73c8342579d9f990b0193487c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05df572327d54bd99595974b75898052', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:51:49.352618 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-dadece5f-2168-42e6-bc66-6c38af9224f5 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] 10.222.0.20 "GET /compute/v2.1/servers/546a77fd-66e1-4d89-afa3-58d632b09186" status: 200 len: 1677 microversion: 2.1 time: 0.156780 Jul 06 13:51:49.353714 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 378/761] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:51:49 2022] GET /compute/v2.1/servers/546a77fd-66e1-4d89-afa3-58d632b09186 => generated 1677 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:51:49.513397 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-aab46f3b-fa01-4ec1-aefb-81ced85def4f tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1172979563", "imageRef": "b08481d9-1e39-41e8-97bd-b05a9c35b377", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "599de418-b206-4788-89c1-e9276ab94414"}], "security_groups": [{"name": "tempest-securitygroup--484782922"}], "key_name": "tempest-keypair-1745217203", "user_data": "}} {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 06 13:51:49.614362 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.network.neutron [None req-aab46f3b-fa01-4ec1-aefb-81ced85def4f tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] validate_networks() for [('599de418-b206-4788-89c1-e9276ab94414', None, None, None, None, None)] {{(pid=124368) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 06 13:51:49.793416 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG dbcounter [-] [124368] Writing DB stats nova_api:SELECT=94,nova_api:DELETE=2,nova_api:INSERT=1 {{(pid=124368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:51:49.988798 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.virt.hardware [None req-aab46f3b-fa01-4ec1-aefb-81ced85def4f tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Flavor limits 0:0:0 {{(pid=124368) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 06 13:51:49.989343 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.virt.hardware [None req-aab46f3b-fa01-4ec1-aefb-81ced85def4f tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Image limits 0:0:0 {{(pid=124368) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 06 13:51:49.989819 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.virt.hardware [None req-aab46f3b-fa01-4ec1-aefb-81ced85def4f tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Flavor pref 0:0:0 {{(pid=124368) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 06 13:51:49.991178 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.virt.hardware [None req-aab46f3b-fa01-4ec1-aefb-81ced85def4f tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Image pref 0:0:0 {{(pid=124368) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 06 13:51:49.991178 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.virt.hardware [None req-aab46f3b-fa01-4ec1-aefb-81ced85def4f tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124368) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 06 13:51:50.001160 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-aab46f3b-fa01-4ec1-aefb-81ced85def4f tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:51:50.001611 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-aab46f3b-fa01-4ec1-aefb-81ced85def4f tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:51:50.002434 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-aab46f3b-fa01-4ec1-aefb-81ced85def4f tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:51:50.002870 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-aab46f3b-fa01-4ec1-aefb-81ced85def4f tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:51:50.026709 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.quota [None req-aab46f3b-fa01-4ec1-aefb-81ced85def4f tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Getting quotas for project bd85f2a57a0847debf5aaf81aab7a638. Resources: {'instances', 'cores', 'ram'} {{(pid=124368) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 06 13:51:50.032691 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.quota [None req-aab46f3b-fa01-4ec1-aefb-81ced85def4f tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Getting quotas for user 7b572a8f465048558fc969b85b2aec5b and project bd85f2a57a0847debf5aaf81aab7a638. Resources: {'instances', 'cores', 'ram'} {{(pid=124368) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 06 13:51:50.046704 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-aab46f3b-fa01-4ec1-aefb-81ced85def4f tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Going to run 1 instances... {{(pid=124368) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 06 13:51:50.048966 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-aab46f3b-fa01-4ec1-aefb-81ced85def4f tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] [instance: d82144a2-d572-4e58-852c-7553331127cc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b08481d9-1e39-41e8-97bd-b05a9c35b377',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124368) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 06 13:51:50.108475 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-aab46f3b-fa01-4ec1-aefb-81ced85def4f tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.599791 Jul 06 13:51:50.109146 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 384/762] 10.222.0.20 () {60 vars in 1146 bytes} [Wed Jul 6 13:51:49 2022] POST /compute/v2.1/servers => generated 401 bytes in 601 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 06 13:51:50.120784 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-4a40a0fb-00db-454c-9d8c-fa52af79ddfa tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:51:50.124216 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-4a40a0fb-00db-454c-9d8c-fa52af79ddfa tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] [instance: d82144a2-d572-4e58-852c-7553331127cc] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:51:50.178712 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-4a40a0fb-00db-454c-9d8c-fa52af79ddfa tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b572a8f465048558fc969b85b2aec5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd85f2a57a0847debf5aaf81aab7a638', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:51:50.187065 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-4a40a0fb-00db-454c-9d8c-fa52af79ddfa tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] 10.222.0.20 "GET /compute/v2.1/servers/d82144a2-d572-4e58-852c-7553331127cc" status: 200 len: 1242 microversion: 2.1 time: 0.070577 Jul 06 13:51:50.187514 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 379/763] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:51:50 2022] GET /compute/v2.1/servers/d82144a2-d572-4e58-852c-7553331127cc => generated 1242 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:51:50.371608 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-31f64d86-295a-4daa-8e43-579528fd759e tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Calling method '>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:51:50.372664 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-31f64d86-295a-4daa-8e43-579528fd759e tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] [instance: 546a77fd-66e1-4d89-afa3-58d632b09186] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:51:50.379418 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-31f64d86-295a-4daa-8e43-579528fd759e tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:51:50.379601 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-31f64d86-295a-4daa-8e43-579528fd759e tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:51:50.380708 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-31f64d86-295a-4daa-8e43-579528fd759e tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:51:50.381254 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-31f64d86-295a-4daa-8e43-579528fd759e tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:51:50.551583 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-31f64d86-295a-4daa-8e43-579528fd759e tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d7cacb73c8342579d9f990b0193487c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05df572327d54bd99595974b75898052', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:51:50.560238 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-31f64d86-295a-4daa-8e43-579528fd759e tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] 10.222.0.20 "GET /compute/v2.1/servers/546a77fd-66e1-4d89-afa3-58d632b09186" status: 200 len: 1677 microversion: 2.1 time: 0.193700 Jul 06 13:51:50.560887 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 385/764] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:51:50 2022] GET /compute/v2.1/servers/546a77fd-66e1-4d89-afa3-58d632b09186 => generated 1677 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:51:51.203507 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-6f63d45e-2ee6-4872-bac1-f41e44e02a66 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:51:51.204109 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-6f63d45e-2ee6-4872-bac1-f41e44e02a66 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] [instance: d82144a2-d572-4e58-852c-7553331127cc] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:51:51.206837 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG dbcounter [-] [124367] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=2 {{(pid=124367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:51:51.213470 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-6f63d45e-2ee6-4872-bac1-f41e44e02a66 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:51:51.213916 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-6f63d45e-2ee6-4872-bac1-f41e44e02a66 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:51:51.214738 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-6f63d45e-2ee6-4872-bac1-f41e44e02a66 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:51:51.215169 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-6f63d45e-2ee6-4872-bac1-f41e44e02a66 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:51:51.293837 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-6f63d45e-2ee6-4872-bac1-f41e44e02a66 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b572a8f465048558fc969b85b2aec5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd85f2a57a0847debf5aaf81aab7a638', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:51:51.305690 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-6f63d45e-2ee6-4872-bac1-f41e44e02a66 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] 10.222.0.20 "GET /compute/v2.1/servers/d82144a2-d572-4e58-852c-7553331127cc" status: 200 len: 1302 microversion: 2.1 time: 0.105700 Jul 06 13:51:51.306581 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 380/765] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:51:51 2022] GET /compute/v2.1/servers/d82144a2-d572-4e58-852c-7553331127cc => generated 1302 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:51:51.578797 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-33f109a2-e939-47f3-a256-abaad01f6e00 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Calling method '>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:51:51.579337 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-33f109a2-e939-47f3-a256-abaad01f6e00 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] [instance: 546a77fd-66e1-4d89-afa3-58d632b09186] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:51:51.585923 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-33f109a2-e939-47f3-a256-abaad01f6e00 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:51:51.586374 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-33f109a2-e939-47f3-a256-abaad01f6e00 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:51:51.587144 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-33f109a2-e939-47f3-a256-abaad01f6e00 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:51:51.587584 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-33f109a2-e939-47f3-a256-abaad01f6e00 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:51:51.607459 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG dbcounter [-] [124368] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=124368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:51:51.725685 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-33f109a2-e939-47f3-a256-abaad01f6e00 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d7cacb73c8342579d9f990b0193487c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05df572327d54bd99595974b75898052', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:51:51.733274 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-33f109a2-e939-47f3-a256-abaad01f6e00 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] 10.222.0.20 "GET /compute/v2.1/servers/546a77fd-66e1-4d89-afa3-58d632b09186" status: 200 len: 1677 microversion: 2.1 time: 0.158324 Jul 06 13:51:51.733889 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 386/766] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:51:51 2022] GET /compute/v2.1/servers/546a77fd-66e1-4d89-afa3-58d632b09186 => generated 1677 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:51:52.323579 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-ae25e7ca-6593-400f-94e8-6d5ddf82579d tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:51:52.324245 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-ae25e7ca-6593-400f-94e8-6d5ddf82579d tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] [instance: d82144a2-d572-4e58-852c-7553331127cc] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:51:52.331261 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-ae25e7ca-6593-400f-94e8-6d5ddf82579d tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:51:52.332001 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-ae25e7ca-6593-400f-94e8-6d5ddf82579d tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:51:52.332771 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-ae25e7ca-6593-400f-94e8-6d5ddf82579d tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:51:52.333379 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-ae25e7ca-6593-400f-94e8-6d5ddf82579d tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:51:52.580123 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-ae25e7ca-6593-400f-94e8-6d5ddf82579d tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b572a8f465048558fc969b85b2aec5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd85f2a57a0847debf5aaf81aab7a638', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:51:52.587681 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-ae25e7ca-6593-400f-94e8-6d5ddf82579d tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] 10.222.0.20 "GET /compute/v2.1/servers/d82144a2-d572-4e58-852c-7553331127cc" status: 200 len: 1367 microversion: 2.1 time: 0.268118 Jul 06 13:51:52.588248 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 381/767] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:51:52 2022] GET /compute/v2.1/servers/d82144a2-d572-4e58-852c-7553331127cc => generated 1367 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:51:52.750887 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-a551793d-dec9-4983-b42b-4b0309389254 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Calling method '>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:51:52.751326 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-a551793d-dec9-4983-b42b-4b0309389254 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] [instance: 546a77fd-66e1-4d89-afa3-58d632b09186] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:51:52.758019 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-a551793d-dec9-4983-b42b-4b0309389254 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:51:52.758483 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-a551793d-dec9-4983-b42b-4b0309389254 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:51:52.759335 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-a551793d-dec9-4983-b42b-4b0309389254 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:51:52.759781 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-a551793d-dec9-4983-b42b-4b0309389254 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:51:52.901461 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-a551793d-dec9-4983-b42b-4b0309389254 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d7cacb73c8342579d9f990b0193487c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05df572327d54bd99595974b75898052', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:51:52.909437 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-a551793d-dec9-4983-b42b-4b0309389254 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] 10.222.0.20 "GET /compute/v2.1/servers/546a77fd-66e1-4d89-afa3-58d632b09186" status: 200 len: 1677 microversion: 2.1 time: 0.162737 Jul 06 13:51:52.910009 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 387/768] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:51:52 2022] GET /compute/v2.1/servers/546a77fd-66e1-4d89-afa3-58d632b09186 => generated 1677 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:51:52.939050 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [req-d88cf504-0661-4c33-bc65-e5d62943a318 req-8dcfffda-860a-4558-b7cf-9262e76a2aa6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d82144a2-d572-4e58-852c-7553331127cc", "tag": "07de552b-eff5-4b04-9e8d-032f865a589a"}]} {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 06 13:51:52.948667 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [req-d88cf504-0661-4c33-bc65-e5d62943a318 req-8dcfffda-860a-4558-b7cf-9262e76a2aa6 service nova] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:51:52.949066 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [req-d88cf504-0661-4c33-bc65-e5d62943a318 req-8dcfffda-860a-4558-b7cf-9262e76a2aa6 service nova] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:51:52.968488 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.compute.server_external_events [req-d88cf504-0661-4c33-bc65-e5d62943a318 req-8dcfffda-860a-4558-b7cf-9262e76a2aa6 service nova] Creating event network-changed:07de552b-eff5-4b04-9e8d-032f865a589a for instance d82144a2-d572-4e58-852c-7553331127cc on hv-cinder-81914 Jul 06 13:51:52.973874 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [req-d88cf504-0661-4c33-bc65-e5d62943a318 req-8dcfffda-860a-4558-b7cf-9262e76a2aa6 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038409 Jul 06 13:51:52.978687 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 382/769] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 6 13:51:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 06 13:51:53.605063 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-f5680285-7d44-49c4-9038-45fc74edc315 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Calling method '>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:51:53.605726 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-f5680285-7d44-49c4-9038-45fc74edc315 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] [instance: d82144a2-d572-4e58-852c-7553331127cc] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:51:53.611669 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-f5680285-7d44-49c4-9038-45fc74edc315 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:51:53.612128 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-f5680285-7d44-49c4-9038-45fc74edc315 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:51:53.612900 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-f5680285-7d44-49c4-9038-45fc74edc315 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:51:53.613374 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-f5680285-7d44-49c4-9038-45fc74edc315 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:51:53.743717 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-f5680285-7d44-49c4-9038-45fc74edc315 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b572a8f465048558fc969b85b2aec5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd85f2a57a0847debf5aaf81aab7a638', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:51:53.750989 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-f5680285-7d44-49c4-9038-45fc74edc315 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] 10.222.0.20 "GET /compute/v2.1/servers/d82144a2-d572-4e58-852c-7553331127cc" status: 200 len: 1367 microversion: 2.1 time: 0.150108 Jul 06 13:51:53.751571 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 388/770] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:51:53 2022] GET /compute/v2.1/servers/d82144a2-d572-4e58-852c-7553331127cc => generated 1367 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:51:53.929601 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-5c96d74b-09b7-4745-973b-c23df308d7c4 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:51:53.930216 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-5c96d74b-09b7-4745-973b-c23df308d7c4 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] [instance: 546a77fd-66e1-4d89-afa3-58d632b09186] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:51:53.936460 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-5c96d74b-09b7-4745-973b-c23df308d7c4 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:51:53.936914 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-5c96d74b-09b7-4745-973b-c23df308d7c4 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:51:53.937712 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-5c96d74b-09b7-4745-973b-c23df308d7c4 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:51:53.938151 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-5c96d74b-09b7-4745-973b-c23df308d7c4 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:51:54.068098 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-5c96d74b-09b7-4745-973b-c23df308d7c4 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d7cacb73c8342579d9f990b0193487c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05df572327d54bd99595974b75898052', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:51:54.075653 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-5c96d74b-09b7-4745-973b-c23df308d7c4 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] 10.222.0.20 "GET /compute/v2.1/servers/546a77fd-66e1-4d89-afa3-58d632b09186" status: 200 len: 1677 microversion: 2.1 time: 0.151999 Jul 06 13:51:54.076240 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 383/771] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:51:53 2022] GET /compute/v2.1/servers/546a77fd-66e1-4d89-afa3-58d632b09186 => generated 1677 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:51:54.767621 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-b8aaff2c-59e6-4406-9946-998f884d52ea tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Calling method '>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:51:54.768237 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-b8aaff2c-59e6-4406-9946-998f884d52ea tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] [instance: d82144a2-d572-4e58-852c-7553331127cc] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:51:54.776258 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-b8aaff2c-59e6-4406-9946-998f884d52ea tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:51:54.776710 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-b8aaff2c-59e6-4406-9946-998f884d52ea tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:51:54.777491 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-b8aaff2c-59e6-4406-9946-998f884d52ea tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:51:54.777924 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-b8aaff2c-59e6-4406-9946-998f884d52ea tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:51:54.904625 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-b8aaff2c-59e6-4406-9946-998f884d52ea tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b572a8f465048558fc969b85b2aec5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd85f2a57a0847debf5aaf81aab7a638', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:51:54.911996 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-b8aaff2c-59e6-4406-9946-998f884d52ea tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] 10.222.0.20 "GET /compute/v2.1/servers/d82144a2-d572-4e58-852c-7553331127cc" status: 200 len: 1367 microversion: 2.1 time: 0.148175 Jul 06 13:51:54.912577 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 389/772] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:51:54 2022] GET /compute/v2.1/servers/d82144a2-d572-4e58-852c-7553331127cc => generated 1367 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:51:55.092551 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-0f5107ea-e2f9-4754-b7ee-4bc8a4398c7b tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:51:55.093188 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-0f5107ea-e2f9-4754-b7ee-4bc8a4398c7b tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] [instance: 546a77fd-66e1-4d89-afa3-58d632b09186] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:51:55.099614 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-0f5107ea-e2f9-4754-b7ee-4bc8a4398c7b tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:51:55.100104 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-0f5107ea-e2f9-4754-b7ee-4bc8a4398c7b tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:51:55.100885 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-0f5107ea-e2f9-4754-b7ee-4bc8a4398c7b tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:51:55.101333 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-0f5107ea-e2f9-4754-b7ee-4bc8a4398c7b tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:51:55.228488 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-0f5107ea-e2f9-4754-b7ee-4bc8a4398c7b tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d7cacb73c8342579d9f990b0193487c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05df572327d54bd99595974b75898052', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:51:55.235888 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-0f5107ea-e2f9-4754-b7ee-4bc8a4398c7b tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] 10.222.0.20 "GET /compute/v2.1/servers/546a77fd-66e1-4d89-afa3-58d632b09186" status: 200 len: 1677 microversion: 2.1 time: 0.147159 Jul 06 13:51:55.236450 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 384/773] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:51:55 2022] GET /compute/v2.1/servers/546a77fd-66e1-4d89-afa3-58d632b09186 => generated 1677 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:51:55.929340 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-c323501a-f641-4d16-b5c6-0e307a9f9803 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Calling method '>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:51:55.929978 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-c323501a-f641-4d16-b5c6-0e307a9f9803 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] [instance: d82144a2-d572-4e58-852c-7553331127cc] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:51:55.936342 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-c323501a-f641-4d16-b5c6-0e307a9f9803 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:51:55.936789 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-c323501a-f641-4d16-b5c6-0e307a9f9803 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:51:55.937577 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-c323501a-f641-4d16-b5c6-0e307a9f9803 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:51:55.938014 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-c323501a-f641-4d16-b5c6-0e307a9f9803 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:51:56.069730 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-c323501a-f641-4d16-b5c6-0e307a9f9803 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b572a8f465048558fc969b85b2aec5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd85f2a57a0847debf5aaf81aab7a638', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:51:56.077130 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-c323501a-f641-4d16-b5c6-0e307a9f9803 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] 10.222.0.20 "GET /compute/v2.1/servers/d82144a2-d572-4e58-852c-7553331127cc" status: 200 len: 1367 microversion: 2.1 time: 0.151872 Jul 06 13:51:56.077702 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 390/774] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:51:55 2022] GET /compute/v2.1/servers/d82144a2-d572-4e58-852c-7553331127cc => generated 1367 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:51:56.253370 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-5e54e81f-ed82-4336-b274-7d1e19a84f8a tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:51:56.253977 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-5e54e81f-ed82-4336-b274-7d1e19a84f8a tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] [instance: 546a77fd-66e1-4d89-afa3-58d632b09186] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:51:56.261134 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-5e54e81f-ed82-4336-b274-7d1e19a84f8a tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:51:56.261589 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-5e54e81f-ed82-4336-b274-7d1e19a84f8a tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:51:56.262348 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-5e54e81f-ed82-4336-b274-7d1e19a84f8a tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:51:56.262775 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-5e54e81f-ed82-4336-b274-7d1e19a84f8a tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:51:56.476712 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-5e54e81f-ed82-4336-b274-7d1e19a84f8a tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d7cacb73c8342579d9f990b0193487c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05df572327d54bd99595974b75898052', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:51:56.484772 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-5e54e81f-ed82-4336-b274-7d1e19a84f8a tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] 10.222.0.20 "GET /compute/v2.1/servers/546a77fd-66e1-4d89-afa3-58d632b09186" status: 200 len: 1654 microversion: 2.1 time: 0.235174 Jul 06 13:51:56.485742 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 385/775] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:51:56 2022] GET /compute/v2.1/servers/546a77fd-66e1-4d89-afa3-58d632b09186 => generated 1654 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:51:56.503382 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-694c8d7b-c301-4400-bfc4-0a0d2fb2bfee tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 06 13:51:56.510578 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-694c8d7b-c301-4400-bfc4-0a0d2fb2bfee tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:51:56.511037 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-694c8d7b-c301-4400-bfc4-0a0d2fb2bfee tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:51:56.578982 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-694c8d7b-c301-4400-bfc4-0a0d2fb2bfee tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] [instance: 546a77fd-66e1-4d89-afa3-58d632b09186] Going to try to start instance {{(pid=124368) start /opt/stack/nova/nova/compute/api.py:2730}} Jul 06 13:51:56.622172 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-694c8d7b-c301-4400-bfc4-0a0d2fb2bfee tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] 10.222.0.20 "POST /compute/v2.1/servers/546a77fd-66e1-4d89-afa3-58d632b09186/action" status: 202 len: 0 microversion: 2.1 time: 0.122205 Jul 06 13:51:56.623061 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 391/776] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Jul 6 13:51:56 2022] POST /compute/v2.1/servers/546a77fd-66e1-4d89-afa3-58d632b09186/action => generated 0 bytes in 124 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 06 13:51:56.630861 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-2a53f4fa-dc51-40b5-b46b-325069ce0b91 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:51:56.631730 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-2a53f4fa-dc51-40b5-b46b-325069ce0b91 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] [instance: 546a77fd-66e1-4d89-afa3-58d632b09186] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:51:56.638426 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-2a53f4fa-dc51-40b5-b46b-325069ce0b91 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:51:56.638881 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-2a53f4fa-dc51-40b5-b46b-325069ce0b91 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:51:56.639666 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-2a53f4fa-dc51-40b5-b46b-325069ce0b91 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:51:56.640099 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-2a53f4fa-dc51-40b5-b46b-325069ce0b91 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:51:56.776418 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-2a53f4fa-dc51-40b5-b46b-325069ce0b91 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d7cacb73c8342579d9f990b0193487c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05df572327d54bd99595974b75898052', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:51:56.783938 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-2a53f4fa-dc51-40b5-b46b-325069ce0b91 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] 10.222.0.20 "GET /compute/v2.1/servers/546a77fd-66e1-4d89-afa3-58d632b09186" status: 200 len: 1663 microversion: 2.1 time: 0.156908 Jul 06 13:51:56.784491 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 386/777] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:51:56 2022] GET /compute/v2.1/servers/546a77fd-66e1-4d89-afa3-58d632b09186 => generated 1663 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 06 13:51:57.095555 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-b5cfa37b-a0e0-451f-b8e5-856d6ffc4a97 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Calling method '>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:51:57.096247 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-b5cfa37b-a0e0-451f-b8e5-856d6ffc4a97 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] [instance: d82144a2-d572-4e58-852c-7553331127cc] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:51:57.102905 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-b5cfa37b-a0e0-451f-b8e5-856d6ffc4a97 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:51:57.103354 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-b5cfa37b-a0e0-451f-b8e5-856d6ffc4a97 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:51:57.104112 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-b5cfa37b-a0e0-451f-b8e5-856d6ffc4a97 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:51:57.104543 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-b5cfa37b-a0e0-451f-b8e5-856d6ffc4a97 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:51:57.234151 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-b5cfa37b-a0e0-451f-b8e5-856d6ffc4a97 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b572a8f465048558fc969b85b2aec5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd85f2a57a0847debf5aaf81aab7a638', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:51:57.242037 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-b5cfa37b-a0e0-451f-b8e5-856d6ffc4a97 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] 10.222.0.20 "GET /compute/v2.1/servers/d82144a2-d572-4e58-852c-7553331127cc" status: 200 len: 1367 microversion: 2.1 time: 0.151219 Jul 06 13:51:57.242596 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 392/778] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:51:57 2022] GET /compute/v2.1/servers/d82144a2-d572-4e58-852c-7553331127cc => generated 1367 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:51:57.802885 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-96d44788-c59a-4121-ab5c-7025639c29f5 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:51:57.804003 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-96d44788-c59a-4121-ab5c-7025639c29f5 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] [instance: 546a77fd-66e1-4d89-afa3-58d632b09186] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:51:57.810478 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-96d44788-c59a-4121-ab5c-7025639c29f5 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:51:57.810925 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-96d44788-c59a-4121-ab5c-7025639c29f5 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:51:57.811684 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-96d44788-c59a-4121-ab5c-7025639c29f5 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:51:57.812113 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-96d44788-c59a-4121-ab5c-7025639c29f5 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:51:57.830749 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG dbcounter [-] [124367] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:51:57.956435 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-96d44788-c59a-4121-ab5c-7025639c29f5 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d7cacb73c8342579d9f990b0193487c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05df572327d54bd99595974b75898052', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:51:57.964738 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-96d44788-c59a-4121-ab5c-7025639c29f5 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] 10.222.0.20 "GET /compute/v2.1/servers/546a77fd-66e1-4d89-afa3-58d632b09186" status: 200 len: 1663 microversion: 2.1 time: 0.165967 Jul 06 13:51:57.965591 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 387/779] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:51:57 2022] GET /compute/v2.1/servers/546a77fd-66e1-4d89-afa3-58d632b09186 => generated 1663 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:51:58.258820 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-b0de07b1-23ac-42b5-9a7d-bd12078bb95e tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Calling method '>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:51:58.259452 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-b0de07b1-23ac-42b5-9a7d-bd12078bb95e tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] [instance: d82144a2-d572-4e58-852c-7553331127cc] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:51:58.265969 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-b0de07b1-23ac-42b5-9a7d-bd12078bb95e tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:51:58.266416 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-b0de07b1-23ac-42b5-9a7d-bd12078bb95e tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:51:58.267175 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-b0de07b1-23ac-42b5-9a7d-bd12078bb95e tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:51:58.267611 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-b0de07b1-23ac-42b5-9a7d-bd12078bb95e tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:51:58.393121 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-b0de07b1-23ac-42b5-9a7d-bd12078bb95e tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b572a8f465048558fc969b85b2aec5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd85f2a57a0847debf5aaf81aab7a638', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:51:58.401091 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-b0de07b1-23ac-42b5-9a7d-bd12078bb95e tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] 10.222.0.20 "GET /compute/v2.1/servers/d82144a2-d572-4e58-852c-7553331127cc" status: 200 len: 1367 microversion: 2.1 time: 0.146256 Jul 06 13:51:58.401642 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 393/780] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:51:58 2022] GET /compute/v2.1/servers/d82144a2-d572-4e58-852c-7553331127cc => generated 1367 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:51:58.983267 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-3851abd2-ba34-4fe9-8aa6-059e9f2c6989 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:51:58.983791 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-3851abd2-ba34-4fe9-8aa6-059e9f2c6989 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] [instance: 546a77fd-66e1-4d89-afa3-58d632b09186] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:51:58.989979 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-3851abd2-ba34-4fe9-8aa6-059e9f2c6989 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:51:58.990442 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-3851abd2-ba34-4fe9-8aa6-059e9f2c6989 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:51:58.991251 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-3851abd2-ba34-4fe9-8aa6-059e9f2c6989 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:51:58.991678 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-3851abd2-ba34-4fe9-8aa6-059e9f2c6989 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:51:59.117979 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-3851abd2-ba34-4fe9-8aa6-059e9f2c6989 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d7cacb73c8342579d9f990b0193487c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05df572327d54bd99595974b75898052', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:51:59.125593 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-3851abd2-ba34-4fe9-8aa6-059e9f2c6989 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] 10.222.0.20 "GET /compute/v2.1/servers/546a77fd-66e1-4d89-afa3-58d632b09186" status: 200 len: 1667 microversion: 2.1 time: 0.146306 Jul 06 13:51:59.126163 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 388/781] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:51:58 2022] GET /compute/v2.1/servers/546a77fd-66e1-4d89-afa3-58d632b09186 => generated 1667 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:51:59.418458 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-cce4c491-908d-4472-93eb-685bcb98b2a2 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Calling method '>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:51:59.419072 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-cce4c491-908d-4472-93eb-685bcb98b2a2 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] [instance: d82144a2-d572-4e58-852c-7553331127cc] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:51:59.425813 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-cce4c491-908d-4472-93eb-685bcb98b2a2 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:51:59.426266 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-cce4c491-908d-4472-93eb-685bcb98b2a2 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:51:59.427033 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-cce4c491-908d-4472-93eb-685bcb98b2a2 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:51:59.427470 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-cce4c491-908d-4472-93eb-685bcb98b2a2 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:51:59.564738 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-cce4c491-908d-4472-93eb-685bcb98b2a2 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b572a8f465048558fc969b85b2aec5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd85f2a57a0847debf5aaf81aab7a638', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:51:59.572162 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-cce4c491-908d-4472-93eb-685bcb98b2a2 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] 10.222.0.20 "GET /compute/v2.1/servers/d82144a2-d572-4e58-852c-7553331127cc" status: 200 len: 1367 microversion: 2.1 time: 0.157633 Jul 06 13:51:59.572718 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 394/782] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:51:59 2022] GET /compute/v2.1/servers/d82144a2-d572-4e58-852c-7553331127cc => generated 1367 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 06 13:52:00.255793 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [req-6f4a18fc-bd2a-4f89-bb11-37930c12f6d8 req-e6995937-2b89-486e-8bc2-4d742ceba3a4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d82144a2-d572-4e58-852c-7553331127cc", "name": "network-vif-plugged", "status": "completed", "tag": "07de552b-eff5-4b04-9e8d-032f865a589a"}]} {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 06 13:52:00.260952 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG dbcounter [-] [124367] Writing DB stats nova_cell0:SELECT=2 {{(pid=124367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:52:00.268866 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [req-6f4a18fc-bd2a-4f89-bb11-37930c12f6d8 req-e6995937-2b89-486e-8bc2-4d742ceba3a4 service nova] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:52:00.269622 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [req-6f4a18fc-bd2a-4f89-bb11-37930c12f6d8 req-e6995937-2b89-486e-8bc2-4d742ceba3a4 service nova] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:52:00.281821 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.compute.server_external_events [req-6f4a18fc-bd2a-4f89-bb11-37930c12f6d8 req-e6995937-2b89-486e-8bc2-4d742ceba3a4 service nova] Creating event network-vif-plugged:07de552b-eff5-4b04-9e8d-032f865a589a for instance d82144a2-d572-4e58-852c-7553331127cc on hv-cinder-81914 Jul 06 13:52:00.287099 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [req-6f4a18fc-bd2a-4f89-bb11-37930c12f6d8 req-e6995937-2b89-486e-8bc2-4d742ceba3a4 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034790 Jul 06 13:52:00.288216 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 389/783] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 6 13:52:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 06 13:52:00.588904 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-e9ad056e-ac48-4e58-8725-13d68adf449e tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Calling method '>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:52:00.589636 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-e9ad056e-ac48-4e58-8725-13d68adf449e tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] [instance: d82144a2-d572-4e58-852c-7553331127cc] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:52:00.591553 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG dbcounter [-] [124368] Writing DB stats nova_cell0:SELECT=2 {{(pid=124368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:52:00.592328 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG dbcounter [-] [124368] Writing DB stats nova_cell0:SELECT=10 {{(pid=124368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:52:00.598496 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-e9ad056e-ac48-4e58-8725-13d68adf449e tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:52:00.598948 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-e9ad056e-ac48-4e58-8725-13d68adf449e tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:52:00.599714 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-e9ad056e-ac48-4e58-8725-13d68adf449e tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:52:00.600152 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-e9ad056e-ac48-4e58-8725-13d68adf449e tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:52:00.727728 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-e9ad056e-ac48-4e58-8725-13d68adf449e tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b572a8f465048558fc969b85b2aec5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd85f2a57a0847debf5aaf81aab7a638', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:52:00.735257 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-e9ad056e-ac48-4e58-8725-13d68adf449e tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] 10.222.0.20 "GET /compute/v2.1/servers/d82144a2-d572-4e58-852c-7553331127cc" status: 200 len: 1367 microversion: 2.1 time: 0.150413 Jul 06 13:52:00.735827 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 395/784] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:52:00 2022] GET /compute/v2.1/servers/d82144a2-d572-4e58-852c-7553331127cc => generated 1367 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:52:01.752439 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-d0cb68ee-0873-49cb-b957-8e269e7ab2e5 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:52:01.753170 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-d0cb68ee-0873-49cb-b957-8e269e7ab2e5 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] [instance: d82144a2-d572-4e58-852c-7553331127cc] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:52:01.761138 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-d0cb68ee-0873-49cb-b957-8e269e7ab2e5 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:52:01.761589 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-d0cb68ee-0873-49cb-b957-8e269e7ab2e5 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:52:01.762347 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-d0cb68ee-0873-49cb-b957-8e269e7ab2e5 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:52:01.762783 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-d0cb68ee-0873-49cb-b957-8e269e7ab2e5 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:52:01.895694 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-d0cb68ee-0873-49cb-b957-8e269e7ab2e5 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b572a8f465048558fc969b85b2aec5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd85f2a57a0847debf5aaf81aab7a638', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:52:01.903520 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-d0cb68ee-0873-49cb-b957-8e269e7ab2e5 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] 10.222.0.20 "GET /compute/v2.1/servers/d82144a2-d572-4e58-852c-7553331127cc" status: 200 len: 1367 microversion: 2.1 time: 0.155542 Jul 06 13:52:01.904075 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 390/785] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:52:01 2022] GET /compute/v2.1/servers/d82144a2-d572-4e58-852c-7553331127cc => generated 1367 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:52:02.920366 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-54b95f9a-c1e2-4616-bfc8-207c98791613 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Calling method '>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:52:02.920956 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-54b95f9a-c1e2-4616-bfc8-207c98791613 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] [instance: d82144a2-d572-4e58-852c-7553331127cc] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:52:02.927855 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-54b95f9a-c1e2-4616-bfc8-207c98791613 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:52:02.928372 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-54b95f9a-c1e2-4616-bfc8-207c98791613 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:52:02.930027 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-54b95f9a-c1e2-4616-bfc8-207c98791613 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:52:02.930270 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-54b95f9a-c1e2-4616-bfc8-207c98791613 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:52:03.078003 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-54b95f9a-c1e2-4616-bfc8-207c98791613 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b572a8f465048558fc969b85b2aec5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd85f2a57a0847debf5aaf81aab7a638', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:52:03.086433 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-54b95f9a-c1e2-4616-bfc8-207c98791613 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] 10.222.0.20 "GET /compute/v2.1/servers/d82144a2-d572-4e58-852c-7553331127cc" status: 200 len: 1558 microversion: 2.1 time: 0.170033 Jul 06 13:52:03.086998 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 396/786] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:52:02 2022] GET /compute/v2.1/servers/d82144a2-d572-4e58-852c-7553331127cc => generated 1558 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:52:03.103389 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-b382e2f2-3337-4989-8eb6-a1f8ef809eb2 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:52:03.103926 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-b382e2f2-3337-4989-8eb6-a1f8ef809eb2 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] [instance: d82144a2-d572-4e58-852c-7553331127cc] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:52:03.110308 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-b382e2f2-3337-4989-8eb6-a1f8ef809eb2 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:52:03.110754 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-b382e2f2-3337-4989-8eb6-a1f8ef809eb2 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:52:03.111504 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-b382e2f2-3337-4989-8eb6-a1f8ef809eb2 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:52:03.111928 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-b382e2f2-3337-4989-8eb6-a1f8ef809eb2 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:52:03.193461 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-b382e2f2-3337-4989-8eb6-a1f8ef809eb2 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] 10.222.0.20 "GET /compute/v2.1/servers/d82144a2-d572-4e58-852c-7553331127cc/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.093859 Jul 06 13:52:03.194079 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 391/787] 10.222.0.20 () {58 vars in 1274 bytes} [Wed Jul 6 13:52:03 2022] GET /compute/v2.1/servers/d82144a2-d572-4e58-852c-7553331127cc/os-interface => generated 285 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 06 13:52:04.389652 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [req-394699f5-e1c4-40a1-a111-d7ef1d161455 req-6dae6df5-363c-4bf8-9594-45bfba2a4574 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d82144a2-d572-4e58-852c-7553331127cc", "tag": "07de552b-eff5-4b04-9e8d-032f865a589a"}]} {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 06 13:52:04.398114 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [req-394699f5-e1c4-40a1-a111-d7ef1d161455 req-6dae6df5-363c-4bf8-9594-45bfba2a4574 service nova] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:52:04.398617 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [req-394699f5-e1c4-40a1-a111-d7ef1d161455 req-6dae6df5-363c-4bf8-9594-45bfba2a4574 service nova] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:52:04.411916 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.compute.server_external_events [req-394699f5-e1c4-40a1-a111-d7ef1d161455 req-6dae6df5-363c-4bf8-9594-45bfba2a4574 service nova] Creating event network-changed:07de552b-eff5-4b04-9e8d-032f865a589a for instance d82144a2-d572-4e58-852c-7553331127cc on hv-cinder-81914 Jul 06 13:52:04.417163 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [req-394699f5-e1c4-40a1-a111-d7ef1d161455 req-6dae6df5-363c-4bf8-9594-45bfba2a4574 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031142 Jul 06 13:52:04.417969 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 397/788] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 6 13:52:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 06 13:52:28.301606 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG dbcounter [-] [124367] Writing DB stats nova_api:SELECT=23 {{(pid=124367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:52:28.302383 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG dbcounter [-] [124367] Writing DB stats nova_cell1:SELECT=20 {{(pid=124367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:52:28.307059 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-08044e82-2506-4207-8f4f-4fcb0653dd69 tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-45974178"}} {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 06 13:52:28.307587 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-08044e82-2506-4207-8f4f-4fcb0653dd69 tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] [instance: 4895b615-7e9b-4a58-ac74-008e7ba87aad] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:52:28.314312 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-08044e82-2506-4207-8f4f-4fcb0653dd69 tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:52:28.314753 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-08044e82-2506-4207-8f4f-4fcb0653dd69 tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:52:28.315517 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-08044e82-2506-4207-8f4f-4fcb0653dd69 tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:52:28.315945 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-08044e82-2506-4207-8f4f-4fcb0653dd69 tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:52:28.440485 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.network.security_group_api [None req-08044e82-2506-4207-8f4f-4fcb0653dd69 tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] Removing security group 911fd285-b97a-4259-b460-245e9ba659eb from port 41ac049c-27f7-4531-b7d5-cc2e3f0f8c79 Jul 06 13:52:28.783442 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-08044e82-2506-4207-8f4f-4fcb0653dd69 tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] 10.222.0.20 "POST /compute/v2.1/servers/4895b615-7e9b-4a58-ac74-008e7ba87aad/action" status: 202 len: 0 microversion: 2.1 time: 0.482627 Jul 06 13:52:28.790039 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 392/789] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Jul 6 13:52:28 2022] POST /compute/v2.1/servers/4895b615-7e9b-4a58-ac74-008e7ba87aad/action => generated 0 bytes in 491 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 06 13:52:28.793606 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG dbcounter [-] [124368] Writing DB stats nova_api:SELECT=38,nova_api:INSERT=3 {{(pid=124368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:52:28.795683 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG dbcounter [-] [124368] Writing DB stats nova_cell1:SELECT=68,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:52:28.801171 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [req-c1d4d9bc-176a-4839-8ade-e0d1b69398b8 req-0a445c00-e1c5-4785-a3bc-dad675c4de25 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4895b615-7e9b-4a58-ac74-008e7ba87aad", "tag": "41ac049c-27f7-4531-b7d5-cc2e3f0f8c79"}]} {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 06 13:52:28.813884 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [req-c1d4d9bc-176a-4839-8ade-e0d1b69398b8 req-0a445c00-e1c5-4785-a3bc-dad675c4de25 service nova] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:52:28.814551 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [req-c1d4d9bc-176a-4839-8ade-e0d1b69398b8 req-0a445c00-e1c5-4785-a3bc-dad675c4de25 service nova] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:52:28.830399 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.compute.server_external_events [req-c1d4d9bc-176a-4839-8ade-e0d1b69398b8 req-0a445c00-e1c5-4785-a3bc-dad675c4de25 service nova] Creating event network-changed:41ac049c-27f7-4531-b7d5-cc2e3f0f8c79 for instance 4895b615-7e9b-4a58-ac74-008e7ba87aad on hv-cinder-81914 Jul 06 13:52:28.838262 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [req-c1d4d9bc-176a-4839-8ade-e0d1b69398b8 req-0a445c00-e1c5-4785-a3bc-dad675c4de25 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046335 Jul 06 13:52:28.839181 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 398/790] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 6 13:52:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 06 13:52:29.983109 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-1f21f13f-b665-4058-9633-ab92a975c71a tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:52:29.983625 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-1f21f13f-b665-4058-9633-ab92a975c71a tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] [instance: 4895b615-7e9b-4a58-ac74-008e7ba87aad] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:52:29.984858 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [req-6dedb866-2e50-4be0-98dd-ceae3d9bdf6d req-1d365ea0-c488-4866-a05d-67e6c0ed3020 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4895b615-7e9b-4a58-ac74-008e7ba87aad", "tag": "41ac049c-27f7-4531-b7d5-cc2e3f0f8c79"}]} {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 06 13:52:29.990196 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-1f21f13f-b665-4058-9633-ab92a975c71a tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:52:29.991564 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-1f21f13f-b665-4058-9633-ab92a975c71a tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:52:29.992455 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-1f21f13f-b665-4058-9633-ab92a975c71a tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:52:29.992919 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-1f21f13f-b665-4058-9633-ab92a975c71a tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:52:29.996912 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [req-6dedb866-2e50-4be0-98dd-ceae3d9bdf6d req-1d365ea0-c488-4866-a05d-67e6c0ed3020 service nova] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:52:29.997694 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [req-6dedb866-2e50-4be0-98dd-ceae3d9bdf6d req-1d365ea0-c488-4866-a05d-67e6c0ed3020 service nova] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:52:30.009403 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.compute.server_external_events [req-6dedb866-2e50-4be0-98dd-ceae3d9bdf6d req-1d365ea0-c488-4866-a05d-67e6c0ed3020 service nova] Creating event network-changed:41ac049c-27f7-4531-b7d5-cc2e3f0f8c79 for instance 4895b615-7e9b-4a58-ac74-008e7ba87aad on hv-cinder-81914 Jul 06 13:52:30.015279 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [req-6dedb866-2e50-4be0-98dd-ceae3d9bdf6d req-1d365ea0-c488-4866-a05d-67e6c0ed3020 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034270 Jul 06 13:52:30.015877 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 399/791] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 6 13:52:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 06 13:52:30.078008 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.objects.instance [None req-1f21f13f-b665-4058-9633-ab92a975c71a tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] Lazy-loading 'services' on Instance uuid 4895b615-7e9b-4a58-ac74-008e7ba87aad {{(pid=124367) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 06 13:52:30.159029 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-1f21f13f-b665-4058-9633-ab92a975c71a tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] 10.222.0.20 "DELETE /compute/v2.1/servers/4895b615-7e9b-4a58-ac74-008e7ba87aad/os-volume_attachments/49d30f07-dd29-4b18-9c55-772059fc7a2d" status: 202 len: 0 microversion: 2.1 time: 0.179908 Jul 06 13:52:30.159867 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 393/792] 10.222.0.20 () {58 vars in 1415 bytes} [Wed Jul 6 13:52:29 2022] DELETE /compute/v2.1/servers/4895b615-7e9b-4a58-ac74-008e7ba87aad/os-volume_attachments/49d30f07-dd29-4b18-9c55-772059fc7a2d => generated 0 bytes in 182 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 06 13:52:30.169927 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-11b4c751-074b-4105-b6b6-29c43795806f tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] Calling method '>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:52:30.170957 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-11b4c751-074b-4105-b6b6-29c43795806f tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] [instance: 4895b615-7e9b-4a58-ac74-008e7ba87aad] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:52:30.178096 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-11b4c751-074b-4105-b6b6-29c43795806f tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:52:30.178849 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-11b4c751-074b-4105-b6b6-29c43795806f tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:52:30.180654 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-11b4c751-074b-4105-b6b6-29c43795806f tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:52:30.181145 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-11b4c751-074b-4105-b6b6-29c43795806f tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:52:30.219800 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-11b4c751-074b-4105-b6b6-29c43795806f tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] 10.222.0.20 "GET /compute/v2.1/servers/4895b615-7e9b-4a58-ac74-008e7ba87aad/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054687 Jul 06 13:52:30.225053 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 400/793] 10.222.0.20 () {58 vars in 1301 bytes} [Wed Jul 6 13:52:30 2022] GET /compute/v2.1/servers/4895b615-7e9b-4a58-ac74-008e7ba87aad/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 06 13:52:31.233610 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-e6263635-c590-4375-b2d3-c67f2b42f7f5 tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:52:31.234619 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-e6263635-c590-4375-b2d3-c67f2b42f7f5 tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] [instance: 4895b615-7e9b-4a58-ac74-008e7ba87aad] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:52:31.241779 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-e6263635-c590-4375-b2d3-c67f2b42f7f5 tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:52:31.242310 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-e6263635-c590-4375-b2d3-c67f2b42f7f5 tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:52:31.243142 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-e6263635-c590-4375-b2d3-c67f2b42f7f5 tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:52:31.243578 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-e6263635-c590-4375-b2d3-c67f2b42f7f5 tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:52:31.273519 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-e6263635-c590-4375-b2d3-c67f2b42f7f5 tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] 10.222.0.20 "GET /compute/v2.1/servers/4895b615-7e9b-4a58-ac74-008e7ba87aad/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045036 Jul 06 13:52:31.274083 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 394/794] 10.222.0.20 () {58 vars in 1301 bytes} [Wed Jul 6 13:52:31 2022] GET /compute/v2.1/servers/4895b615-7e9b-4a58-ac74-008e7ba87aad/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 06 13:52:32.285330 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-c677f583-e434-4168-a5b3-5b870e328644 tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] Calling method '>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:52:32.286278 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-c677f583-e434-4168-a5b3-5b870e328644 tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] [instance: 4895b615-7e9b-4a58-ac74-008e7ba87aad] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:52:32.293068 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-c677f583-e434-4168-a5b3-5b870e328644 tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:52:32.293652 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-c677f583-e434-4168-a5b3-5b870e328644 tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:52:32.294458 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-c677f583-e434-4168-a5b3-5b870e328644 tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:52:32.294893 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-c677f583-e434-4168-a5b3-5b870e328644 tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:52:32.325103 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-c677f583-e434-4168-a5b3-5b870e328644 tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] 10.222.0.20 "GET /compute/v2.1/servers/4895b615-7e9b-4a58-ac74-008e7ba87aad/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043745 Jul 06 13:52:32.325651 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 401/795] 10.222.0.20 () {58 vars in 1301 bytes} [Wed Jul 6 13:52:32 2022] GET /compute/v2.1/servers/4895b615-7e9b-4a58-ac74-008e7ba87aad/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 06 13:52:32.335110 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-ef16da55-8947-473d-be78-d0ee0b4766b3 tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:52:32.335619 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-ef16da55-8947-473d-be78-d0ee0b4766b3 tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] [instance: 4895b615-7e9b-4a58-ac74-008e7ba87aad] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:52:32.342133 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-ef16da55-8947-473d-be78-d0ee0b4766b3 tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:52:32.342514 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-ef16da55-8947-473d-be78-d0ee0b4766b3 tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:52:32.343266 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-ef16da55-8947-473d-be78-d0ee0b4766b3 tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:52:32.343693 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-ef16da55-8947-473d-be78-d0ee0b4766b3 tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:52:32.425891 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.wsgi [None req-ef16da55-8947-473d-be78-d0ee0b4766b3 tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] HTTP exception thrown: Instance 4895b615-7e9b-4a58-ac74-008e7ba87aad is not attached to volume 49d30f07-dd29-4b18-9c55-772059fc7a2d Jul 06 13:52:32.428267 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-ef16da55-8947-473d-be78-d0ee0b4766b3 tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] Request method failure captured: Jul 06 13:52:32.428267 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: request: DELETE /compute/v2.1/servers/4895b615-7e9b-4a58-ac74-008e7ba87aad/os-volume_attachments/49d30f07-dd29-4b18-9c55-772059fc7a2d HTTP/1.1 Jul 06 13:52:32.428267 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: Accept: application/json Jul 06 13:52:32.428267 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: Accept-Encoding: identity Jul 06 13:52:32.428267 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: Connection: close Jul 06 13:52:32.428267 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: Content-Length: 0 Jul 06 13:52:32.428267 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: Content-Type: application/json Jul 06 13:52:32.428267 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: Host: 10.222.0.20 Jul 06 13:52:32.428267 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: Openstack-System-Scope: None Jul 06 13:52:32.428267 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: User-Agent: python-urllib3/1.26.9 Jul 06 13:52:32.428267 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: X-Auth-Token: gAAAAABixZJuYf2gChCrNx5nhPRqdXr2m0l6xmGiuNxIheNJYxs23TTMQjev2kJjTdpWjtf-g1axtzNXIKyPBTD8xNeI7LpouG5w_t1Zf-ac7KqvB_7gn0fiFgtW0XGHFxMjRoGSCccpNGZDhm9ieCt3aYZWsFdFFj0TGtlhsrSeol_iKoPitYA Jul 06 13:52:32.428267 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: X-Domain-Id: None Jul 06 13:52:32.428267 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: X-Domain-Name: None Jul 06 13:52:32.428267 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: X-Identity-Status: Confirmed Jul 06 13:52:32.428267 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: X-Is-Admin-Project: True Jul 06 13:52:32.428267 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: X-Project-Domain-Id: default Jul 06 13:52:32.428267 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: X-Project-Domain-Name: Default Jul 06 13:52:32.428267 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: X-Project-Id: 3ffa9da064c64346b5f227c28a89ea81 Jul 06 13:52:32.428267 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: X-Project-Name: tempest-TestMinimumBasicScenario-1384563913 Jul 06 13:52:32.428267 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: X-Role: reader,member Jul 06 13:52:32.428267 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: X-Roles: reader,member Jul 06 13:52:32.430537 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_3ffa9da064c64346b5f227c28a89ea81"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/3ffa9da064c64346b5f227c28a89ea81"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/3ffa9da064c64346b5f227c28a89ea81"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/3ffa9da064c64346b5f227c28a89ea81"}]}] Jul 06 13:52:32.430537 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: X-Tenant: tempest-TestMinimumBasicScenario-1384563913 Jul 06 13:52:32.430537 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: X-Tenant-Id: 3ffa9da064c64346b5f227c28a89ea81 Jul 06 13:52:32.430537 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1384563913 Jul 06 13:52:32.430537 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: X-User: tempest-TestMinimumBasicScenario-1384563913-project Jul 06 13:52:32.430537 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: X-User-Domain-Id: default Jul 06 13:52:32.430537 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: X-User-Domain-Name: Default Jul 06 13:52:32.430537 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: X-User-Id: 19ccda8f7ce447c490910ffa14165c8b Jul 06 13:52:32.430537 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: X-User-Name: tempest-TestMinimumBasicScenario-1384563913-project Jul 06 13:52:32.430537 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: method: > Jul 06 13:52:32.430537 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: exception: Instance 4895b615-7e9b-4a58-ac74-008e7ba87aad is not attached to volume 49d30f07-dd29-4b18-9c55-772059fc7a2d Jul 06 13:52:32.431461 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: action_args: {'server_id': '4895b615-7e9b-4a58-ac74-008e7ba87aad', 'id': '49d30f07-dd29-4b18-9c55-772059fc7a2d'} Jul 06 13:52:32.431461 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 06 13:52:32.431461 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 06 13:52:32.431461 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Jul 06 13:52:32.431461 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Jul 06 13:52:32.431461 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 06 13:52:32.431461 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 06 13:52:32.431461 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Jul 06 13:52:32.431461 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Jul 06 13:52:32.431461 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 49d30f07-dd29-4b18-9c55-772059fc7a2d. Jul 06 13:52:32.431461 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi Jul 06 13:52:32.431461 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 06 13:52:32.431461 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi Jul 06 13:52:32.431461 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 06 13:52:32.431461 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 06 13:52:32.431461 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 06 13:52:32.431461 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 06 13:52:32.431461 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 06 13:52:32.431461 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 06 13:52:32.432860 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 06 13:52:32.432860 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Jul 06 13:52:32.432860 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jul 06 13:52:32.432860 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4895b615-7e9b-4a58-ac74-008e7ba87aad is not attached to volume 49d30f07-dd29-4b18-9c55-772059fc7a2d Jul 06 13:52:32.432860 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi Jul 06 13:52:32.432860 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 06 13:52:32.432860 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi Jul 06 13:52:32.432860 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 06 13:52:32.432860 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 06 13:52:32.432860 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 06 13:52:32.432860 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 06 13:52:32.432860 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 06 13:52:32.432860 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4895b615-7e9b-4a58-ac74-008e7ba87aad is not attached to volume 49d30f07-dd29-4b18-9c55-772059fc7a2d Jul 06 13:52:32.432860 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi Jul 06 13:52:32.432860 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-ef16da55-8947-473d-be78-d0ee0b4766b3 tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] Returning 404 to user: Instance 4895b615-7e9b-4a58-ac74-008e7ba87aad is not attached to volume 49d30f07-dd29-4b18-9c55-772059fc7a2d {{(pid=124367) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 06 13:52:32.433999 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-ef16da55-8947-473d-be78-d0ee0b4766b3 tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] 10.222.0.20 "DELETE /compute/v2.1/servers/4895b615-7e9b-4a58-ac74-008e7ba87aad/os-volume_attachments/49d30f07-dd29-4b18-9c55-772059fc7a2d" status: 404 len: 154 microversion: 2.1 time: 0.098485 Jul 06 13:52:32.433999 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 395/796] 10.222.0.20 () {58 vars in 1415 bytes} [Wed Jul 6 13:52:32 2022] DELETE /compute/v2.1/servers/4895b615-7e9b-4a58-ac74-008e7ba87aad/os-volume_attachments/49d30f07-dd29-4b18-9c55-772059fc7a2d => generated 154 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 06 13:52:33.563908 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-fe9ec7a1-94e9-41a9-bfb0-29c7b99beff9 tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] Calling method '>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:52:33.564398 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-fe9ec7a1-94e9-41a9-bfb0-29c7b99beff9 tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] [instance: 4895b615-7e9b-4a58-ac74-008e7ba87aad] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:52:33.571533 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-fe9ec7a1-94e9-41a9-bfb0-29c7b99beff9 tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:52:33.571975 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-fe9ec7a1-94e9-41a9-bfb0-29c7b99beff9 tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:52:33.572736 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-fe9ec7a1-94e9-41a9-bfb0-29c7b99beff9 tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:52:33.573795 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-fe9ec7a1-94e9-41a9-bfb0-29c7b99beff9 tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:52:33.597726 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-fe9ec7a1-94e9-41a9-bfb0-29c7b99beff9 tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] [instance: 4895b615-7e9b-4a58-ac74-008e7ba87aad] Going to try to terminate instance {{(pid=124368) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 06 13:52:33.680632 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-fe9ec7a1-94e9-41a9-bfb0-29c7b99beff9 tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] 10.222.0.20 "DELETE /compute/v2.1/servers/4895b615-7e9b-4a58-ac74-008e7ba87aad" status: 204 len: 0 microversion: 2.1 time: 0.118586 Jul 06 13:52:33.682252 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 402/797] 10.222.0.20 () {58 vars in 1238 bytes} [Wed Jul 6 13:52:33 2022] DELETE /compute/v2.1/servers/4895b615-7e9b-4a58-ac74-008e7ba87aad => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 06 13:52:33.689624 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-8f8af39b-6977-4998-8ae6-1c813231cd28 tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:52:33.690221 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-8f8af39b-6977-4998-8ae6-1c813231cd28 tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] [instance: 4895b615-7e9b-4a58-ac74-008e7ba87aad] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:52:33.697699 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-8f8af39b-6977-4998-8ae6-1c813231cd28 tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:52:33.698191 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-8f8af39b-6977-4998-8ae6-1c813231cd28 tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:52:33.698950 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-8f8af39b-6977-4998-8ae6-1c813231cd28 tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:52:33.699378 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-8f8af39b-6977-4998-8ae6-1c813231cd28 tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:52:33.829460 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-8f8af39b-6977-4998-8ae6-1c813231cd28 tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19ccda8f7ce447c490910ffa14165c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ffa9da064c64346b5f227c28a89ea81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:52:33.836836 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-8f8af39b-6977-4998-8ae6-1c813231cd28 tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] 10.222.0.20 "GET /compute/v2.1/servers/4895b615-7e9b-4a58-ac74-008e7ba87aad" status: 200 len: 1552 microversion: 2.1 time: 0.151307 Jul 06 13:52:33.837429 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 396/798] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:52:33 2022] GET /compute/v2.1/servers/4895b615-7e9b-4a58-ac74-008e7ba87aad => generated 1552 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:52:34.854732 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-f0737e6f-726b-4fa0-9786-ad5eac131862 tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] Calling method '>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:52:34.856564 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-f0737e6f-726b-4fa0-9786-ad5eac131862 tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] [instance: 4895b615-7e9b-4a58-ac74-008e7ba87aad] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:52:34.861394 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-f0737e6f-726b-4fa0-9786-ad5eac131862 tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:52:34.861842 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-f0737e6f-726b-4fa0-9786-ad5eac131862 tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:52:34.862594 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-f0737e6f-726b-4fa0-9786-ad5eac131862 tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:52:34.863027 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-f0737e6f-726b-4fa0-9786-ad5eac131862 tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:52:34.993359 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-f0737e6f-726b-4fa0-9786-ad5eac131862 tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19ccda8f7ce447c490910ffa14165c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ffa9da064c64346b5f227c28a89ea81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:52:35.000743 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-f0737e6f-726b-4fa0-9786-ad5eac131862 tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] 10.222.0.20 "GET /compute/v2.1/servers/4895b615-7e9b-4a58-ac74-008e7ba87aad" status: 200 len: 1552 microversion: 2.1 time: 0.151052 Jul 06 13:52:35.001339 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 403/799] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:52:34 2022] GET /compute/v2.1/servers/4895b615-7e9b-4a58-ac74-008e7ba87aad => generated 1552 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:52:36.018598 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-0932988a-9ca8-4aa2-bad2-5905f7d2213b tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:52:36.019201 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-0932988a-9ca8-4aa2-bad2-5905f7d2213b tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] [instance: 4895b615-7e9b-4a58-ac74-008e7ba87aad] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:52:36.026522 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-0932988a-9ca8-4aa2-bad2-5905f7d2213b tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:52:36.026968 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-0932988a-9ca8-4aa2-bad2-5905f7d2213b tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:52:36.027725 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-0932988a-9ca8-4aa2-bad2-5905f7d2213b tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:52:36.028157 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-0932988a-9ca8-4aa2-bad2-5905f7d2213b tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:52:36.263083 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-0932988a-9ca8-4aa2-bad2-5905f7d2213b tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19ccda8f7ce447c490910ffa14165c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ffa9da064c64346b5f227c28a89ea81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:52:36.270471 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-0932988a-9ca8-4aa2-bad2-5905f7d2213b tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] 10.222.0.20 "GET /compute/v2.1/servers/4895b615-7e9b-4a58-ac74-008e7ba87aad" status: 200 len: 1552 microversion: 2.1 time: 0.255768 Jul 06 13:52:36.271041 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 397/800] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:52:36 2022] GET /compute/v2.1/servers/4895b615-7e9b-4a58-ac74-008e7ba87aad => generated 1552 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:52:36.599714 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [req-54fe32e1-723b-41e0-861e-dcbe8638e90a req-8ad49e69-1306-4b44-9d98-76c829f4072d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4895b615-7e9b-4a58-ac74-008e7ba87aad", "name": "network-vif-deleted", "tag": "41ac049c-27f7-4531-b7d5-cc2e3f0f8c79"}]} {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 06 13:52:36.609190 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [req-54fe32e1-723b-41e0-861e-dcbe8638e90a req-8ad49e69-1306-4b44-9d98-76c829f4072d service nova] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:52:36.609645 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [req-54fe32e1-723b-41e0-861e-dcbe8638e90a req-8ad49e69-1306-4b44-9d98-76c829f4072d service nova] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:52:36.621683 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.compute.server_external_events [req-54fe32e1-723b-41e0-861e-dcbe8638e90a req-8ad49e69-1306-4b44-9d98-76c829f4072d service nova] Creating event network-vif-deleted:41ac049c-27f7-4531-b7d5-cc2e3f0f8c79 for instance 4895b615-7e9b-4a58-ac74-008e7ba87aad on hv-cinder-81914 Jul 06 13:52:36.626378 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [req-54fe32e1-723b-41e0-861e-dcbe8638e90a req-8ad49e69-1306-4b44-9d98-76c829f4072d service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030312 Jul 06 13:52:36.627058 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 404/801] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 6 13:52:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 06 13:52:37.393603 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-821a9fce-007b-49cd-867c-db3fe7279f36 tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:52:37.394223 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-821a9fce-007b-49cd-867c-db3fe7279f36 tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] [instance: 4895b615-7e9b-4a58-ac74-008e7ba87aad] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:52:37.400768 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-821a9fce-007b-49cd-867c-db3fe7279f36 tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:52:37.401249 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-821a9fce-007b-49cd-867c-db3fe7279f36 tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:52:37.402008 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-821a9fce-007b-49cd-867c-db3fe7279f36 tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:52:37.402466 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-821a9fce-007b-49cd-867c-db3fe7279f36 tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:52:37.417633 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.wsgi [None req-821a9fce-007b-49cd-867c-db3fe7279f36 tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] HTTP exception thrown: Instance 4895b615-7e9b-4a58-ac74-008e7ba87aad could not be found. Jul 06 13:52:37.419124 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-821a9fce-007b-49cd-867c-db3fe7279f36 tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] Request method failure captured: Jul 06 13:52:37.419124 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: request: GET /compute/v2.1/servers/4895b615-7e9b-4a58-ac74-008e7ba87aad HTTP/1.1 Jul 06 13:52:37.419124 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: Accept: application/json Jul 06 13:52:37.419124 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: Accept-Encoding: identity Jul 06 13:52:37.419124 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: Connection: close Jul 06 13:52:37.419124 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: Content-Length: 0 Jul 06 13:52:37.419124 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: Content-Type: application/json Jul 06 13:52:37.419124 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: Host: 10.222.0.20 Jul 06 13:52:37.419124 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: Openstack-System-Scope: None Jul 06 13:52:37.419124 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: User-Agent: python-urllib3/1.26.9 Jul 06 13:52:37.419124 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: X-Auth-Token: gAAAAABixZJuYf2gChCrNx5nhPRqdXr2m0l6xmGiuNxIheNJYxs23TTMQjev2kJjTdpWjtf-g1axtzNXIKyPBTD8xNeI7LpouG5w_t1Zf-ac7KqvB_7gn0fiFgtW0XGHFxMjRoGSCccpNGZDhm9ieCt3aYZWsFdFFj0TGtlhsrSeol_iKoPitYA Jul 06 13:52:37.419124 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: X-Domain-Id: None Jul 06 13:52:37.419124 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: X-Domain-Name: None Jul 06 13:52:37.419124 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: X-Identity-Status: Confirmed Jul 06 13:52:37.419124 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: X-Is-Admin-Project: True Jul 06 13:52:37.419124 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: X-Project-Domain-Id: default Jul 06 13:52:37.419124 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: X-Project-Domain-Name: Default Jul 06 13:52:37.419124 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: X-Project-Id: 3ffa9da064c64346b5f227c28a89ea81 Jul 06 13:52:37.419124 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: X-Project-Name: tempest-TestMinimumBasicScenario-1384563913 Jul 06 13:52:37.419124 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: X-Role: reader,member Jul 06 13:52:37.419124 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: X-Roles: reader,member Jul 06 13:52:37.420717 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_3ffa9da064c64346b5f227c28a89ea81"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/3ffa9da064c64346b5f227c28a89ea81"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/3ffa9da064c64346b5f227c28a89ea81"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/3ffa9da064c64346b5f227c28a89ea81"}]}] Jul 06 13:52:37.420717 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: X-Tenant: tempest-TestMinimumBasicScenario-1384563913 Jul 06 13:52:37.420717 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: X-Tenant-Id: 3ffa9da064c64346b5f227c28a89ea81 Jul 06 13:52:37.420717 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1384563913 Jul 06 13:52:37.420717 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: X-User: tempest-TestMinimumBasicScenario-1384563913-project Jul 06 13:52:37.420717 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: X-User-Domain-Id: default Jul 06 13:52:37.420717 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: X-User-Domain-Name: Default Jul 06 13:52:37.420717 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: X-User-Id: 19ccda8f7ce447c490910ffa14165c8b Jul 06 13:52:37.420717 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: X-User-Name: tempest-TestMinimumBasicScenario-1384563913-project Jul 06 13:52:37.420717 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: method: > Jul 06 13:52:37.420717 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: exception: Instance 4895b615-7e9b-4a58-ac74-008e7ba87aad could not be found. Jul 06 13:52:37.420717 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: action_args: {'id': '4895b615-7e9b-4a58-ac74-008e7ba87aad'} Jul 06 13:52:37.421853 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 06 13:52:37.421853 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 06 13:52:37.421853 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 06 13:52:37.421853 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 06 13:52:37.421853 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 06 13:52:37.421853 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 06 13:52:37.421853 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 06 13:52:37.421853 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 06 13:52:37.421853 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 06 13:52:37.421853 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 06 13:52:37.421853 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4895b615-7e9b-4a58-ac74-008e7ba87aad could not be found. Jul 06 13:52:37.421853 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi Jul 06 13:52:37.421853 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 06 13:52:37.421853 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi Jul 06 13:52:37.421853 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 06 13:52:37.421853 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 06 13:52:37.421853 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 06 13:52:37.421853 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 06 13:52:37.421853 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 06 13:52:37.421853 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 06 13:52:37.423306 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 06 13:52:37.423306 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 06 13:52:37.423306 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 06 13:52:37.423306 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 06 13:52:37.423306 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 06 13:52:37.423306 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 06 13:52:37.423306 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 06 13:52:37.423306 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4895b615-7e9b-4a58-ac74-008e7ba87aad could not be found. Jul 06 13:52:37.423306 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi Jul 06 13:52:37.423306 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 06 13:52:37.423306 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi Jul 06 13:52:37.423306 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 06 13:52:37.423306 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 06 13:52:37.423306 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 06 13:52:37.423306 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 06 13:52:37.423306 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 06 13:52:37.423306 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4895b615-7e9b-4a58-ac74-008e7ba87aad could not be found. Jul 06 13:52:37.423306 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi Jul 06 13:52:37.425099 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-821a9fce-007b-49cd-867c-db3fe7279f36 tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] Returning 404 to user: Instance 4895b615-7e9b-4a58-ac74-008e7ba87aad could not be found. {{(pid=124367) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 06 13:52:37.425099 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-821a9fce-007b-49cd-867c-db3fe7279f36 tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] 10.222.0.20 "GET /compute/v2.1/servers/4895b615-7e9b-4a58-ac74-008e7ba87aad" status: 404 len: 111 microversion: 2.1 time: 0.136811 Jul 06 13:52:37.425099 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 398/802] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:52:37 2022] GET /compute/v2.1/servers/4895b615-7e9b-4a58-ac74-008e7ba87aad => generated 111 bytes in 138 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 06 13:52:37.429868 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-873b79da-2ef4-422e-a3d4-2e896891bfb1 tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] Calling method '.version_select at 0x7ffbbf7d6940>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:52:37.446524 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-873b79da-2ef4-422e-a3d4-2e896891bfb1 tempest-TestMinimumBasicScenario-1384563913 tempest-TestMinimumBasicScenario-1384563913-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-2015858302" status: 202 len: 0 microversion: 2.1 time: 0.020783 Jul 06 13:52:37.447067 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 405/803] 10.222.0.20 () {58 vars in 1271 bytes} [Wed Jul 6 13:52:37 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-2015858302 => generated 0 bytes in 22 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 06 13:52:46.687784 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-debb2582-df53-44e4-8739-0964deac68e5 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:52:46.688329 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-debb2582-df53-44e4-8739-0964deac68e5 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] [instance: 74a59be2-69eb-4bdc-865c-570f5a2019df] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:52:46.695519 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-debb2582-df53-44e4-8739-0964deac68e5 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:52:46.696028 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-debb2582-df53-44e4-8739-0964deac68e5 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:52:46.696782 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-debb2582-df53-44e4-8739-0964deac68e5 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:52:46.697271 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-debb2582-df53-44e4-8739-0964deac68e5 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:52:46.776299 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.objects.instance [None req-debb2582-df53-44e4-8739-0964deac68e5 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lazy-loading 'services' on Instance uuid 74a59be2-69eb-4bdc-865c-570f5a2019df {{(pid=124367) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 06 13:52:46.845403 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-debb2582-df53-44e4-8739-0964deac68e5 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] 10.222.0.20 "DELETE /compute/v2.1/servers/74a59be2-69eb-4bdc-865c-570f5a2019df/os-volume_attachments/7f526dcf-d898-4258-a1c6-c22cc15925e3" status: 202 len: 0 microversion: 2.1 time: 0.161211 Jul 06 13:52:46.845986 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 399/804] 10.222.0.20 () {58 vars in 1415 bytes} [Wed Jul 6 13:52:46 2022] DELETE /compute/v2.1/servers/74a59be2-69eb-4bdc-865c-570f5a2019df/os-volume_attachments/7f526dcf-d898-4258-a1c6-c22cc15925e3 => generated 0 bytes in 163 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 06 13:52:46.852098 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG dbcounter [-] [124368] Writing DB stats nova_cell1:SELECT=38,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:52:46.856212 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-64df1283-3e9c-4559-8166-16363001436e tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Calling method '>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:52:46.857275 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-64df1283-3e9c-4559-8166-16363001436e tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] [instance: 74a59be2-69eb-4bdc-865c-570f5a2019df] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:52:46.864184 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-64df1283-3e9c-4559-8166-16363001436e tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:52:46.864668 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-64df1283-3e9c-4559-8166-16363001436e tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:52:46.865465 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-64df1283-3e9c-4559-8166-16363001436e tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:52:46.865909 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-64df1283-3e9c-4559-8166-16363001436e tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:52:46.905062 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-64df1283-3e9c-4559-8166-16363001436e tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] 10.222.0.20 "GET /compute/v2.1/servers/74a59be2-69eb-4bdc-865c-570f5a2019df/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054629 Jul 06 13:52:46.905628 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 406/805] 10.222.0.20 () {58 vars in 1301 bytes} [Wed Jul 6 13:52:46 2022] GET /compute/v2.1/servers/74a59be2-69eb-4bdc-865c-570f5a2019df/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 06 13:52:47.917587 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-7f83e190-0b56-4280-92ba-b57a462039ba tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:52:47.918600 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-7f83e190-0b56-4280-92ba-b57a462039ba tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] [instance: 74a59be2-69eb-4bdc-865c-570f5a2019df] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:52:47.925312 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-7f83e190-0b56-4280-92ba-b57a462039ba tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:52:47.925767 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-7f83e190-0b56-4280-92ba-b57a462039ba tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:52:47.926646 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-7f83e190-0b56-4280-92ba-b57a462039ba tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:52:47.927110 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-7f83e190-0b56-4280-92ba-b57a462039ba tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:52:47.955079 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-7f83e190-0b56-4280-92ba-b57a462039ba tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] 10.222.0.20 "GET /compute/v2.1/servers/74a59be2-69eb-4bdc-865c-570f5a2019df/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043086 Jul 06 13:52:47.955629 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 400/806] 10.222.0.20 () {58 vars in 1301 bytes} [Wed Jul 6 13:52:47 2022] GET /compute/v2.1/servers/74a59be2-69eb-4bdc-865c-570f5a2019df/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 06 13:52:48.026767 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-edfc6d12-3962-4803-b857-a3d764f543c3 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Calling method '>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:52:48.027478 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-edfc6d12-3962-4803-b857-a3d764f543c3 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] [instance: 74a59be2-69eb-4bdc-865c-570f5a2019df] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:52:48.033779 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-edfc6d12-3962-4803-b857-a3d764f543c3 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:52:48.034233 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-edfc6d12-3962-4803-b857-a3d764f543c3 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:52:48.034995 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-edfc6d12-3962-4803-b857-a3d764f543c3 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:52:48.035428 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-edfc6d12-3962-4803-b857-a3d764f543c3 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:52:48.061458 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-edfc6d12-3962-4803-b857-a3d764f543c3 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] [instance: 74a59be2-69eb-4bdc-865c-570f5a2019df] Going to try to terminate instance {{(pid=124368) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 06 13:52:48.139052 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-edfc6d12-3962-4803-b857-a3d764f543c3 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] 10.222.0.20 "DELETE /compute/v2.1/servers/74a59be2-69eb-4bdc-865c-570f5a2019df" status: 204 len: 0 microversion: 2.1 time: 0.116808 Jul 06 13:52:48.139746 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 407/807] 10.222.0.20 () {58 vars in 1238 bytes} [Wed Jul 6 13:52:48 2022] DELETE /compute/v2.1/servers/74a59be2-69eb-4bdc-865c-570f5a2019df => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 06 13:52:48.148189 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-3c8d2a1a-5309-4c65-b072-bd2001091a19 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:52:48.149659 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-3c8d2a1a-5309-4c65-b072-bd2001091a19 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] [instance: 74a59be2-69eb-4bdc-865c-570f5a2019df] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:52:48.155887 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-3c8d2a1a-5309-4c65-b072-bd2001091a19 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:52:48.156336 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-3c8d2a1a-5309-4c65-b072-bd2001091a19 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:52:48.157135 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-3c8d2a1a-5309-4c65-b072-bd2001091a19 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:52:48.157584 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-3c8d2a1a-5309-4c65-b072-bd2001091a19 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:52:48.290586 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-3c8d2a1a-5309-4c65-b072-bd2001091a19 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c83c05bec4f456d8aa7d51732ddc8af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b2a80a004e04da7ae12db9f3f87146f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:52:48.298209 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-3c8d2a1a-5309-4c65-b072-bd2001091a19 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] 10.222.0.20 "GET /compute/v2.1/servers/74a59be2-69eb-4bdc-865c-570f5a2019df" status: 200 len: 1689 microversion: 2.1 time: 0.153902 Jul 06 13:52:48.298785 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 401/808] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:52:48 2022] GET /compute/v2.1/servers/74a59be2-69eb-4bdc-865c-570f5a2019df => generated 1689 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 06 13:52:49.317111 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-4d49cd88-6d30-4a53-b362-879d2ccc6f3c tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Calling method '>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:52:49.317779 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-4d49cd88-6d30-4a53-b362-879d2ccc6f3c tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] [instance: 74a59be2-69eb-4bdc-865c-570f5a2019df] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:52:49.324371 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-4d49cd88-6d30-4a53-b362-879d2ccc6f3c tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:52:49.324855 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-4d49cd88-6d30-4a53-b362-879d2ccc6f3c tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:52:49.325658 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-4d49cd88-6d30-4a53-b362-879d2ccc6f3c tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:52:49.326101 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-4d49cd88-6d30-4a53-b362-879d2ccc6f3c tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:52:49.457377 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-4d49cd88-6d30-4a53-b362-879d2ccc6f3c tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c83c05bec4f456d8aa7d51732ddc8af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b2a80a004e04da7ae12db9f3f87146f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:52:49.465639 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-4d49cd88-6d30-4a53-b362-879d2ccc6f3c tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] 10.222.0.20 "GET /compute/v2.1/servers/74a59be2-69eb-4bdc-865c-570f5a2019df" status: 200 len: 1689 microversion: 2.1 time: 0.152828 Jul 06 13:52:49.466218 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 408/809] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:52:49 2022] GET /compute/v2.1/servers/74a59be2-69eb-4bdc-865c-570f5a2019df => generated 1689 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:52:50.484716 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-182b2793-23d9-414b-99d9-f598ac81a837 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:52:50.485433 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-182b2793-23d9-414b-99d9-f598ac81a837 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] [instance: 74a59be2-69eb-4bdc-865c-570f5a2019df] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:52:50.492069 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-182b2793-23d9-414b-99d9-f598ac81a837 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:52:50.493115 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-182b2793-23d9-414b-99d9-f598ac81a837 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:52:50.493889 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-182b2793-23d9-414b-99d9-f598ac81a837 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:52:50.494324 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-182b2793-23d9-414b-99d9-f598ac81a837 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:52:50.627102 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-182b2793-23d9-414b-99d9-f598ac81a837 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c83c05bec4f456d8aa7d51732ddc8af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b2a80a004e04da7ae12db9f3f87146f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:52:50.634606 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-182b2793-23d9-414b-99d9-f598ac81a837 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] 10.222.0.20 "GET /compute/v2.1/servers/74a59be2-69eb-4bdc-865c-570f5a2019df" status: 200 len: 1689 microversion: 2.1 time: 0.153826 Jul 06 13:52:50.635168 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 402/810] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:52:50 2022] GET /compute/v2.1/servers/74a59be2-69eb-4bdc-865c-570f5a2019df => generated 1689 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:52:51.651538 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-8420a700-32fd-486c-b7f7-b784f235d5c5 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Calling method '>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:52:51.652156 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-8420a700-32fd-486c-b7f7-b784f235d5c5 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] [instance: 74a59be2-69eb-4bdc-865c-570f5a2019df] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:52:51.658524 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-8420a700-32fd-486c-b7f7-b784f235d5c5 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:52:51.658978 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-8420a700-32fd-486c-b7f7-b784f235d5c5 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:52:51.659743 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-8420a700-32fd-486c-b7f7-b784f235d5c5 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:52:51.660184 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-8420a700-32fd-486c-b7f7-b784f235d5c5 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:52:51.796845 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-8420a700-32fd-486c-b7f7-b784f235d5c5 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c83c05bec4f456d8aa7d51732ddc8af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b2a80a004e04da7ae12db9f3f87146f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:52:51.804771 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-8420a700-32fd-486c-b7f7-b784f235d5c5 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] 10.222.0.20 "GET /compute/v2.1/servers/74a59be2-69eb-4bdc-865c-570f5a2019df" status: 200 len: 1689 microversion: 2.1 time: 0.157093 Jul 06 13:52:51.805395 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 409/811] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:52:51 2022] GET /compute/v2.1/servers/74a59be2-69eb-4bdc-865c-570f5a2019df => generated 1689 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:52:52.541561 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [req-c6a7af87-4deb-4075-bdc6-55741bdeb896 req-400ff962-443c-4ed6-b00b-cf9c6842cbd0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "74a59be2-69eb-4bdc-865c-570f5a2019df", "name": "network-vif-deleted", "tag": "d9803c72-57aa-4aaf-b69c-e5ca48b8a2ca"}]} {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 06 13:52:52.550869 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [req-c6a7af87-4deb-4075-bdc6-55741bdeb896 req-400ff962-443c-4ed6-b00b-cf9c6842cbd0 service nova] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:52:52.551391 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [req-c6a7af87-4deb-4075-bdc6-55741bdeb896 req-400ff962-443c-4ed6-b00b-cf9c6842cbd0 service nova] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:52:52.563203 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.compute.server_external_events [req-c6a7af87-4deb-4075-bdc6-55741bdeb896 req-400ff962-443c-4ed6-b00b-cf9c6842cbd0 service nova] Creating event network-vif-deleted:d9803c72-57aa-4aaf-b69c-e5ca48b8a2ca for instance 74a59be2-69eb-4bdc-865c-570f5a2019df on hv-cinder-81914 Jul 06 13:52:52.568816 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [req-c6a7af87-4deb-4075-bdc6-55741bdeb896 req-400ff962-443c-4ed6-b00b-cf9c6842cbd0 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031372 Jul 06 13:52:52.569829 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 403/812] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 6 13:52:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 06 13:52:52.822614 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-b4ff3877-3c07-4863-9814-008361436634 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Calling method '>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:52:52.823228 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-b4ff3877-3c07-4863-9814-008361436634 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] [instance: 74a59be2-69eb-4bdc-865c-570f5a2019df] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:52:52.829714 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-b4ff3877-3c07-4863-9814-008361436634 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:52:52.830167 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-b4ff3877-3c07-4863-9814-008361436634 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:52:52.830929 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-b4ff3877-3c07-4863-9814-008361436634 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:52:52.831365 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-b4ff3877-3c07-4863-9814-008361436634 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:52:52.863247 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-b4ff3877-3c07-4863-9814-008361436634 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:52:52.863698 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-b4ff3877-3c07-4863-9814-008361436634 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:52:52.864150 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.objects.instance [None req-b4ff3877-3c07-4863-9814-008361436634 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lazy-loading 'fault' on Instance uuid 74a59be2-69eb-4bdc-865c-570f5a2019df {{(pid=124368) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 06 13:52:52.905098 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-b4ff3877-3c07-4863-9814-008361436634 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c83c05bec4f456d8aa7d51732ddc8af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b2a80a004e04da7ae12db9f3f87146f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:52:52.912491 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-b4ff3877-3c07-4863-9814-008361436634 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] 10.222.0.20 "GET /compute/v2.1/servers/74a59be2-69eb-4bdc-865c-570f5a2019df" status: 200 len: 1334 microversion: 2.1 time: 0.094592 Jul 06 13:52:52.913083 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 410/813] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:52:52 2022] GET /compute/v2.1/servers/74a59be2-69eb-4bdc-865c-570f5a2019df => generated 1334 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:52:53.931194 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-84551e86-3a49-439e-8d65-f34be0ec0db2 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:52:53.931809 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-84551e86-3a49-439e-8d65-f34be0ec0db2 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] [instance: 74a59be2-69eb-4bdc-865c-570f5a2019df] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:52:53.938003 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-84551e86-3a49-439e-8d65-f34be0ec0db2 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:52:53.938456 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-84551e86-3a49-439e-8d65-f34be0ec0db2 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:52:53.939218 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-84551e86-3a49-439e-8d65-f34be0ec0db2 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:52:53.939651 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-84551e86-3a49-439e-8d65-f34be0ec0db2 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:52:53.954117 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.wsgi [None req-84551e86-3a49-439e-8d65-f34be0ec0db2 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] HTTP exception thrown: Instance 74a59be2-69eb-4bdc-865c-570f5a2019df could not be found. Jul 06 13:52:53.955718 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-84551e86-3a49-439e-8d65-f34be0ec0db2 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Request method failure captured: Jul 06 13:52:53.955718 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: request: GET /compute/v2.1/servers/74a59be2-69eb-4bdc-865c-570f5a2019df HTTP/1.1 Jul 06 13:52:53.955718 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: Accept: application/json Jul 06 13:52:53.955718 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: Accept-Encoding: identity Jul 06 13:52:53.955718 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: Connection: close Jul 06 13:52:53.955718 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: Content-Length: 0 Jul 06 13:52:53.955718 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: Content-Type: application/json Jul 06 13:52:53.955718 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: Host: 10.222.0.20 Jul 06 13:52:53.955718 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: Openstack-System-Scope: None Jul 06 13:52:53.955718 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: User-Agent: python-urllib3/1.26.9 Jul 06 13:52:53.955718 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: X-Auth-Token: gAAAAABixZH75p1b2ILOi45fcNF92-zTsRsIgZ35DgQcq749C0w1kkYHYWHbuoMJGGkHW9WPBjYh0zxzWH474VrSUUR4tFNhBBNpjbmin3OznzgbylsUH2zxuJOhwhiPNwMppgS72cUuSxmI0bW6Nxx2svX__3EGBU7RgRf-kZZLsUGvLTS4iek Jul 06 13:52:53.955718 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: X-Domain-Id: None Jul 06 13:52:53.955718 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: X-Domain-Name: None Jul 06 13:52:53.955718 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: X-Identity-Status: Confirmed Jul 06 13:52:53.955718 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: X-Is-Admin-Project: True Jul 06 13:52:53.955718 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: X-Project-Domain-Id: default Jul 06 13:52:53.955718 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: X-Project-Domain-Name: Default Jul 06 13:52:53.955718 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: X-Project-Id: 3b2a80a004e04da7ae12db9f3f87146f Jul 06 13:52:53.955718 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-428270635 Jul 06 13:52:53.955718 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: X-Role: reader,member Jul 06 13:52:53.955718 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: X-Roles: reader,member Jul 06 13:52:53.957338 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_3b2a80a004e04da7ae12db9f3f87146f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/3b2a80a004e04da7ae12db9f3f87146f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/3b2a80a004e04da7ae12db9f3f87146f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/3b2a80a004e04da7ae12db9f3f87146f"}]}] Jul 06 13:52:53.957338 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: X-Tenant: tempest-ServerRescueNegativeTestJSON-428270635 Jul 06 13:52:53.957338 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: X-Tenant-Id: 3b2a80a004e04da7ae12db9f3f87146f Jul 06 13:52:53.957338 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-428270635 Jul 06 13:52:53.957338 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: X-User: tempest-ServerRescueNegativeTestJSON-428270635-project Jul 06 13:52:53.957338 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: X-User-Domain-Id: default Jul 06 13:52:53.957338 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: X-User-Domain-Name: Default Jul 06 13:52:53.957338 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: X-User-Id: 0c83c05bec4f456d8aa7d51732ddc8af Jul 06 13:52:53.957338 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: X-User-Name: tempest-ServerRescueNegativeTestJSON-428270635-project Jul 06 13:52:53.957338 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: method: > Jul 06 13:52:53.957338 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: exception: Instance 74a59be2-69eb-4bdc-865c-570f5a2019df could not be found. Jul 06 13:52:53.957338 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: action_args: {'id': '74a59be2-69eb-4bdc-865c-570f5a2019df'} Jul 06 13:52:53.958187 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 06 13:52:53.958187 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 06 13:52:53.958187 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 06 13:52:53.958187 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 06 13:52:53.958187 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 06 13:52:53.958187 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 06 13:52:53.958187 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 06 13:52:53.958187 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 06 13:52:53.958187 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 06 13:52:53.958187 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 06 13:52:53.958187 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 74a59be2-69eb-4bdc-865c-570f5a2019df could not be found. Jul 06 13:52:53.958187 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi Jul 06 13:52:53.958187 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 06 13:52:53.958187 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi Jul 06 13:52:53.958187 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 06 13:52:53.958187 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 06 13:52:53.958187 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 06 13:52:53.958187 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 06 13:52:53.958187 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 06 13:52:53.958187 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 06 13:52:53.959512 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 06 13:52:53.959512 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 06 13:52:53.959512 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 06 13:52:53.959512 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 06 13:52:53.959512 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 06 13:52:53.959512 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 06 13:52:53.959512 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 06 13:52:53.959512 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 74a59be2-69eb-4bdc-865c-570f5a2019df could not be found. Jul 06 13:52:53.959512 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi Jul 06 13:52:53.959512 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 06 13:52:53.959512 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi Jul 06 13:52:53.959512 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 06 13:52:53.959512 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 06 13:52:53.959512 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 06 13:52:53.959512 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 06 13:52:53.959512 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 06 13:52:53.959512 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 74a59be2-69eb-4bdc-865c-570f5a2019df could not be found. Jul 06 13:52:53.959512 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi Jul 06 13:52:53.960621 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-84551e86-3a49-439e-8d65-f34be0ec0db2 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Returning 404 to user: Instance 74a59be2-69eb-4bdc-865c-570f5a2019df could not be found. {{(pid=124367) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 06 13:52:53.960621 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-84551e86-3a49-439e-8d65-f34be0ec0db2 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] 10.222.0.20 "GET /compute/v2.1/servers/74a59be2-69eb-4bdc-865c-570f5a2019df" status: 404 len: 111 microversion: 2.1 time: 0.031334 Jul 06 13:52:53.960621 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 404/814] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:52:53 2022] GET /compute/v2.1/servers/74a59be2-69eb-4bdc-865c-570f5a2019df => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 06 13:52:53.966280 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-f5315b1f-cd4c-42e8-8d70-977a4d843ccd tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Calling method '.version_select at 0x7ffbbf7d6280>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:52:53.984041 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-f5315b1f-cd4c-42e8-8d70-977a4d843ccd tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-335900744" status: 202 len: 0 microversion: 2.1 time: 0.021558 Jul 06 13:52:53.984638 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 411/815] 10.222.0.20 () {58 vars in 1217 bytes} [Wed Jul 6 13:52:53 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-335900744 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 06 13:52:56.827351 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-7438fe1c-d248-4f98-b4bd-a339da8e0c49 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:52:56.827826 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-7438fe1c-d248-4f98-b4bd-a339da8e0c49 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] [instance: c801676d-524f-42fc-a2b8-fe4186986d95] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:52:56.834365 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-7438fe1c-d248-4f98-b4bd-a339da8e0c49 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:52:56.834805 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-7438fe1c-d248-4f98-b4bd-a339da8e0c49 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:52:56.835560 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-7438fe1c-d248-4f98-b4bd-a339da8e0c49 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:52:56.836061 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-7438fe1c-d248-4f98-b4bd-a339da8e0c49 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:52:56.860552 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-7438fe1c-d248-4f98-b4bd-a339da8e0c49 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] [instance: c801676d-524f-42fc-a2b8-fe4186986d95] Going to try to terminate instance {{(pid=124367) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 06 13:52:56.933469 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-7438fe1c-d248-4f98-b4bd-a339da8e0c49 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] 10.222.0.20 "DELETE /compute/v2.1/servers/c801676d-524f-42fc-a2b8-fe4186986d95" status: 204 len: 0 microversion: 2.1 time: 0.109514 Jul 06 13:52:56.934104 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 405/816] 10.222.0.20 () {58 vars in 1238 bytes} [Wed Jul 6 13:52:56 2022] DELETE /compute/v2.1/servers/c801676d-524f-42fc-a2b8-fe4186986d95 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 06 13:52:56.942757 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-46f3d44e-21a9-40d3-9cd4-240b4b366678 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Calling method '>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:52:56.943374 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-46f3d44e-21a9-40d3-9cd4-240b4b366678 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] [instance: c801676d-524f-42fc-a2b8-fe4186986d95] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:52:56.950527 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-46f3d44e-21a9-40d3-9cd4-240b4b366678 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:52:56.950986 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-46f3d44e-21a9-40d3-9cd4-240b4b366678 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:52:56.951761 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-46f3d44e-21a9-40d3-9cd4-240b4b366678 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:52:56.952203 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-46f3d44e-21a9-40d3-9cd4-240b4b366678 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:52:57.081737 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-46f3d44e-21a9-40d3-9cd4-240b4b366678 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c83c05bec4f456d8aa7d51732ddc8af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b2a80a004e04da7ae12db9f3f87146f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:52:57.089163 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-46f3d44e-21a9-40d3-9cd4-240b4b366678 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] 10.222.0.20 "GET /compute/v2.1/servers/c801676d-524f-42fc-a2b8-fe4186986d95" status: 200 len: 1508 microversion: 2.1 time: 0.150908 Jul 06 13:52:57.089753 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 412/817] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:52:56 2022] GET /compute/v2.1/servers/c801676d-524f-42fc-a2b8-fe4186986d95 => generated 1508 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:52:58.106794 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-ec6b1ad6-d196-4cce-b11e-52b096f1d597 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:52:58.107496 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-ec6b1ad6-d196-4cce-b11e-52b096f1d597 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] [instance: c801676d-524f-42fc-a2b8-fe4186986d95] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:52:58.113933 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-ec6b1ad6-d196-4cce-b11e-52b096f1d597 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:52:58.114363 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-ec6b1ad6-d196-4cce-b11e-52b096f1d597 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:52:58.115119 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-ec6b1ad6-d196-4cce-b11e-52b096f1d597 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:52:58.115546 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-ec6b1ad6-d196-4cce-b11e-52b096f1d597 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:52:58.215115 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-ec6b1ad6-d196-4cce-b11e-52b096f1d597 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c83c05bec4f456d8aa7d51732ddc8af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b2a80a004e04da7ae12db9f3f87146f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:52:58.225369 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-ec6b1ad6-d196-4cce-b11e-52b096f1d597 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] 10.222.0.20 "GET /compute/v2.1/servers/c801676d-524f-42fc-a2b8-fe4186986d95" status: 200 len: 1466 microversion: 2.1 time: 0.122641 Jul 06 13:52:58.234939 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 406/818] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:52:58 2022] GET /compute/v2.1/servers/c801676d-524f-42fc-a2b8-fe4186986d95 => generated 1466 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:52:58.270954 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [req-c2c2d907-9297-4aa2-9bcc-f005f6a45fa4 req-b9a029ff-b279-4615-9b7c-f31a2f1a0a73 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c801676d-524f-42fc-a2b8-fe4186986d95", "name": "network-vif-deleted", "tag": "13a49a96-2359-4685-a057-014466405458"}]} {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 06 13:52:58.281061 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [req-c2c2d907-9297-4aa2-9bcc-f005f6a45fa4 req-b9a029ff-b279-4615-9b7c-f31a2f1a0a73 service nova] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:52:58.281515 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [req-c2c2d907-9297-4aa2-9bcc-f005f6a45fa4 req-b9a029ff-b279-4615-9b7c-f31a2f1a0a73 service nova] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:52:58.296362 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.compute.server_external_events [req-c2c2d907-9297-4aa2-9bcc-f005f6a45fa4 req-b9a029ff-b279-4615-9b7c-f31a2f1a0a73 service nova] Creating event network-vif-deleted:13a49a96-2359-4685-a057-014466405458 for instance c801676d-524f-42fc-a2b8-fe4186986d95 on hv-cinder-81914 Jul 06 13:52:58.302318 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [req-c2c2d907-9297-4aa2-9bcc-f005f6a45fa4 req-b9a029ff-b279-4615-9b7c-f31a2f1a0a73 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034969 Jul 06 13:52:58.303176 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 413/819] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 6 13:52:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 06 13:52:59.242681 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-91aaeee9-ac48-4c77-b374-e2c87262fa7f tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:52:59.243284 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-91aaeee9-ac48-4c77-b374-e2c87262fa7f tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] [instance: c801676d-524f-42fc-a2b8-fe4186986d95] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:52:59.245254 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG dbcounter [-] [124367] Writing DB stats nova_api:SELECT=36,nova_api:UPDATE=1 {{(pid=124367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:52:59.251595 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-91aaeee9-ac48-4c77-b374-e2c87262fa7f tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:52:59.252184 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-91aaeee9-ac48-4c77-b374-e2c87262fa7f tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:52:59.252962 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-91aaeee9-ac48-4c77-b374-e2c87262fa7f tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:52:59.253433 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-91aaeee9-ac48-4c77-b374-e2c87262fa7f tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:52:59.256593 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG dbcounter [-] [124367] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=3,nova_cell1:UPDATE=1 {{(pid=124367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:52:59.269547 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.wsgi [None req-91aaeee9-ac48-4c77-b374-e2c87262fa7f tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] HTTP exception thrown: Instance c801676d-524f-42fc-a2b8-fe4186986d95 could not be found. Jul 06 13:52:59.271300 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-91aaeee9-ac48-4c77-b374-e2c87262fa7f tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Request method failure captured: Jul 06 13:52:59.271300 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: request: GET /compute/v2.1/servers/c801676d-524f-42fc-a2b8-fe4186986d95 HTTP/1.1 Jul 06 13:52:59.271300 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: Accept: application/json Jul 06 13:52:59.271300 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: Accept-Encoding: identity Jul 06 13:52:59.271300 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: Connection: close Jul 06 13:52:59.271300 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: Content-Length: 0 Jul 06 13:52:59.271300 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: Content-Type: application/json Jul 06 13:52:59.271300 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: Host: 10.222.0.20 Jul 06 13:52:59.271300 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: Openstack-System-Scope: None Jul 06 13:52:59.271300 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: User-Agent: python-urllib3/1.26.9 Jul 06 13:52:59.271300 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: X-Auth-Token: gAAAAABixZH75p1b2ILOi45fcNF92-zTsRsIgZ35DgQcq749C0w1kkYHYWHbuoMJGGkHW9WPBjYh0zxzWH474VrSUUR4tFNhBBNpjbmin3OznzgbylsUH2zxuJOhwhiPNwMppgS72cUuSxmI0bW6Nxx2svX__3EGBU7RgRf-kZZLsUGvLTS4iek Jul 06 13:52:59.271300 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: X-Domain-Id: None Jul 06 13:52:59.271300 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: X-Domain-Name: None Jul 06 13:52:59.271300 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: X-Identity-Status: Confirmed Jul 06 13:52:59.271300 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: X-Is-Admin-Project: True Jul 06 13:52:59.271300 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: X-Project-Domain-Id: default Jul 06 13:52:59.271300 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: X-Project-Domain-Name: Default Jul 06 13:52:59.271300 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: X-Project-Id: 3b2a80a004e04da7ae12db9f3f87146f Jul 06 13:52:59.271300 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-428270635 Jul 06 13:52:59.271300 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: X-Role: reader,member Jul 06 13:52:59.271300 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: X-Roles: reader,member Jul 06 13:52:59.272718 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_3b2a80a004e04da7ae12db9f3f87146f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/3b2a80a004e04da7ae12db9f3f87146f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/3b2a80a004e04da7ae12db9f3f87146f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/3b2a80a004e04da7ae12db9f3f87146f"}]}] Jul 06 13:52:59.272718 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: X-Tenant: tempest-ServerRescueNegativeTestJSON-428270635 Jul 06 13:52:59.272718 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: X-Tenant-Id: 3b2a80a004e04da7ae12db9f3f87146f Jul 06 13:52:59.272718 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-428270635 Jul 06 13:52:59.272718 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: X-User: tempest-ServerRescueNegativeTestJSON-428270635-project Jul 06 13:52:59.272718 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: X-User-Domain-Id: default Jul 06 13:52:59.272718 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: X-User-Domain-Name: Default Jul 06 13:52:59.272718 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: X-User-Id: 0c83c05bec4f456d8aa7d51732ddc8af Jul 06 13:52:59.272718 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: X-User-Name: tempest-ServerRescueNegativeTestJSON-428270635-project Jul 06 13:52:59.272718 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: method: > Jul 06 13:52:59.272718 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: exception: Instance c801676d-524f-42fc-a2b8-fe4186986d95 could not be found. Jul 06 13:52:59.272718 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: action_args: {'id': 'c801676d-524f-42fc-a2b8-fe4186986d95'} Jul 06 13:52:59.273537 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 06 13:52:59.273537 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 06 13:52:59.273537 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 06 13:52:59.273537 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 06 13:52:59.273537 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 06 13:52:59.273537 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 06 13:52:59.273537 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 06 13:52:59.273537 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 06 13:52:59.273537 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 06 13:52:59.273537 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 06 13:52:59.273537 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c801676d-524f-42fc-a2b8-fe4186986d95 could not be found. Jul 06 13:52:59.273537 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi Jul 06 13:52:59.273537 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 06 13:52:59.273537 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi Jul 06 13:52:59.273537 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 06 13:52:59.273537 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 06 13:52:59.273537 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 06 13:52:59.273537 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 06 13:52:59.273537 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 06 13:52:59.273537 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 06 13:52:59.275072 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 06 13:52:59.275072 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 06 13:52:59.275072 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 06 13:52:59.275072 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 06 13:52:59.275072 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 06 13:52:59.275072 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 06 13:52:59.275072 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 06 13:52:59.275072 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c801676d-524f-42fc-a2b8-fe4186986d95 could not be found. Jul 06 13:52:59.275072 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi Jul 06 13:52:59.275072 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 06 13:52:59.275072 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi Jul 06 13:52:59.275072 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 06 13:52:59.275072 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 06 13:52:59.275072 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 06 13:52:59.275072 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 06 13:52:59.275072 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 06 13:52:59.275072 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c801676d-524f-42fc-a2b8-fe4186986d95 could not be found. Jul 06 13:52:59.275072 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi Jul 06 13:52:59.276522 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-91aaeee9-ac48-4c77-b374-e2c87262fa7f tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Returning 404 to user: Instance c801676d-524f-42fc-a2b8-fe4186986d95 could not be found. {{(pid=124367) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 06 13:52:59.276522 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-91aaeee9-ac48-4c77-b374-e2c87262fa7f tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] 10.222.0.20 "GET /compute/v2.1/servers/c801676d-524f-42fc-a2b8-fe4186986d95" status: 404 len: 111 microversion: 2.1 time: 0.033998 Jul 06 13:52:59.276522 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 407/820] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:52:59 2022] GET /compute/v2.1/servers/c801676d-524f-42fc-a2b8-fe4186986d95 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 06 13:52:59.282273 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-ec94c753-c9ec-4893-acea-91817888c313 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Calling method '>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:52:59.282939 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-ec94c753-c9ec-4893-acea-91817888c313 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] [instance: 12bddea9-d545-43f2-9bf7-5e723900c8c6] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:52:59.290071 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-ec94c753-c9ec-4893-acea-91817888c313 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:52:59.290534 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-ec94c753-c9ec-4893-acea-91817888c313 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:52:59.291308 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-ec94c753-c9ec-4893-acea-91817888c313 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:52:59.291749 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-ec94c753-c9ec-4893-acea-91817888c313 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:52:59.318006 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-ec94c753-c9ec-4893-acea-91817888c313 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] [instance: 12bddea9-d545-43f2-9bf7-5e723900c8c6] Going to try to terminate instance {{(pid=124368) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 06 13:52:59.392878 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-ec94c753-c9ec-4893-acea-91817888c313 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] 10.222.0.20 "DELETE /compute/v2.1/servers/12bddea9-d545-43f2-9bf7-5e723900c8c6" status: 204 len: 0 microversion: 2.1 time: 0.114817 Jul 06 13:52:59.393421 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 414/821] 10.222.0.20 () {58 vars in 1238 bytes} [Wed Jul 6 13:52:59 2022] DELETE /compute/v2.1/servers/12bddea9-d545-43f2-9bf7-5e723900c8c6 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 06 13:52:59.402787 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-4c6437d7-ff69-4fe2-91e2-836daf660e49 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:52:59.403388 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-4c6437d7-ff69-4fe2-91e2-836daf660e49 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] [instance: 12bddea9-d545-43f2-9bf7-5e723900c8c6] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:52:59.409331 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-4c6437d7-ff69-4fe2-91e2-836daf660e49 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:52:59.409783 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-4c6437d7-ff69-4fe2-91e2-836daf660e49 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:52:59.410539 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-4c6437d7-ff69-4fe2-91e2-836daf660e49 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:52:59.410965 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-4c6437d7-ff69-4fe2-91e2-836daf660e49 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:52:59.538413 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-4c6437d7-ff69-4fe2-91e2-836daf660e49 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c83c05bec4f456d8aa7d51732ddc8af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b2a80a004e04da7ae12db9f3f87146f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:52:59.546402 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-4c6437d7-ff69-4fe2-91e2-836daf660e49 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] 10.222.0.20 "GET /compute/v2.1/servers/12bddea9-d545-43f2-9bf7-5e723900c8c6" status: 200 len: 1522 microversion: 2.1 time: 0.148669 Jul 06 13:52:59.546959 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 408/822] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:52:59 2022] GET /compute/v2.1/servers/12bddea9-d545-43f2-9bf7-5e723900c8c6 => generated 1522 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:53:00.564642 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-d41352b8-627a-4b62-a0da-4775d7a6fbde tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Calling method '>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:53:00.565295 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-d41352b8-627a-4b62-a0da-4775d7a6fbde tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] [instance: 12bddea9-d545-43f2-9bf7-5e723900c8c6] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:53:00.567644 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG dbcounter [-] [124368] Writing DB stats nova_api:SELECT=54,nova_api:UPDATE=3,nova_api:DELETE=2 {{(pid=124368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:53:00.573142 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-d41352b8-627a-4b62-a0da-4775d7a6fbde tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:53:00.573601 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-d41352b8-627a-4b62-a0da-4775d7a6fbde tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:53:00.574374 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-d41352b8-627a-4b62-a0da-4775d7a6fbde tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:53:00.574815 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-d41352b8-627a-4b62-a0da-4775d7a6fbde tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:53:00.707511 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-d41352b8-627a-4b62-a0da-4775d7a6fbde tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c83c05bec4f456d8aa7d51732ddc8af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b2a80a004e04da7ae12db9f3f87146f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:53:00.715390 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-d41352b8-627a-4b62-a0da-4775d7a6fbde tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] 10.222.0.20 "GET /compute/v2.1/servers/12bddea9-d545-43f2-9bf7-5e723900c8c6" status: 200 len: 1522 microversion: 2.1 time: 0.155066 Jul 06 13:53:00.715948 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 415/823] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:53:00 2022] GET /compute/v2.1/servers/12bddea9-d545-43f2-9bf7-5e723900c8c6 => generated 1522 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:53:01.732727 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-c3f27827-6575-4463-8c59-f84267589e18 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:53:01.733493 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-c3f27827-6575-4463-8c59-f84267589e18 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] [instance: 12bddea9-d545-43f2-9bf7-5e723900c8c6] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:53:01.740090 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-c3f27827-6575-4463-8c59-f84267589e18 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:53:01.740709 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-c3f27827-6575-4463-8c59-f84267589e18 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:53:01.741563 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-c3f27827-6575-4463-8c59-f84267589e18 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:53:01.742521 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-c3f27827-6575-4463-8c59-f84267589e18 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:53:01.823973 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-c3f27827-6575-4463-8c59-f84267589e18 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c83c05bec4f456d8aa7d51732ddc8af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b2a80a004e04da7ae12db9f3f87146f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:53:01.834175 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-c3f27827-6575-4463-8c59-f84267589e18 tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] 10.222.0.20 "GET /compute/v2.1/servers/12bddea9-d545-43f2-9bf7-5e723900c8c6" status: 200 len: 1480 microversion: 2.1 time: 0.105685 Jul 06 13:53:01.835521 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 409/824] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:53:01 2022] GET /compute/v2.1/servers/12bddea9-d545-43f2-9bf7-5e723900c8c6 => generated 1480 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:53:01.861084 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [req-dab7e835-c95b-4edf-86d0-34bdd16edcc6 req-7bd5f563-ef3a-441f-ac81-2fbee9a710b7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "12bddea9-d545-43f2-9bf7-5e723900c8c6", "name": "network-vif-deleted", "tag": "0a503503-bc5a-427b-9188-0939c526e5da"}]} {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 06 13:53:01.872039 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [req-dab7e835-c95b-4edf-86d0-34bdd16edcc6 req-7bd5f563-ef3a-441f-ac81-2fbee9a710b7 service nova] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:53:01.872443 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [req-dab7e835-c95b-4edf-86d0-34bdd16edcc6 req-7bd5f563-ef3a-441f-ac81-2fbee9a710b7 service nova] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:53:01.885033 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.compute.server_external_events [req-dab7e835-c95b-4edf-86d0-34bdd16edcc6 req-7bd5f563-ef3a-441f-ac81-2fbee9a710b7 service nova] Creating event network-vif-deleted:0a503503-bc5a-427b-9188-0939c526e5da for instance 12bddea9-d545-43f2-9bf7-5e723900c8c6 on hv-cinder-81914 Jul 06 13:53:01.899110 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [req-dab7e835-c95b-4edf-86d0-34bdd16edcc6 req-7bd5f563-ef3a-441f-ac81-2fbee9a710b7 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046058 Jul 06 13:53:01.899930 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 416/825] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 6 13:53:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 06 13:53:02.854708 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-2d2cfa60-0621-4b53-909f-a4fb2d43aaad tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:53:02.855331 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-2d2cfa60-0621-4b53-909f-a4fb2d43aaad tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] [instance: 12bddea9-d545-43f2-9bf7-5e723900c8c6] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:53:02.861796 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-2d2cfa60-0621-4b53-909f-a4fb2d43aaad tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:53:02.862286 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-2d2cfa60-0621-4b53-909f-a4fb2d43aaad tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:53:02.863024 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-2d2cfa60-0621-4b53-909f-a4fb2d43aaad tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:53:02.863484 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-2d2cfa60-0621-4b53-909f-a4fb2d43aaad tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:53:02.876228 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.wsgi [None req-2d2cfa60-0621-4b53-909f-a4fb2d43aaad tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] HTTP exception thrown: Instance 12bddea9-d545-43f2-9bf7-5e723900c8c6 could not be found. Jul 06 13:53:02.877735 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-2d2cfa60-0621-4b53-909f-a4fb2d43aaad tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Request method failure captured: Jul 06 13:53:02.877735 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: request: GET /compute/v2.1/servers/12bddea9-d545-43f2-9bf7-5e723900c8c6 HTTP/1.1 Jul 06 13:53:02.877735 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: Accept: application/json Jul 06 13:53:02.877735 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: Accept-Encoding: identity Jul 06 13:53:02.877735 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: Connection: close Jul 06 13:53:02.877735 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: Content-Length: 0 Jul 06 13:53:02.877735 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: Content-Type: application/json Jul 06 13:53:02.877735 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: Host: 10.222.0.20 Jul 06 13:53:02.877735 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: Openstack-System-Scope: None Jul 06 13:53:02.877735 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: User-Agent: python-urllib3/1.26.9 Jul 06 13:53:02.877735 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: X-Auth-Token: gAAAAABixZH75p1b2ILOi45fcNF92-zTsRsIgZ35DgQcq749C0w1kkYHYWHbuoMJGGkHW9WPBjYh0zxzWH474VrSUUR4tFNhBBNpjbmin3OznzgbylsUH2zxuJOhwhiPNwMppgS72cUuSxmI0bW6Nxx2svX__3EGBU7RgRf-kZZLsUGvLTS4iek Jul 06 13:53:02.877735 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: X-Domain-Id: None Jul 06 13:53:02.877735 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: X-Domain-Name: None Jul 06 13:53:02.877735 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: X-Identity-Status: Confirmed Jul 06 13:53:02.877735 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: X-Is-Admin-Project: True Jul 06 13:53:02.877735 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: X-Project-Domain-Id: default Jul 06 13:53:02.877735 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: X-Project-Domain-Name: Default Jul 06 13:53:02.877735 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: X-Project-Id: 3b2a80a004e04da7ae12db9f3f87146f Jul 06 13:53:02.877735 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-428270635 Jul 06 13:53:02.877735 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: X-Role: reader,member Jul 06 13:53:02.877735 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: X-Roles: reader,member Jul 06 13:53:02.879225 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_3b2a80a004e04da7ae12db9f3f87146f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/3b2a80a004e04da7ae12db9f3f87146f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/3b2a80a004e04da7ae12db9f3f87146f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/3b2a80a004e04da7ae12db9f3f87146f"}]}] Jul 06 13:53:02.879225 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: X-Tenant: tempest-ServerRescueNegativeTestJSON-428270635 Jul 06 13:53:02.879225 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: X-Tenant-Id: 3b2a80a004e04da7ae12db9f3f87146f Jul 06 13:53:02.879225 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-428270635 Jul 06 13:53:02.879225 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: X-User: tempest-ServerRescueNegativeTestJSON-428270635-project Jul 06 13:53:02.879225 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: X-User-Domain-Id: default Jul 06 13:53:02.879225 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: X-User-Domain-Name: Default Jul 06 13:53:02.879225 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: X-User-Id: 0c83c05bec4f456d8aa7d51732ddc8af Jul 06 13:53:02.879225 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: X-User-Name: tempest-ServerRescueNegativeTestJSON-428270635-project Jul 06 13:53:02.879225 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: method: > Jul 06 13:53:02.879225 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: exception: Instance 12bddea9-d545-43f2-9bf7-5e723900c8c6 could not be found. Jul 06 13:53:02.879225 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: action_args: {'id': '12bddea9-d545-43f2-9bf7-5e723900c8c6'} Jul 06 13:53:02.880107 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 06 13:53:02.880107 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 06 13:53:02.880107 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 06 13:53:02.880107 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 06 13:53:02.880107 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 06 13:53:02.880107 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 06 13:53:02.880107 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 06 13:53:02.880107 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 06 13:53:02.880107 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 06 13:53:02.880107 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 06 13:53:02.880107 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 12bddea9-d545-43f2-9bf7-5e723900c8c6 could not be found. Jul 06 13:53:02.880107 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi Jul 06 13:53:02.880107 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 06 13:53:02.880107 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi Jul 06 13:53:02.880107 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 06 13:53:02.880107 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 06 13:53:02.880107 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 06 13:53:02.880107 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 06 13:53:02.880107 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 06 13:53:02.880107 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 06 13:53:02.881549 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 06 13:53:02.881549 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 06 13:53:02.881549 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 06 13:53:02.881549 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 06 13:53:02.881549 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 06 13:53:02.881549 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 06 13:53:02.881549 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 06 13:53:02.881549 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 12bddea9-d545-43f2-9bf7-5e723900c8c6 could not be found. Jul 06 13:53:02.881549 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi Jul 06 13:53:02.881549 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 06 13:53:02.881549 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi Jul 06 13:53:02.881549 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 06 13:53:02.881549 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 06 13:53:02.881549 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 06 13:53:02.881549 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 06 13:53:02.881549 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 06 13:53:02.881549 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 12bddea9-d545-43f2-9bf7-5e723900c8c6 could not be found. Jul 06 13:53:02.881549 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi Jul 06 13:53:02.883560 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-2d2cfa60-0621-4b53-909f-a4fb2d43aaad tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] Returning 404 to user: Instance 12bddea9-d545-43f2-9bf7-5e723900c8c6 could not be found. {{(pid=124367) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 06 13:53:02.883560 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-2d2cfa60-0621-4b53-909f-a4fb2d43aaad tempest-ServerRescueNegativeTestJSON-428270635 tempest-ServerRescueNegativeTestJSON-428270635-project] 10.222.0.20 "GET /compute/v2.1/servers/12bddea9-d545-43f2-9bf7-5e723900c8c6" status: 404 len: 111 microversion: 2.1 time: 0.028799 Jul 06 13:53:02.883560 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 410/826] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:53:02 2022] GET /compute/v2.1/servers/12bddea9-d545-43f2-9bf7-5e723900c8c6 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 06 13:53:06.350077 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-5fe0506d-7898-491d-a99e-cf0dc7024f3e tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Calling method '>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:53:06.351457 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-5fe0506d-7898-491d-a99e-cf0dc7024f3e tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] [instance: 546a77fd-66e1-4d89-afa3-58d632b09186] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:53:06.357954 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-5fe0506d-7898-491d-a99e-cf0dc7024f3e tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:53:06.358412 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-5fe0506d-7898-491d-a99e-cf0dc7024f3e tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:53:06.359355 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-5fe0506d-7898-491d-a99e-cf0dc7024f3e tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:53:06.359810 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-5fe0506d-7898-491d-a99e-cf0dc7024f3e tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:53:06.392841 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-5fe0506d-7898-491d-a99e-cf0dc7024f3e tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] 10.222.0.20 "GET /compute/v2.1/servers/546a77fd-66e1-4d89-afa3-58d632b09186/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047955 Jul 06 13:53:06.393773 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 417/827] 10.222.0.20 () {58 vars in 1301 bytes} [Wed Jul 6 13:53:06 2022] GET /compute/v2.1/servers/546a77fd-66e1-4d89-afa3-58d632b09186/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 06 13:53:06.453207 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-cd8e6635-cd61-45f6-a943-d21addcaf841 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:53:06.453730 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-cd8e6635-cd61-45f6-a943-d21addcaf841 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] [instance: 546a77fd-66e1-4d89-afa3-58d632b09186] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:53:06.460051 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-cd8e6635-cd61-45f6-a943-d21addcaf841 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:53:06.460526 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-cd8e6635-cd61-45f6-a943-d21addcaf841 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:53:06.461395 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-cd8e6635-cd61-45f6-a943-d21addcaf841 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:53:06.461826 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-cd8e6635-cd61-45f6-a943-d21addcaf841 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:53:06.489065 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-cd8e6635-cd61-45f6-a943-d21addcaf841 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] [instance: 546a77fd-66e1-4d89-afa3-58d632b09186] Going to try to terminate instance {{(pid=124367) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 06 13:53:06.575397 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-cd8e6635-cd61-45f6-a943-d21addcaf841 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] 10.222.0.20 "DELETE /compute/v2.1/servers/546a77fd-66e1-4d89-afa3-58d632b09186" status: 204 len: 0 microversion: 2.1 time: 0.125631 Jul 06 13:53:06.576038 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 411/828] 10.222.0.20 () {58 vars in 1238 bytes} [Wed Jul 6 13:53:06 2022] DELETE /compute/v2.1/servers/546a77fd-66e1-4d89-afa3-58d632b09186 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 06 13:53:06.586791 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-5f7949f3-efb8-496e-bfd5-45a23231a305 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Calling method '>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:53:06.587415 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-5f7949f3-efb8-496e-bfd5-45a23231a305 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] [instance: 546a77fd-66e1-4d89-afa3-58d632b09186] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:53:06.593661 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-5f7949f3-efb8-496e-bfd5-45a23231a305 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:53:06.594317 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-5f7949f3-efb8-496e-bfd5-45a23231a305 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:53:06.595096 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-5f7949f3-efb8-496e-bfd5-45a23231a305 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:53:06.595532 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-5f7949f3-efb8-496e-bfd5-45a23231a305 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:53:06.730922 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-5f7949f3-efb8-496e-bfd5-45a23231a305 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d7cacb73c8342579d9f990b0193487c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05df572327d54bd99595974b75898052', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:53:06.738467 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-5f7949f3-efb8-496e-bfd5-45a23231a305 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] 10.222.0.20 "GET /compute/v2.1/servers/546a77fd-66e1-4d89-afa3-58d632b09186" status: 200 len: 1673 microversion: 2.1 time: 0.157932 Jul 06 13:53:06.739039 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 418/829] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:53:06 2022] GET /compute/v2.1/servers/546a77fd-66e1-4d89-afa3-58d632b09186 => generated 1673 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:53:07.755949 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-8f703e7e-ec27-4b5f-be3d-cd2637130b33 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:53:07.756680 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-8f703e7e-ec27-4b5f-be3d-cd2637130b33 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] [instance: 546a77fd-66e1-4d89-afa3-58d632b09186] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:53:07.763291 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-8f703e7e-ec27-4b5f-be3d-cd2637130b33 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:53:07.763736 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-8f703e7e-ec27-4b5f-be3d-cd2637130b33 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:53:07.764498 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-8f703e7e-ec27-4b5f-be3d-cd2637130b33 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:53:07.764929 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-8f703e7e-ec27-4b5f-be3d-cd2637130b33 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:53:07.973292 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-8f703e7e-ec27-4b5f-be3d-cd2637130b33 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d7cacb73c8342579d9f990b0193487c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05df572327d54bd99595974b75898052', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:53:07.985134 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-8f703e7e-ec27-4b5f-be3d-cd2637130b33 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] 10.222.0.20 "GET /compute/v2.1/servers/546a77fd-66e1-4d89-afa3-58d632b09186" status: 200 len: 1673 microversion: 2.1 time: 0.232929 Jul 06 13:53:07.986595 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 412/830] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:53:07 2022] GET /compute/v2.1/servers/546a77fd-66e1-4d89-afa3-58d632b09186 => generated 1673 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:53:09.003980 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-8593a30c-d2e1-45bc-9d58-0f51dc520196 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Calling method '>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:53:09.004815 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-8593a30c-d2e1-45bc-9d58-0f51dc520196 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] [instance: 546a77fd-66e1-4d89-afa3-58d632b09186] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:53:09.015990 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-8593a30c-d2e1-45bc-9d58-0f51dc520196 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:53:09.016453 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-8593a30c-d2e1-45bc-9d58-0f51dc520196 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:53:09.026230 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-8593a30c-d2e1-45bc-9d58-0f51dc520196 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:53:09.026833 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-8593a30c-d2e1-45bc-9d58-0f51dc520196 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:53:09.146782 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [req-58dbecf0-84c7-4158-adc9-776195907681 req-ed696315-7e78-46f6-a4af-f0e091174131 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "546a77fd-66e1-4d89-afa3-58d632b09186", "name": "network-vif-deleted", "tag": "3ca14d5b-272c-4543-9380-0fbec0da4da8"}]} {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 06 13:53:09.153029 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-8593a30c-d2e1-45bc-9d58-0f51dc520196 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d7cacb73c8342579d9f990b0193487c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05df572327d54bd99595974b75898052', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:53:09.156577 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [req-58dbecf0-84c7-4158-adc9-776195907681 req-ed696315-7e78-46f6-a4af-f0e091174131 service nova] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:53:09.157333 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [req-58dbecf0-84c7-4158-adc9-776195907681 req-ed696315-7e78-46f6-a4af-f0e091174131 service nova] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:53:09.168657 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-8593a30c-d2e1-45bc-9d58-0f51dc520196 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] 10.222.0.20 "GET /compute/v2.1/servers/546a77fd-66e1-4d89-afa3-58d632b09186" status: 200 len: 1607 microversion: 2.1 time: 0.169094 Jul 06 13:53:09.171556 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.compute.server_external_events [req-58dbecf0-84c7-4158-adc9-776195907681 req-ed696315-7e78-46f6-a4af-f0e091174131 service nova] Creating event network-vif-deleted:3ca14d5b-272c-4543-9380-0fbec0da4da8 for instance 546a77fd-66e1-4d89-afa3-58d632b09186 on hv-cinder-81914 Jul 06 13:53:09.179251 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 419/831] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:53:08 2022] GET /compute/v2.1/servers/546a77fd-66e1-4d89-afa3-58d632b09186 => generated 1607 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:53:09.191650 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [req-58dbecf0-84c7-4158-adc9-776195907681 req-ed696315-7e78-46f6-a4af-f0e091174131 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047557 Jul 06 13:53:09.199136 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 413/832] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 6 13:53:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 06 13:53:10.188481 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-07832edc-06a9-4364-ad06-33b771ccd372 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Calling method '>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:53:10.189806 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-07832edc-06a9-4364-ad06-33b771ccd372 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] [instance: 546a77fd-66e1-4d89-afa3-58d632b09186] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:53:10.197407 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-07832edc-06a9-4364-ad06-33b771ccd372 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:53:10.198313 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-07832edc-06a9-4364-ad06-33b771ccd372 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:53:10.199337 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-07832edc-06a9-4364-ad06-33b771ccd372 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:53:10.200012 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-07832edc-06a9-4364-ad06-33b771ccd372 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:53:10.219067 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.wsgi [None req-07832edc-06a9-4364-ad06-33b771ccd372 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] HTTP exception thrown: Instance 546a77fd-66e1-4d89-afa3-58d632b09186 could not be found. Jul 06 13:53:10.221533 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-07832edc-06a9-4364-ad06-33b771ccd372 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Request method failure captured: Jul 06 13:53:10.221533 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: request: GET /compute/v2.1/servers/546a77fd-66e1-4d89-afa3-58d632b09186 HTTP/1.1 Jul 06 13:53:10.221533 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: Accept: application/json Jul 06 13:53:10.221533 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: Accept-Encoding: identity Jul 06 13:53:10.221533 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: Connection: close Jul 06 13:53:10.221533 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: Content-Length: 0 Jul 06 13:53:10.221533 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: Content-Type: application/json Jul 06 13:53:10.221533 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: Host: 10.222.0.20 Jul 06 13:53:10.221533 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: Openstack-System-Scope: None Jul 06 13:53:10.221533 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: User-Agent: python-urllib3/1.26.9 Jul 06 13:53:10.221533 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Auth-Token: gAAAAABixZH5S3knz4fvYX5rMVzIRaVsYzIKLfrrz8lDPVem74Mg_DTbdjOjiuIblg7Yv_5KYUCq8cU5CAPyveLkwoLjHq0KpmoFJl1HEbcs8GS4ExBwATXjRnPlECQAMq-F6w3rOAPGgVuvSxjNdgiF89mYcHWuNREzSrBRKyP00YlMZ9-oZ94 Jul 06 13:53:10.221533 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Domain-Id: None Jul 06 13:53:10.221533 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Domain-Name: None Jul 06 13:53:10.221533 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Identity-Status: Confirmed Jul 06 13:53:10.221533 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Is-Admin-Project: True Jul 06 13:53:10.221533 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Project-Domain-Id: default Jul 06 13:53:10.221533 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Project-Domain-Name: Default Jul 06 13:53:10.221533 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Project-Id: 05df572327d54bd99595974b75898052 Jul 06 13:53:10.221533 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Project-Name: tempest-AttachVolumeTestJSON-1571746075 Jul 06 13:53:10.221533 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Role: reader,member Jul 06 13:53:10.221533 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Roles: reader,member Jul 06 13:53:10.223031 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_05df572327d54bd99595974b75898052"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/05df572327d54bd99595974b75898052"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/05df572327d54bd99595974b75898052"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/05df572327d54bd99595974b75898052"}]}] Jul 06 13:53:10.223031 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Tenant: tempest-AttachVolumeTestJSON-1571746075 Jul 06 13:53:10.223031 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Tenant-Id: 05df572327d54bd99595974b75898052 Jul 06 13:53:10.223031 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1571746075 Jul 06 13:53:10.223031 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-User: tempest-AttachVolumeTestJSON-1571746075-project Jul 06 13:53:10.223031 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-User-Domain-Id: default Jul 06 13:53:10.223031 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-User-Domain-Name: Default Jul 06 13:53:10.223031 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-User-Id: 3d7cacb73c8342579d9f990b0193487c Jul 06 13:53:10.223031 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-User-Name: tempest-AttachVolumeTestJSON-1571746075-project Jul 06 13:53:10.223031 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: method: > Jul 06 13:53:10.223031 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: exception: Instance 546a77fd-66e1-4d89-afa3-58d632b09186 could not be found. Jul 06 13:53:10.223031 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: action_args: {'id': '546a77fd-66e1-4d89-afa3-58d632b09186'} Jul 06 13:53:10.223918 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 06 13:53:10.223918 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 06 13:53:10.223918 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 06 13:53:10.223918 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 06 13:53:10.223918 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 06 13:53:10.223918 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 06 13:53:10.223918 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 06 13:53:10.223918 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 06 13:53:10.223918 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 06 13:53:10.223918 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 06 13:53:10.223918 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 546a77fd-66e1-4d89-afa3-58d632b09186 could not be found. Jul 06 13:53:10.223918 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi Jul 06 13:53:10.223918 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 06 13:53:10.223918 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi Jul 06 13:53:10.223918 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 06 13:53:10.223918 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 06 13:53:10.223918 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 06 13:53:10.223918 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 06 13:53:10.223918 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 06 13:53:10.223918 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 06 13:53:10.225346 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 06 13:53:10.225346 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 06 13:53:10.225346 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 06 13:53:10.225346 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 06 13:53:10.225346 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 06 13:53:10.225346 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 06 13:53:10.225346 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 06 13:53:10.225346 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 546a77fd-66e1-4d89-afa3-58d632b09186 could not be found. Jul 06 13:53:10.225346 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi Jul 06 13:53:10.225346 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 06 13:53:10.225346 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi Jul 06 13:53:10.225346 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 06 13:53:10.225346 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 06 13:53:10.225346 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 06 13:53:10.225346 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 06 13:53:10.225346 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 06 13:53:10.225346 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 546a77fd-66e1-4d89-afa3-58d632b09186 could not be found. Jul 06 13:53:10.225346 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi Jul 06 13:53:10.229793 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-07832edc-06a9-4364-ad06-33b771ccd372 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Returning 404 to user: Instance 546a77fd-66e1-4d89-afa3-58d632b09186 could not be found. {{(pid=124368) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 06 13:53:10.230883 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-07832edc-06a9-4364-ad06-33b771ccd372 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] 10.222.0.20 "GET /compute/v2.1/servers/546a77fd-66e1-4d89-afa3-58d632b09186" status: 404 len: 111 microversion: 2.1 time: 0.047346 Jul 06 13:53:10.243131 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 420/833] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:53:10 2022] GET /compute/v2.1/servers/546a77fd-66e1-4d89-afa3-58d632b09186 => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 06 13:53:10.248583 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-177ebfca-2b22-401f-a52e-f037131f41e7 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Calling method '.version_select at 0x7ffbc43b8040>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:53:10.272722 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-177ebfca-2b22-401f-a52e-f037131f41e7 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1180722985" status: 202 len: 0 microversion: 2.1 time: 0.028802 Jul 06 13:53:10.273978 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 414/834] 10.222.0.20 () {58 vars in 1220 bytes} [Wed Jul 6 13:53:10 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1180722985 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 06 13:53:11.161839 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-0ee996b5-744d-4299-b6c3-11f5ce3a42c0 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Action: 'create', calling method: .version_select at 0x7ffbbf6d45e0>, body: {"keypair": {"name": "tempest-keypair-717089440", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOKzXFGy4u4cAzA4cE3lfDIUgnXxu81JN0wyIBjaqSh6rV6nRJq+64S+FxtnEUzbxvT6ArssfHpimySNd6TOIhCUpbEYZgdnN45ZQgd1fj5QShe9W+wR4ulRZfFukBb2Wg=="}} {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 06 13:53:11.180877 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.quota [None req-0ee996b5-744d-4299-b6c3-11f5ce3a42c0 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Getting quotas for project 05df572327d54bd99595974b75898052. Resources: {'key_pairs'} {{(pid=124368) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 06 13:53:11.186156 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.quota [None req-0ee996b5-744d-4299-b6c3-11f5ce3a42c0 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Getting quotas for user 3d7cacb73c8342579d9f990b0193487c and project 05df572327d54bd99595974b75898052. Resources: {'key_pairs'} {{(pid=124368) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 06 13:53:11.218772 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-0ee996b5-744d-4299-b6c3-11f5ce3a42c0 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.075515 Jul 06 13:53:11.236192 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 421/835] 10.222.0.20 () {60 vars in 1158 bytes} [Wed Jul 6 13:53:11 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 06 13:53:12.164611 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-a5c13a84-8d20-4978-a94c-d200428c6c7f tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Action: 'create', calling method: .version_select at 0x7ffbc4191940>, body: {"keypair": {"name": "tempest-keypair-1604058782", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJSBaS+4v0Ob4Ly/TJ46Rtc0A4ydbprGGGA3GaLDXkE4Djrlyn1OHvZqjmAOy4HAjCY8gecbb5DX6WVBRtXF+0gCOIouljA5QGcVc49odAEl9Jbs4SoPaR4RLcffHthjMQ=="}} {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 06 13:53:12.179945 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.quota [None req-a5c13a84-8d20-4978-a94c-d200428c6c7f tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Getting quotas for project 9e3edb8d53184b98b7055ffc145f186d. Resources: {'key_pairs'} {{(pid=124367) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 06 13:53:12.184038 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.quota [None req-a5c13a84-8d20-4978-a94c-d200428c6c7f tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Getting quotas for user c85251638bc64deca16008b696b11ea4 and project 9e3edb8d53184b98b7055ffc145f186d. Resources: {'key_pairs'} {{(pid=124367) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 06 13:53:12.208467 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-a5c13a84-8d20-4978-a94c-d200428c6c7f tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.193385 Jul 06 13:53:12.209116 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 415/836] 10.222.0.20 () {62 vars in 1199 bytes} [Wed Jul 6 13:53:12 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 195 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jul 06 13:53:12.842849 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-3a24d16c-904f-4429-8c5f-46cc60a3e1c5 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-458799310", "imageRef": "b08481d9-1e39-41e8-97bd-b05a9c35b377", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "971af843-a8c2-4694-8a42-a011949622a1"}], "security_groups": [{"name": "tempest-securitygroup--1903479811"}], "key_name": "tempest-keypair-717089440", "user_data": "}} {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 06 13:53:13.013758 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.network.neutron [None req-3a24d16c-904f-4429-8c5f-46cc60a3e1c5 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] validate_networks() for [('971af843-a8c2-4694-8a42-a011949622a1', None, None, None, None, None)] {{(pid=124368) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 06 13:53:13.677718 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.virt.hardware [None req-3a24d16c-904f-4429-8c5f-46cc60a3e1c5 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Flavor limits 0:0:0 {{(pid=124368) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 06 13:53:13.678798 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.virt.hardware [None req-3a24d16c-904f-4429-8c5f-46cc60a3e1c5 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Image limits 0:0:0 {{(pid=124368) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 06 13:53:13.679481 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.virt.hardware [None req-3a24d16c-904f-4429-8c5f-46cc60a3e1c5 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Flavor pref 0:0:0 {{(pid=124368) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 06 13:53:13.680205 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.virt.hardware [None req-3a24d16c-904f-4429-8c5f-46cc60a3e1c5 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Image pref 0:0:0 {{(pid=124368) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 06 13:53:13.680835 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.virt.hardware [None req-3a24d16c-904f-4429-8c5f-46cc60a3e1c5 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124368) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 06 13:53:13.691898 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-3a24d16c-904f-4429-8c5f-46cc60a3e1c5 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:53:13.692502 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-3a24d16c-904f-4429-8c5f-46cc60a3e1c5 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:53:13.693420 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-3a24d16c-904f-4429-8c5f-46cc60a3e1c5 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:53:13.694084 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-3a24d16c-904f-4429-8c5f-46cc60a3e1c5 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:53:13.713785 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.quota [None req-3a24d16c-904f-4429-8c5f-46cc60a3e1c5 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Getting quotas for project 05df572327d54bd99595974b75898052. Resources: {'instances', 'cores', 'ram'} {{(pid=124368) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 06 13:53:13.718976 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.quota [None req-3a24d16c-904f-4429-8c5f-46cc60a3e1c5 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Getting quotas for user 3d7cacb73c8342579d9f990b0193487c and project 05df572327d54bd99595974b75898052. Resources: {'instances', 'cores', 'ram'} {{(pid=124368) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 06 13:53:13.732422 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-3a24d16c-904f-4429-8c5f-46cc60a3e1c5 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Going to run 1 instances... {{(pid=124368) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 06 13:53:13.735412 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-3a24d16c-904f-4429-8c5f-46cc60a3e1c5 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] [instance: be6603c1-852c-4efc-8442-14b7228cf3d0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b08481d9-1e39-41e8-97bd-b05a9c35b377',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124368) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 06 13:53:13.786568 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-3a24d16c-904f-4429-8c5f-46cc60a3e1c5 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.947986 Jul 06 13:53:13.788055 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 422/837] 10.222.0.20 () {60 vars in 1146 bytes} [Wed Jul 6 13:53:12 2022] POST /compute/v2.1/servers => generated 402 bytes in 950 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 06 13:53:13.798770 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-eb4c0ab2-238e-44eb-acca-71467976c9d3 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:53:13.800352 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-eb4c0ab2-238e-44eb-acca-71467976c9d3 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] [instance: be6603c1-852c-4efc-8442-14b7228cf3d0] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:53:13.909099 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-eb4c0ab2-238e-44eb-acca-71467976c9d3 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d7cacb73c8342579d9f990b0193487c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05df572327d54bd99595974b75898052', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:53:13.916294 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-eb4c0ab2-238e-44eb-acca-71467976c9d3 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] 10.222.0.20 "GET /compute/v2.1/servers/be6603c1-852c-4efc-8442-14b7228cf3d0" status: 200 len: 1236 microversion: 2.1 time: 0.122232 Jul 06 13:53:13.919128 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 416/838] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:53:13 2022] GET /compute/v2.1/servers/be6603c1-852c-4efc-8442-14b7228cf3d0 => generated 1236 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:53:13.932737 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-691c9390-7743-4912-b479-a61312bf356b tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1773289924", "imageRef": "b08481d9-1e39-41e8-97bd-b05a9c35b377", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "e12e604c-a9aa-4964-89ef-163e19d2e86f"}], "security_groups": [{"name": "tempest-securitygroup--442232709"}], "key_name": "tempest-keypair-1604058782", "user_data": "}} {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 06 13:53:14.351102 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.network.neutron [None req-691c9390-7743-4912-b479-a61312bf356b tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] validate_networks() for [('e12e604c-a9aa-4964-89ef-163e19d2e86f', None, None, None, None, None)] {{(pid=124368) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 06 13:53:14.933108 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-cef4758d-a8f5-4bfb-830b-ca53d41df259 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:53:14.934398 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-cef4758d-a8f5-4bfb-830b-ca53d41df259 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] [instance: be6603c1-852c-4efc-8442-14b7228cf3d0] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:53:14.942394 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-cef4758d-a8f5-4bfb-830b-ca53d41df259 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:53:14.942947 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-cef4758d-a8f5-4bfb-830b-ca53d41df259 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:53:14.943902 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-cef4758d-a8f5-4bfb-830b-ca53d41df259 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:53:14.944323 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-cef4758d-a8f5-4bfb-830b-ca53d41df259 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:53:14.956090 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.virt.hardware [None req-691c9390-7743-4912-b479-a61312bf356b tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Flavor limits 0:0:0 {{(pid=124368) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 06 13:53:14.956569 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.virt.hardware [None req-691c9390-7743-4912-b479-a61312bf356b tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Image limits 0:0:0 {{(pid=124368) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 06 13:53:14.956986 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.virt.hardware [None req-691c9390-7743-4912-b479-a61312bf356b tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Flavor pref 0:0:0 {{(pid=124368) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 06 13:53:14.957620 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.virt.hardware [None req-691c9390-7743-4912-b479-a61312bf356b tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Image pref 0:0:0 {{(pid=124368) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 06 13:53:14.958215 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.virt.hardware [None req-691c9390-7743-4912-b479-a61312bf356b tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124368) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 06 13:53:14.970849 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-691c9390-7743-4912-b479-a61312bf356b tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:53:14.971314 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-691c9390-7743-4912-b479-a61312bf356b tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:53:14.972282 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-691c9390-7743-4912-b479-a61312bf356b tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:53:14.972733 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-691c9390-7743-4912-b479-a61312bf356b tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:53:15.034975 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.quota [None req-691c9390-7743-4912-b479-a61312bf356b tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Getting quotas for project 9e3edb8d53184b98b7055ffc145f186d. Resources: {'instances', 'cores', 'ram'} {{(pid=124368) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 06 13:53:15.039904 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.quota [None req-691c9390-7743-4912-b479-a61312bf356b tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Getting quotas for user c85251638bc64deca16008b696b11ea4 and project 9e3edb8d53184b98b7055ffc145f186d. Resources: {'instances', 'cores', 'ram'} {{(pid=124368) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 06 13:53:15.053954 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-691c9390-7743-4912-b479-a61312bf356b tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Going to run 1 instances... {{(pid=124368) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 06 13:53:15.057281 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-691c9390-7743-4912-b479-a61312bf356b tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] [instance: 4c0c4bb6-269f-46bc-b460-7d0299277753] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b08481d9-1e39-41e8-97bd-b05a9c35b377',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124368) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 06 13:53:15.102419 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-cef4758d-a8f5-4bfb-830b-ca53d41df259 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d7cacb73c8342579d9f990b0193487c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05df572327d54bd99595974b75898052', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:53:15.112496 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-cef4758d-a8f5-4bfb-830b-ca53d41df259 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] 10.222.0.20 "GET /compute/v2.1/servers/be6603c1-852c-4efc-8442-14b7228cf3d0" status: 200 len: 1288 microversion: 2.1 time: 0.183812 Jul 06 13:53:15.123891 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 417/839] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:53:14 2022] GET /compute/v2.1/servers/be6603c1-852c-4efc-8442-14b7228cf3d0 => generated 1288 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 06 13:53:15.134080 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-915e9c74-ebe5-4afe-8cb5-fe35a2563b13 tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:53:15.135580 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-915e9c74-ebe5-4afe-8cb5-fe35a2563b13 tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] [instance: 0a925141-db5f-4cae-bc6c-8ca4930adf73] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:53:15.160079 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-915e9c74-ebe5-4afe-8cb5-fe35a2563b13 tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:53:15.161482 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-915e9c74-ebe5-4afe-8cb5-fe35a2563b13 tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:53:15.162965 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-915e9c74-ebe5-4afe-8cb5-fe35a2563b13 tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:53:15.164748 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-915e9c74-ebe5-4afe-8cb5-fe35a2563b13 tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:53:15.197811 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-691c9390-7743-4912-b479-a61312bf356b tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 1.270534 Jul 06 13:53:15.198693 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 423/840] 10.222.0.20 () {62 vars in 1187 bytes} [Wed Jul 6 13:53:13 2022] POST /compute/v2.1/servers => generated 401 bytes in 1272 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 06 13:53:15.210086 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [req-161c7d06-d9b5-4b7b-bd4f-036663ac8bb4 req-cdfee13d-b093-4a26-b1ec-a218cfe3939c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0a925141-db5f-4cae-bc6c-8ca4930adf73", "tag": "e0490198-5029-4543-9a66-8d41adcd3783"}]} {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 06 13:53:15.223673 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-915e9c74-ebe5-4afe-8cb5-fe35a2563b13 tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] [instance: 0a925141-db5f-4cae-bc6c-8ca4930adf73] Going to try to terminate instance {{(pid=124367) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 06 13:53:15.255922 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [req-161c7d06-d9b5-4b7b-bd4f-036663ac8bb4 req-cdfee13d-b093-4a26-b1ec-a218cfe3939c service nova] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:53:15.258485 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [req-161c7d06-d9b5-4b7b-bd4f-036663ac8bb4 req-cdfee13d-b093-4a26-b1ec-a218cfe3939c service nova] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:53:15.283185 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG dbcounter [-] [124368] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=124368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:53:15.286870 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.compute.server_external_events [req-161c7d06-d9b5-4b7b-bd4f-036663ac8bb4 req-cdfee13d-b093-4a26-b1ec-a218cfe3939c service nova] Creating event network-changed:e0490198-5029-4543-9a66-8d41adcd3783 for instance 0a925141-db5f-4cae-bc6c-8ca4930adf73 on hv-cinder-81914 Jul 06 13:53:15.299192 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [req-161c7d06-d9b5-4b7b-bd4f-036663ac8bb4 req-cdfee13d-b093-4a26-b1ec-a218cfe3939c service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.096724 Jul 06 13:53:15.300132 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 424/841] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 6 13:53:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 06 13:53:15.306611 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-66e6db2f-c77d-4610-86f2-67812981b843 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Calling method '>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:53:15.307343 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-66e6db2f-c77d-4610-86f2-67812981b843 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] [instance: 4c0c4bb6-269f-46bc-b460-7d0299277753] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:53:15.422785 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-915e9c74-ebe5-4afe-8cb5-fe35a2563b13 tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] 10.222.0.20 "DELETE /compute/v2.1/servers/0a925141-db5f-4cae-bc6c-8ca4930adf73" status: 204 len: 0 microversion: 2.1 time: 0.297343 Jul 06 13:53:15.426394 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 418/842] 10.222.0.20 () {58 vars in 1238 bytes} [Wed Jul 6 13:53:15 2022] DELETE /compute/v2.1/servers/0a925141-db5f-4cae-bc6c-8ca4930adf73 => generated 0 bytes in 302 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 06 13:53:15.437091 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-d8e92bdd-bd99-4e65-a9c2-a6317ca22ab4 tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:53:15.447427 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-d8e92bdd-bd99-4e65-a9c2-a6317ca22ab4 tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] [instance: 0a925141-db5f-4cae-bc6c-8ca4930adf73] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:53:15.459164 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-d8e92bdd-bd99-4e65-a9c2-a6317ca22ab4 tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:53:15.459492 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-d8e92bdd-bd99-4e65-a9c2-a6317ca22ab4 tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:53:15.460871 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-d8e92bdd-bd99-4e65-a9c2-a6317ca22ab4 tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:53:15.466799 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-d8e92bdd-bd99-4e65-a9c2-a6317ca22ab4 tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:53:15.482542 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-66e6db2f-c77d-4610-86f2-67812981b843 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c85251638bc64deca16008b696b11ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3edb8d53184b98b7055ffc145f186d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:53:15.506737 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-66e6db2f-c77d-4610-86f2-67812981b843 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c85251638bc64deca16008b696b11ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3edb8d53184b98b7055ffc145f186d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:53:15.511881 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-66e6db2f-c77d-4610-86f2-67812981b843 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c85251638bc64deca16008b696b11ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3edb8d53184b98b7055ffc145f186d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:53:15.513081 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-66e6db2f-c77d-4610-86f2-67812981b843 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] 10.222.0.20 "GET /compute/v2.1/servers/4c0c4bb6-269f-46bc-b460-7d0299277753" status: 200 len: 1282 microversion: 2.20 time: 0.212049 Jul 06 13:53:15.513835 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 425/843] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 6 13:53:15 2022] GET /compute/v2.1/servers/4c0c4bb6-269f-46bc-b460-7d0299277753 => generated 1282 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 06 13:53:15.674456 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-d8e92bdd-bd99-4e65-a9c2-a6317ca22ab4 tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53d00e4198e240c8a5c2fbe8bd241b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1727f66e37f94cc6971b574c8635e078', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:53:15.684809 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-d8e92bdd-bd99-4e65-a9c2-a6317ca22ab4 tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] 10.222.0.20 "GET /compute/v2.1/servers/0a925141-db5f-4cae-bc6c-8ca4930adf73" status: 200 len: 1566 microversion: 2.1 time: 0.251566 Jul 06 13:53:15.696235 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 419/844] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:53:15 2022] GET /compute/v2.1/servers/0a925141-db5f-4cae-bc6c-8ca4930adf73 => generated 1566 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:53:16.135781 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-49a8fdfa-b072-4ed5-a2f3-0578729caa3c tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Calling method '>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:53:16.136454 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-49a8fdfa-b072-4ed5-a2f3-0578729caa3c tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] [instance: be6603c1-852c-4efc-8442-14b7228cf3d0] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:53:16.144287 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-49a8fdfa-b072-4ed5-a2f3-0578729caa3c tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:53:16.144747 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-49a8fdfa-b072-4ed5-a2f3-0578729caa3c tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:53:16.145560 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-49a8fdfa-b072-4ed5-a2f3-0578729caa3c tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:53:16.146004 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-49a8fdfa-b072-4ed5-a2f3-0578729caa3c tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:53:16.216040 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-49a8fdfa-b072-4ed5-a2f3-0578729caa3c tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d7cacb73c8342579d9f990b0193487c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05df572327d54bd99595974b75898052', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:53:16.224192 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-49a8fdfa-b072-4ed5-a2f3-0578729caa3c tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] 10.222.0.20 "GET /compute/v2.1/servers/be6603c1-852c-4efc-8442-14b7228cf3d0" status: 200 len: 1294 microversion: 2.1 time: 0.092387 Jul 06 13:53:16.224831 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 426/845] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:53:16 2022] GET /compute/v2.1/servers/be6603c1-852c-4efc-8442-14b7228cf3d0 => generated 1294 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:53:16.532228 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-b9a19043-d82e-4e97-b45c-3dc378cd6b25 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:53:16.533473 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-b9a19043-d82e-4e97-b45c-3dc378cd6b25 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] [instance: 4c0c4bb6-269f-46bc-b460-7d0299277753] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:53:16.545508 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-b9a19043-d82e-4e97-b45c-3dc378cd6b25 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:53:16.546347 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-b9a19043-d82e-4e97-b45c-3dc378cd6b25 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:53:16.547328 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-b9a19043-d82e-4e97-b45c-3dc378cd6b25 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:53:16.547767 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-b9a19043-d82e-4e97-b45c-3dc378cd6b25 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:53:16.658189 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-b9a19043-d82e-4e97-b45c-3dc378cd6b25 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c85251638bc64deca16008b696b11ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3edb8d53184b98b7055ffc145f186d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:53:16.666606 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-b9a19043-d82e-4e97-b45c-3dc378cd6b25 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c85251638bc64deca16008b696b11ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3edb8d53184b98b7055ffc145f186d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:53:16.668096 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-b9a19043-d82e-4e97-b45c-3dc378cd6b25 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c85251638bc64deca16008b696b11ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3edb8d53184b98b7055ffc145f186d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:53:16.669256 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-b9a19043-d82e-4e97-b45c-3dc378cd6b25 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] 10.222.0.20 "GET /compute/v2.1/servers/4c0c4bb6-269f-46bc-b460-7d0299277753" status: 200 len: 1286 microversion: 2.20 time: 0.141148 Jul 06 13:53:16.669810 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 420/846] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 6 13:53:16 2022] GET /compute/v2.1/servers/4c0c4bb6-269f-46bc-b460-7d0299277753 => generated 1286 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 06 13:53:16.701943 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-c43468c5-8df6-4c77-bba9-9d4faa35279d tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] Calling method '>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:53:16.702565 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-c43468c5-8df6-4c77-bba9-9d4faa35279d tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] [instance: 0a925141-db5f-4cae-bc6c-8ca4930adf73] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:53:16.708560 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-c43468c5-8df6-4c77-bba9-9d4faa35279d tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:53:16.709140 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-c43468c5-8df6-4c77-bba9-9d4faa35279d tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:53:16.709851 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-c43468c5-8df6-4c77-bba9-9d4faa35279d tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:53:16.710366 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-c43468c5-8df6-4c77-bba9-9d4faa35279d tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:53:16.878407 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-c43468c5-8df6-4c77-bba9-9d4faa35279d tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53d00e4198e240c8a5c2fbe8bd241b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1727f66e37f94cc6971b574c8635e078', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:53:16.887231 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-c43468c5-8df6-4c77-bba9-9d4faa35279d tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] 10.222.0.20 "GET /compute/v2.1/servers/0a925141-db5f-4cae-bc6c-8ca4930adf73" status: 200 len: 1566 microversion: 2.1 time: 0.189082 Jul 06 13:53:16.887896 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 427/847] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:53:16 2022] GET /compute/v2.1/servers/0a925141-db5f-4cae-bc6c-8ca4930adf73 => generated 1566 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:53:17.241772 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-4eb5801d-3e28-43ab-a72c-b11f31676f96 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:53:17.242869 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-4eb5801d-3e28-43ab-a72c-b11f31676f96 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] [instance: be6603c1-852c-4efc-8442-14b7228cf3d0] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:53:17.248773 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-4eb5801d-3e28-43ab-a72c-b11f31676f96 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:53:17.249261 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-4eb5801d-3e28-43ab-a72c-b11f31676f96 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:53:17.250041 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-4eb5801d-3e28-43ab-a72c-b11f31676f96 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:53:17.250471 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-4eb5801d-3e28-43ab-a72c-b11f31676f96 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:53:17.457051 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-4eb5801d-3e28-43ab-a72c-b11f31676f96 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d7cacb73c8342579d9f990b0193487c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05df572327d54bd99595974b75898052', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:53:17.465275 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-4eb5801d-3e28-43ab-a72c-b11f31676f96 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] 10.222.0.20 "GET /compute/v2.1/servers/be6603c1-852c-4efc-8442-14b7228cf3d0" status: 200 len: 1362 microversion: 2.1 time: 0.227248 Jul 06 13:53:17.466188 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 421/848] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:53:17 2022] GET /compute/v2.1/servers/be6603c1-852c-4efc-8442-14b7228cf3d0 => generated 1362 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 06 13:53:17.689719 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-d912c2b9-884b-4874-8cff-97178a7d585e tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Calling method '>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:53:17.690568 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-d912c2b9-884b-4874-8cff-97178a7d585e tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] [instance: 4c0c4bb6-269f-46bc-b460-7d0299277753] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:53:17.697555 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-d912c2b9-884b-4874-8cff-97178a7d585e tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:53:17.698325 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-d912c2b9-884b-4874-8cff-97178a7d585e tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:53:17.699343 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-d912c2b9-884b-4874-8cff-97178a7d585e tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:53:17.700009 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-d912c2b9-884b-4874-8cff-97178a7d585e tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:53:17.786739 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-d912c2b9-884b-4874-8cff-97178a7d585e tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c85251638bc64deca16008b696b11ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3edb8d53184b98b7055ffc145f186d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:53:17.795523 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-d912c2b9-884b-4874-8cff-97178a7d585e tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c85251638bc64deca16008b696b11ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3edb8d53184b98b7055ffc145f186d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:53:17.797413 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-d912c2b9-884b-4874-8cff-97178a7d585e tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c85251638bc64deca16008b696b11ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3edb8d53184b98b7055ffc145f186d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:53:17.799368 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-d912c2b9-884b-4874-8cff-97178a7d585e tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] 10.222.0.20 "GET /compute/v2.1/servers/4c0c4bb6-269f-46bc-b460-7d0299277753" status: 200 len: 1340 microversion: 2.20 time: 0.113110 Jul 06 13:53:17.799997 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 428/849] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 6 13:53:17 2022] GET /compute/v2.1/servers/4c0c4bb6-269f-46bc-b460-7d0299277753 => generated 1340 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 06 13:53:17.904882 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-464263f6-9304-4f45-a3a6-b0cb3d81e2db tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:53:17.906630 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-464263f6-9304-4f45-a3a6-b0cb3d81e2db tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] [instance: 0a925141-db5f-4cae-bc6c-8ca4930adf73] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:53:17.913876 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-464263f6-9304-4f45-a3a6-b0cb3d81e2db tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:53:17.914538 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-464263f6-9304-4f45-a3a6-b0cb3d81e2db tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:53:17.915320 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-464263f6-9304-4f45-a3a6-b0cb3d81e2db tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:53:17.915748 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-464263f6-9304-4f45-a3a6-b0cb3d81e2db tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:53:18.187683 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [req-22be6f52-2017-402a-9227-1eaac7641af8 req-951bc28f-a838-45c0-8def-9bebe917f270 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0a925141-db5f-4cae-bc6c-8ca4930adf73", "name": "network-vif-deleted", "tag": "e0490198-5029-4543-9a66-8d41adcd3783"}]} {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 06 13:53:18.201244 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [req-22be6f52-2017-402a-9227-1eaac7641af8 req-951bc28f-a838-45c0-8def-9bebe917f270 service nova] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:53:18.201665 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [req-22be6f52-2017-402a-9227-1eaac7641af8 req-951bc28f-a838-45c0-8def-9bebe917f270 service nova] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:53:18.215652 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.compute.server_external_events [req-22be6f52-2017-402a-9227-1eaac7641af8 req-951bc28f-a838-45c0-8def-9bebe917f270 service nova] Creating event network-vif-deleted:e0490198-5029-4543-9a66-8d41adcd3783 for instance 0a925141-db5f-4cae-bc6c-8ca4930adf73 on hv-cinder-81914 Jul 06 13:53:18.220932 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [req-22be6f52-2017-402a-9227-1eaac7641af8 req-951bc28f-a838-45c0-8def-9bebe917f270 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039052 Jul 06 13:53:18.221579 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 429/850] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 6 13:53:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 06 13:53:18.466178 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-464263f6-9304-4f45-a3a6-b0cb3d81e2db tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53d00e4198e240c8a5c2fbe8bd241b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1727f66e37f94cc6971b574c8635e078', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:53:18.474079 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-464263f6-9304-4f45-a3a6-b0cb3d81e2db tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] 10.222.0.20 "GET /compute/v2.1/servers/0a925141-db5f-4cae-bc6c-8ca4930adf73" status: 200 len: 1448 microversion: 2.1 time: 0.573435 Jul 06 13:53:18.485760 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 422/851] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:53:17 2022] GET /compute/v2.1/servers/0a925141-db5f-4cae-bc6c-8ca4930adf73 => generated 1448 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:53:18.485961 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-5ee1c15e-988f-4e82-8d44-24b596d05908 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Calling method '>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:53:18.485961 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-5ee1c15e-988f-4e82-8d44-24b596d05908 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] [instance: be6603c1-852c-4efc-8442-14b7228cf3d0] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:53:18.496701 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-5ee1c15e-988f-4e82-8d44-24b596d05908 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:53:18.498554 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-5ee1c15e-988f-4e82-8d44-24b596d05908 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:53:18.499874 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-5ee1c15e-988f-4e82-8d44-24b596d05908 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:53:18.502621 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-5ee1c15e-988f-4e82-8d44-24b596d05908 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:53:18.802666 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-5ee1c15e-988f-4e82-8d44-24b596d05908 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d7cacb73c8342579d9f990b0193487c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05df572327d54bd99595974b75898052', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:53:18.811204 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-5ee1c15e-988f-4e82-8d44-24b596d05908 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] 10.222.0.20 "GET /compute/v2.1/servers/be6603c1-852c-4efc-8442-14b7228cf3d0" status: 200 len: 1362 microversion: 2.1 time: 0.332008 Jul 06 13:53:18.820291 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-845131b6-d2a7-4e6f-b964-72862eb6e0c1 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:53:18.821150 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 430/852] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:53:18 2022] GET /compute/v2.1/servers/be6603c1-852c-4efc-8442-14b7228cf3d0 => generated 1362 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:53:18.821512 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-845131b6-d2a7-4e6f-b964-72862eb6e0c1 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] [instance: 4c0c4bb6-269f-46bc-b460-7d0299277753] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:53:18.828913 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-845131b6-d2a7-4e6f-b964-72862eb6e0c1 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:53:18.829725 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-845131b6-d2a7-4e6f-b964-72862eb6e0c1 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:53:18.830743 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-845131b6-d2a7-4e6f-b964-72862eb6e0c1 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:53:18.831428 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-845131b6-d2a7-4e6f-b964-72862eb6e0c1 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:53:18.939570 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-845131b6-d2a7-4e6f-b964-72862eb6e0c1 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c85251638bc64deca16008b696b11ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3edb8d53184b98b7055ffc145f186d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:53:18.948199 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-845131b6-d2a7-4e6f-b964-72862eb6e0c1 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c85251638bc64deca16008b696b11ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3edb8d53184b98b7055ffc145f186d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:53:18.949721 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-845131b6-d2a7-4e6f-b964-72862eb6e0c1 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c85251638bc64deca16008b696b11ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3edb8d53184b98b7055ffc145f186d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:53:18.950821 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-845131b6-d2a7-4e6f-b964-72862eb6e0c1 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] 10.222.0.20 "GET /compute/v2.1/servers/4c0c4bb6-269f-46bc-b460-7d0299277753" status: 200 len: 1340 microversion: 2.20 time: 0.136820 Jul 06 13:53:18.951752 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 423/853] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 6 13:53:18 2022] GET /compute/v2.1/servers/4c0c4bb6-269f-46bc-b460-7d0299277753 => generated 1340 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 06 13:53:19.093986 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [req-07f4fc6f-990b-4b10-b4df-7d99f6808257 req-1088cb2e-55a1-4e5c-9745-1161ea06724c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "be6603c1-852c-4efc-8442-14b7228cf3d0", "tag": "73906c58-8548-4ecf-a678-d849a4bac0f7"}]} {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 06 13:53:19.102858 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [req-07f4fc6f-990b-4b10-b4df-7d99f6808257 req-1088cb2e-55a1-4e5c-9745-1161ea06724c service nova] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:53:19.103256 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [req-07f4fc6f-990b-4b10-b4df-7d99f6808257 req-1088cb2e-55a1-4e5c-9745-1161ea06724c service nova] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:53:19.117033 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.compute.server_external_events [req-07f4fc6f-990b-4b10-b4df-7d99f6808257 req-1088cb2e-55a1-4e5c-9745-1161ea06724c service nova] Creating event network-changed:73906c58-8548-4ecf-a678-d849a4bac0f7 for instance be6603c1-852c-4efc-8442-14b7228cf3d0 on hv-cinder-81914 Jul 06 13:53:19.122222 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [req-07f4fc6f-990b-4b10-b4df-7d99f6808257 req-1088cb2e-55a1-4e5c-9745-1161ea06724c service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031718 Jul 06 13:53:19.123064 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 431/854] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 6 13:53:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 06 13:53:19.493818 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-5bea87f5-000c-4e09-ac86-51f06bddd0fa tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:53:19.494426 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-5bea87f5-000c-4e09-ac86-51f06bddd0fa tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] [instance: 0a925141-db5f-4cae-bc6c-8ca4930adf73] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:53:19.500746 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-5bea87f5-000c-4e09-ac86-51f06bddd0fa tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:53:19.501225 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-5bea87f5-000c-4e09-ac86-51f06bddd0fa tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:53:19.502199 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-5bea87f5-000c-4e09-ac86-51f06bddd0fa tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:53:19.502624 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-5bea87f5-000c-4e09-ac86-51f06bddd0fa tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:53:19.519088 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.wsgi [None req-5bea87f5-000c-4e09-ac86-51f06bddd0fa tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] HTTP exception thrown: Instance 0a925141-db5f-4cae-bc6c-8ca4930adf73 could not be found. Jul 06 13:53:19.520818 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-5bea87f5-000c-4e09-ac86-51f06bddd0fa tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] Request method failure captured: Jul 06 13:53:19.520818 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: request: GET /compute/v2.1/servers/0a925141-db5f-4cae-bc6c-8ca4930adf73 HTTP/1.1 Jul 06 13:53:19.520818 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: Accept: application/json Jul 06 13:53:19.520818 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: Accept-Encoding: identity Jul 06 13:53:19.520818 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: Connection: close Jul 06 13:53:19.520818 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: Content-Length: 0 Jul 06 13:53:19.520818 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: Content-Type: application/json Jul 06 13:53:19.520818 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: Host: 10.222.0.20 Jul 06 13:53:19.520818 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: Openstack-System-Scope: None Jul 06 13:53:19.520818 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: User-Agent: python-urllib3/1.26.9 Jul 06 13:53:19.520818 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: X-Auth-Token: gAAAAABixZIyRLFgjQfTGqp7Geug64QNIqpIqFfj2RTn8lS4iTFT19jk84JjdhXMw0OtUsOwcB4I6_j4OqjCAmwCIHrA3Z3g7KT8Q7TkPzn7eo8xtMU_ZU6OA9FRY-0xGpxhtrRgZ0XutEou-KAfJdT6kqDhpXBxvoYp0nW06WTwx-_1VxN-1e0 Jul 06 13:53:19.520818 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: X-Domain-Id: None Jul 06 13:53:19.520818 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: X-Domain-Name: None Jul 06 13:53:19.520818 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: X-Identity-Status: Confirmed Jul 06 13:53:19.520818 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: X-Is-Admin-Project: True Jul 06 13:53:19.520818 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: X-Project-Domain-Id: default Jul 06 13:53:19.520818 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: X-Project-Domain-Name: Default Jul 06 13:53:19.520818 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: X-Project-Id: 1727f66e37f94cc6971b574c8635e078 Jul 06 13:53:19.520818 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: X-Project-Name: tempest-TestShelveInstance-1472249093 Jul 06 13:53:19.520818 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: X-Role: reader,member Jul 06 13:53:19.520818 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: X-Roles: reader,member Jul 06 13:53:19.522190 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_1727f66e37f94cc6971b574c8635e078"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/1727f66e37f94cc6971b574c8635e078"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/1727f66e37f94cc6971b574c8635e078"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/1727f66e37f94cc6971b574c8635e078"}]}] Jul 06 13:53:19.522190 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: X-Tenant: tempest-TestShelveInstance-1472249093 Jul 06 13:53:19.522190 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: X-Tenant-Id: 1727f66e37f94cc6971b574c8635e078 Jul 06 13:53:19.522190 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: X-Tenant-Name: tempest-TestShelveInstance-1472249093 Jul 06 13:53:19.522190 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: X-User: tempest-TestShelveInstance-1472249093-project Jul 06 13:53:19.522190 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: X-User-Domain-Id: default Jul 06 13:53:19.522190 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: X-User-Domain-Name: Default Jul 06 13:53:19.522190 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: X-User-Id: 53d00e4198e240c8a5c2fbe8bd241b45 Jul 06 13:53:19.522190 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: X-User-Name: tempest-TestShelveInstance-1472249093-project Jul 06 13:53:19.522190 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: method: > Jul 06 13:53:19.522190 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: exception: Instance 0a925141-db5f-4cae-bc6c-8ca4930adf73 could not be found. Jul 06 13:53:19.522190 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: action_args: {'id': '0a925141-db5f-4cae-bc6c-8ca4930adf73'} Jul 06 13:53:19.523756 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 06 13:53:19.523756 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 06 13:53:19.523756 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 06 13:53:19.523756 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 06 13:53:19.523756 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 06 13:53:19.523756 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 06 13:53:19.523756 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 06 13:53:19.523756 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 06 13:53:19.523756 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 06 13:53:19.523756 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 06 13:53:19.523756 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0a925141-db5f-4cae-bc6c-8ca4930adf73 could not be found. Jul 06 13:53:19.523756 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi Jul 06 13:53:19.523756 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 06 13:53:19.523756 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi Jul 06 13:53:19.523756 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 06 13:53:19.523756 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 06 13:53:19.523756 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 06 13:53:19.523756 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 06 13:53:19.523756 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 06 13:53:19.523756 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 06 13:53:19.529451 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 06 13:53:19.529451 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 06 13:53:19.529451 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 06 13:53:19.529451 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 06 13:53:19.529451 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 06 13:53:19.529451 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 06 13:53:19.529451 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 06 13:53:19.529451 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0a925141-db5f-4cae-bc6c-8ca4930adf73 could not be found. Jul 06 13:53:19.529451 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi Jul 06 13:53:19.529451 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 06 13:53:19.529451 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi Jul 06 13:53:19.529451 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 06 13:53:19.529451 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 06 13:53:19.529451 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 06 13:53:19.529451 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 06 13:53:19.529451 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 06 13:53:19.529451 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0a925141-db5f-4cae-bc6c-8ca4930adf73 could not be found. Jul 06 13:53:19.529451 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi Jul 06 13:53:19.531780 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-5bea87f5-000c-4e09-ac86-51f06bddd0fa tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] Returning 404 to user: Instance 0a925141-db5f-4cae-bc6c-8ca4930adf73 could not be found. {{(pid=124367) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 06 13:53:19.531780 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-5bea87f5-000c-4e09-ac86-51f06bddd0fa tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] 10.222.0.20 "GET /compute/v2.1/servers/0a925141-db5f-4cae-bc6c-8ca4930adf73" status: 404 len: 111 microversion: 2.1 time: 0.032881 Jul 06 13:53:19.531780 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 424/855] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:53:19 2022] GET /compute/v2.1/servers/0a925141-db5f-4cae-bc6c-8ca4930adf73 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 06 13:53:19.697091 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-445683ab-0ff8-4ea4-a997-0e495e576d37 tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] Calling method '.version_select at 0x7ffbc40dc4c0>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:53:19.720409 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-445683ab-0ff8-4ea4-a997-0e495e576d37 tempest-TestShelveInstance-1472249093 tempest-TestShelveInstance-1472249093-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-135657547" status: 202 len: 0 microversion: 2.1 time: 0.028209 Jul 06 13:53:19.721251 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 432/856] 10.222.0.20 () {58 vars in 1250 bytes} [Wed Jul 6 13:53:19 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-135657547 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 06 13:53:19.828420 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-db024cb7-a4a5-4833-bb0b-734a4afed942 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:53:19.829210 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-db024cb7-a4a5-4833-bb0b-734a4afed942 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] [instance: be6603c1-852c-4efc-8442-14b7228cf3d0] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:53:19.835636 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-db024cb7-a4a5-4833-bb0b-734a4afed942 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:53:19.836222 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-db024cb7-a4a5-4833-bb0b-734a4afed942 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:53:19.837116 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-db024cb7-a4a5-4833-bb0b-734a4afed942 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:53:19.837630 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-db024cb7-a4a5-4833-bb0b-734a4afed942 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:53:19.970280 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-22d4e9ff-bd77-4fb0-b9d4-c6e343160b4a tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Calling method '>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:53:19.971236 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-22d4e9ff-bd77-4fb0-b9d4-c6e343160b4a tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] [instance: 4c0c4bb6-269f-46bc-b460-7d0299277753] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:53:19.978860 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-22d4e9ff-bd77-4fb0-b9d4-c6e343160b4a tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:53:19.979248 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-22d4e9ff-bd77-4fb0-b9d4-c6e343160b4a tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:53:19.980120 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-22d4e9ff-bd77-4fb0-b9d4-c6e343160b4a tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:53:19.980905 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-22d4e9ff-bd77-4fb0-b9d4-c6e343160b4a tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:53:20.088202 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-db024cb7-a4a5-4833-bb0b-734a4afed942 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d7cacb73c8342579d9f990b0193487c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05df572327d54bd99595974b75898052', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:53:20.096546 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-db024cb7-a4a5-4833-bb0b-734a4afed942 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] 10.222.0.20 "GET /compute/v2.1/servers/be6603c1-852c-4efc-8442-14b7228cf3d0" status: 200 len: 1362 microversion: 2.1 time: 0.272003 Jul 06 13:53:20.097686 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 425/857] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:53:19 2022] GET /compute/v2.1/servers/be6603c1-852c-4efc-8442-14b7228cf3d0 => generated 1362 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:53:20.389738 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-22d4e9ff-bd77-4fb0-b9d4-c6e343160b4a tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c85251638bc64deca16008b696b11ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3edb8d53184b98b7055ffc145f186d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:53:20.398246 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-22d4e9ff-bd77-4fb0-b9d4-c6e343160b4a tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c85251638bc64deca16008b696b11ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3edb8d53184b98b7055ffc145f186d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:53:20.399966 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-22d4e9ff-bd77-4fb0-b9d4-c6e343160b4a tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c85251638bc64deca16008b696b11ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3edb8d53184b98b7055ffc145f186d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:53:20.401336 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-22d4e9ff-bd77-4fb0-b9d4-c6e343160b4a tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] 10.222.0.20 "GET /compute/v2.1/servers/4c0c4bb6-269f-46bc-b460-7d0299277753" status: 200 len: 1407 microversion: 2.20 time: 0.435099 Jul 06 13:53:20.401884 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 433/858] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 6 13:53:19 2022] GET /compute/v2.1/servers/4c0c4bb6-269f-46bc-b460-7d0299277753 => generated 1407 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 06 13:53:21.115904 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-ba49dc1e-8f1b-49f3-b44e-611a9a6aa109 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:53:21.117233 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-ba49dc1e-8f1b-49f3-b44e-611a9a6aa109 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] [instance: be6603c1-852c-4efc-8442-14b7228cf3d0] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:53:21.123929 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-ba49dc1e-8f1b-49f3-b44e-611a9a6aa109 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:53:21.124391 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-ba49dc1e-8f1b-49f3-b44e-611a9a6aa109 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:53:21.128790 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-ba49dc1e-8f1b-49f3-b44e-611a9a6aa109 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:53:21.129310 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-ba49dc1e-8f1b-49f3-b44e-611a9a6aa109 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:53:21.132588 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG dbcounter [-] [124367] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=124367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:53:21.146645 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [req-eea3c5be-2aa4-4c91-ad44-fdf12b4ebe3f req-ca8b5346-60d1-486f-b474-de2d8316ca9a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4c0c4bb6-269f-46bc-b460-7d0299277753", "tag": "92164628-0711-4bbe-835d-289c030d699a"}]} {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 06 13:53:21.171496 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [req-eea3c5be-2aa4-4c91-ad44-fdf12b4ebe3f req-ca8b5346-60d1-486f-b474-de2d8316ca9a service nova] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:53:21.172198 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [req-eea3c5be-2aa4-4c91-ad44-fdf12b4ebe3f req-ca8b5346-60d1-486f-b474-de2d8316ca9a service nova] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:53:21.184106 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.compute.server_external_events [req-eea3c5be-2aa4-4c91-ad44-fdf12b4ebe3f req-ca8b5346-60d1-486f-b474-de2d8316ca9a service nova] Creating event network-changed:92164628-0711-4bbe-835d-289c030d699a for instance 4c0c4bb6-269f-46bc-b460-7d0299277753 on hv-cinder-81914 Jul 06 13:53:21.190994 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [req-eea3c5be-2aa4-4c91-ad44-fdf12b4ebe3f req-ca8b5346-60d1-486f-b474-de2d8316ca9a service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047897 Jul 06 13:53:21.191601 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 434/859] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 6 13:53:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 06 13:53:21.292100 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-ba49dc1e-8f1b-49f3-b44e-611a9a6aa109 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d7cacb73c8342579d9f990b0193487c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05df572327d54bd99595974b75898052', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:53:21.302741 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-ba49dc1e-8f1b-49f3-b44e-611a9a6aa109 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] 10.222.0.20 "GET /compute/v2.1/servers/be6603c1-852c-4efc-8442-14b7228cf3d0" status: 200 len: 1362 microversion: 2.1 time: 0.190880 Jul 06 13:53:21.303300 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 426/860] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:53:21 2022] GET /compute/v2.1/servers/be6603c1-852c-4efc-8442-14b7228cf3d0 => generated 1362 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 06 13:53:21.420673 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-bfae097e-a19a-4ff0-9339-b79ace83f3e8 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Calling method '>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:53:21.421406 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-bfae097e-a19a-4ff0-9339-b79ace83f3e8 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] [instance: 4c0c4bb6-269f-46bc-b460-7d0299277753] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:53:21.427821 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-bfae097e-a19a-4ff0-9339-b79ace83f3e8 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:53:21.428277 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-bfae097e-a19a-4ff0-9339-b79ace83f3e8 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:53:21.429129 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-bfae097e-a19a-4ff0-9339-b79ace83f3e8 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:53:21.429571 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-bfae097e-a19a-4ff0-9339-b79ace83f3e8 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:53:21.600324 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-bfae097e-a19a-4ff0-9339-b79ace83f3e8 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c85251638bc64deca16008b696b11ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3edb8d53184b98b7055ffc145f186d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:53:21.609822 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-bfae097e-a19a-4ff0-9339-b79ace83f3e8 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c85251638bc64deca16008b696b11ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3edb8d53184b98b7055ffc145f186d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:53:21.611461 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-bfae097e-a19a-4ff0-9339-b79ace83f3e8 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c85251638bc64deca16008b696b11ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3edb8d53184b98b7055ffc145f186d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:53:21.612575 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-bfae097e-a19a-4ff0-9339-b79ace83f3e8 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] 10.222.0.20 "GET /compute/v2.1/servers/4c0c4bb6-269f-46bc-b460-7d0299277753" status: 200 len: 1407 microversion: 2.20 time: 0.196205 Jul 06 13:53:21.613464 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 435/861] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 6 13:53:21 2022] GET /compute/v2.1/servers/4c0c4bb6-269f-46bc-b460-7d0299277753 => generated 1407 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 06 13:53:22.320057 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-3e0ea168-0a46-4ab8-9dba-8eeb6855e4ec tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:53:22.320668 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-3e0ea168-0a46-4ab8-9dba-8eeb6855e4ec tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] [instance: be6603c1-852c-4efc-8442-14b7228cf3d0] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:53:22.328000 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-3e0ea168-0a46-4ab8-9dba-8eeb6855e4ec tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:53:22.328670 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-3e0ea168-0a46-4ab8-9dba-8eeb6855e4ec tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:53:22.330093 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-3e0ea168-0a46-4ab8-9dba-8eeb6855e4ec tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:53:22.330832 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-3e0ea168-0a46-4ab8-9dba-8eeb6855e4ec tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:53:22.631666 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-ab6797d7-2e35-441f-9663-ba070155acb7 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Calling method '>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:53:22.632291 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-ab6797d7-2e35-441f-9663-ba070155acb7 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] [instance: 4c0c4bb6-269f-46bc-b460-7d0299277753] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:53:22.640080 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-ab6797d7-2e35-441f-9663-ba070155acb7 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:53:22.640877 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-ab6797d7-2e35-441f-9663-ba070155acb7 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:53:22.641701 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-ab6797d7-2e35-441f-9663-ba070155acb7 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:53:22.642151 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-ab6797d7-2e35-441f-9663-ba070155acb7 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:53:22.722836 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-3e0ea168-0a46-4ab8-9dba-8eeb6855e4ec tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d7cacb73c8342579d9f990b0193487c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05df572327d54bd99595974b75898052', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:53:22.738240 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-3e0ea168-0a46-4ab8-9dba-8eeb6855e4ec tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] 10.222.0.20 "GET /compute/v2.1/servers/be6603c1-852c-4efc-8442-14b7228cf3d0" status: 200 len: 1362 microversion: 2.1 time: 0.421512 Jul 06 13:53:22.749426 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 427/862] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:53:22 2022] GET /compute/v2.1/servers/be6603c1-852c-4efc-8442-14b7228cf3d0 => generated 1362 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:53:22.755125 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-d62f3714-e55c-4dcf-a481-2e236c7c29af tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:53:22.755853 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-d62f3714-e55c-4dcf-a481-2e236c7c29af tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] [instance: d82144a2-d572-4e58-852c-7553331127cc] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:53:22.762333 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-d62f3714-e55c-4dcf-a481-2e236c7c29af tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:53:22.763027 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-d62f3714-e55c-4dcf-a481-2e236c7c29af tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:53:22.763994 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-d62f3714-e55c-4dcf-a481-2e236c7c29af tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:53:22.764588 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-d62f3714-e55c-4dcf-a481-2e236c7c29af tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:53:22.795103 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-d62f3714-e55c-4dcf-a481-2e236c7c29af tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] 10.222.0.20 "GET /compute/v2.1/servers/d82144a2-d572-4e58-852c-7553331127cc/ips" status: 200 len: 151 microversion: 2.1 time: 0.044323 Jul 06 13:53:22.796557 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 428/863] 10.222.0.20 () {58 vars in 1247 bytes} [Wed Jul 6 13:53:22 2022] GET /compute/v2.1/servers/d82144a2-d572-4e58-852c-7553331127cc/ips => generated 151 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 06 13:53:22.882574 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-ab6797d7-2e35-441f-9663-ba070155acb7 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c85251638bc64deca16008b696b11ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3edb8d53184b98b7055ffc145f186d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:53:22.892051 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-ab6797d7-2e35-441f-9663-ba070155acb7 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c85251638bc64deca16008b696b11ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3edb8d53184b98b7055ffc145f186d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:53:22.895253 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-ab6797d7-2e35-441f-9663-ba070155acb7 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c85251638bc64deca16008b696b11ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3edb8d53184b98b7055ffc145f186d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:53:22.896952 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-ab6797d7-2e35-441f-9663-ba070155acb7 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] 10.222.0.20 "GET /compute/v2.1/servers/4c0c4bb6-269f-46bc-b460-7d0299277753" status: 200 len: 1407 microversion: 2.20 time: 0.269210 Jul 06 13:53:22.898712 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 436/864] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 6 13:53:22 2022] GET /compute/v2.1/servers/4c0c4bb6-269f-46bc-b460-7d0299277753 => generated 1407 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 06 13:53:23.756039 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-92b84a42-ddc3-4206-af78-34756841dc57 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:53:23.757241 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-92b84a42-ddc3-4206-af78-34756841dc57 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] [instance: be6603c1-852c-4efc-8442-14b7228cf3d0] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:53:23.763656 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-92b84a42-ddc3-4206-af78-34756841dc57 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:53:23.764097 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-92b84a42-ddc3-4206-af78-34756841dc57 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:53:23.764860 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-92b84a42-ddc3-4206-af78-34756841dc57 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:53:23.765315 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-92b84a42-ddc3-4206-af78-34756841dc57 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:53:23.915930 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG dbcounter [-] [124367] Writing DB stats nova_cell0:SELECT=6 {{(pid=124367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:53:23.916172 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-c058454e-a500-488e-b320-16f2fc973c7d tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Calling method '>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:53:23.916619 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-c058454e-a500-488e-b320-16f2fc973c7d tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] [instance: 4c0c4bb6-269f-46bc-b460-7d0299277753] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:53:23.923349 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-c058454e-a500-488e-b320-16f2fc973c7d tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:53:23.924832 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-c058454e-a500-488e-b320-16f2fc973c7d tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:53:23.930855 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-c058454e-a500-488e-b320-16f2fc973c7d tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:53:23.931310 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-c058454e-a500-488e-b320-16f2fc973c7d tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:53:24.064810 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-c058454e-a500-488e-b320-16f2fc973c7d tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c85251638bc64deca16008b696b11ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3edb8d53184b98b7055ffc145f186d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:53:24.074198 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-c058454e-a500-488e-b320-16f2fc973c7d tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c85251638bc64deca16008b696b11ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3edb8d53184b98b7055ffc145f186d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:53:24.075697 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-c058454e-a500-488e-b320-16f2fc973c7d tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c85251638bc64deca16008b696b11ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3edb8d53184b98b7055ffc145f186d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:53:24.076810 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-c058454e-a500-488e-b320-16f2fc973c7d tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] 10.222.0.20 "GET /compute/v2.1/servers/4c0c4bb6-269f-46bc-b460-7d0299277753" status: 200 len: 1407 microversion: 2.20 time: 0.164929 Jul 06 13:53:24.077718 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 437/865] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 6 13:53:23 2022] GET /compute/v2.1/servers/4c0c4bb6-269f-46bc-b460-7d0299277753 => generated 1407 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 06 13:53:24.124877 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-92b84a42-ddc3-4206-af78-34756841dc57 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d7cacb73c8342579d9f990b0193487c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05df572327d54bd99595974b75898052', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:53:24.133172 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-92b84a42-ddc3-4206-af78-34756841dc57 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] 10.222.0.20 "GET /compute/v2.1/servers/be6603c1-852c-4efc-8442-14b7228cf3d0" status: 200 len: 1362 microversion: 2.1 time: 0.380775 Jul 06 13:53:24.133885 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 429/866] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:53:23 2022] GET /compute/v2.1/servers/be6603c1-852c-4efc-8442-14b7228cf3d0 => generated 1362 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:53:24.294685 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-8be7c52f-1dbc-4791-9cc9-54aae8498825 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "459c3d2b-06e0-47b9-8753-56aa54431719"}} {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 06 13:53:24.295764 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-8be7c52f-1dbc-4791-9cc9-54aae8498825 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] [instance: d82144a2-d572-4e58-852c-7553331127cc] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:53:24.302135 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-8be7c52f-1dbc-4791-9cc9-54aae8498825 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:53:24.302597 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-8be7c52f-1dbc-4791-9cc9-54aae8498825 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:53:24.303386 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-8be7c52f-1dbc-4791-9cc9-54aae8498825 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:53:24.304483 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-8be7c52f-1dbc-4791-9cc9-54aae8498825 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:53:25.016155 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG dbcounter [-] [124368] Writing DB stats nova_cell0:SELECT=4 {{(pid=124368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:53:25.097860 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-7255dccd-3383-4033-882d-90094b28c3bb tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:53:25.098488 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-7255dccd-3383-4033-882d-90094b28c3bb tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] [instance: 4c0c4bb6-269f-46bc-b460-7d0299277753] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:53:25.105430 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-7255dccd-3383-4033-882d-90094b28c3bb tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:53:25.105832 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-7255dccd-3383-4033-882d-90094b28c3bb tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:53:25.106784 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-7255dccd-3383-4033-882d-90094b28c3bb tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:53:25.107376 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-7255dccd-3383-4033-882d-90094b28c3bb tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:53:25.340253 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-7255dccd-3383-4033-882d-90094b28c3bb tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c85251638bc64deca16008b696b11ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3edb8d53184b98b7055ffc145f186d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:53:25.349751 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-7255dccd-3383-4033-882d-90094b28c3bb tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c85251638bc64deca16008b696b11ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3edb8d53184b98b7055ffc145f186d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:53:25.351280 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-7255dccd-3383-4033-882d-90094b28c3bb tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c85251638bc64deca16008b696b11ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3edb8d53184b98b7055ffc145f186d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:53:25.352487 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-7255dccd-3383-4033-882d-90094b28c3bb tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] 10.222.0.20 "GET /compute/v2.1/servers/4c0c4bb6-269f-46bc-b460-7d0299277753" status: 200 len: 1407 microversion: 2.20 time: 0.260884 Jul 06 13:53:25.363253 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 430/867] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 6 13:53:25 2022] GET /compute/v2.1/servers/4c0c4bb6-269f-46bc-b460-7d0299277753 => generated 1407 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 06 13:53:25.363253 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-f0a00508-82fb-4925-b4d9-76d692cd371b tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:53:25.363253 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-f0a00508-82fb-4925-b4d9-76d692cd371b tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] [instance: be6603c1-852c-4efc-8442-14b7228cf3d0] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:53:25.367046 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-f0a00508-82fb-4925-b4d9-76d692cd371b tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:53:25.367506 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-f0a00508-82fb-4925-b4d9-76d692cd371b tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:53:25.368285 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-f0a00508-82fb-4925-b4d9-76d692cd371b tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:53:25.368723 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-f0a00508-82fb-4925-b4d9-76d692cd371b tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:53:25.486979 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG dbcounter [-] [124368] Writing DB stats nova_cell0:SELECT=18 {{(pid=124368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:53:25.590988 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-f0a00508-82fb-4925-b4d9-76d692cd371b tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d7cacb73c8342579d9f990b0193487c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05df572327d54bd99595974b75898052', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:53:25.599444 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-f0a00508-82fb-4925-b4d9-76d692cd371b tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] 10.222.0.20 "GET /compute/v2.1/servers/be6603c1-852c-4efc-8442-14b7228cf3d0" status: 200 len: 1362 microversion: 2.1 time: 0.243736 Jul 06 13:53:25.605659 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 431/868] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:53:25 2022] GET /compute/v2.1/servers/be6603c1-852c-4efc-8442-14b7228cf3d0 => generated 1362 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:53:26.371584 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-8d7d3b0e-b43d-4d38-bbf1-df4e44ee8301 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:53:26.372311 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-8d7d3b0e-b43d-4d38-bbf1-df4e44ee8301 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] [instance: 4c0c4bb6-269f-46bc-b460-7d0299277753] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:53:26.379116 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-8d7d3b0e-b43d-4d38-bbf1-df4e44ee8301 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:53:26.379775 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-8d7d3b0e-b43d-4d38-bbf1-df4e44ee8301 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:53:26.380711 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-8d7d3b0e-b43d-4d38-bbf1-df4e44ee8301 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:53:26.381313 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-8d7d3b0e-b43d-4d38-bbf1-df4e44ee8301 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:53:26.708380 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-8d7d3b0e-b43d-4d38-bbf1-df4e44ee8301 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c85251638bc64deca16008b696b11ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3edb8d53184b98b7055ffc145f186d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:53:26.719632 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-8d7d3b0e-b43d-4d38-bbf1-df4e44ee8301 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c85251638bc64deca16008b696b11ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3edb8d53184b98b7055ffc145f186d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:53:26.721214 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-8d7d3b0e-b43d-4d38-bbf1-df4e44ee8301 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c85251638bc64deca16008b696b11ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3edb8d53184b98b7055ffc145f186d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:53:26.722559 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-8d7d3b0e-b43d-4d38-bbf1-df4e44ee8301 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] 10.222.0.20 "GET /compute/v2.1/servers/4c0c4bb6-269f-46bc-b460-7d0299277753" status: 200 len: 1407 microversion: 2.20 time: 0.355099 Jul 06 13:53:26.730572 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 432/869] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 6 13:53:26 2022] GET /compute/v2.1/servers/4c0c4bb6-269f-46bc-b460-7d0299277753 => generated 1407 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 06 13:53:26.741477 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-ca1b1cfc-c3b7-4bca-ac13-7271e917eb82 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:53:26.742319 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-ca1b1cfc-c3b7-4bca-ac13-7271e917eb82 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] [instance: be6603c1-852c-4efc-8442-14b7228cf3d0] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:53:26.758458 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-ca1b1cfc-c3b7-4bca-ac13-7271e917eb82 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:53:26.758923 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-ca1b1cfc-c3b7-4bca-ac13-7271e917eb82 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:53:26.762911 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-ca1b1cfc-c3b7-4bca-ac13-7271e917eb82 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:53:26.763532 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-ca1b1cfc-c3b7-4bca-ac13-7271e917eb82 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:53:26.829312 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-8be7c52f-1dbc-4791-9cc9-54aae8498825 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] 10.222.0.20 "POST /compute/v2.1/servers/d82144a2-d572-4e58-852c-7553331127cc/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.538219 Jul 06 13:53:26.829926 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 438/870] 10.222.0.20 () {60 vars in 1322 bytes} [Wed Jul 6 13:53:24 2022] POST /compute/v2.1/servers/d82144a2-d572-4e58-852c-7553331127cc/os-volume_attachments => generated 194 bytes in 2540 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 06 13:53:26.837234 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [req-3d8504c2-fc54-4fc8-bb79-1ca4a27bad02 req-b764aa88-bb46-4339-8bf1-b0349bc911fa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "be6603c1-852c-4efc-8442-14b7228cf3d0", "name": "network-vif-plugged", "status": "completed", "tag": "73906c58-8548-4ecf-a678-d849a4bac0f7"}]} {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 06 13:53:26.846117 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [req-3d8504c2-fc54-4fc8-bb79-1ca4a27bad02 req-b764aa88-bb46-4339-8bf1-b0349bc911fa service nova] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:53:26.846499 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [req-3d8504c2-fc54-4fc8-bb79-1ca4a27bad02 req-b764aa88-bb46-4339-8bf1-b0349bc911fa service nova] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:53:26.859016 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.compute.server_external_events [req-3d8504c2-fc54-4fc8-bb79-1ca4a27bad02 req-b764aa88-bb46-4339-8bf1-b0349bc911fa service nova] Creating event network-vif-plugged:73906c58-8548-4ecf-a678-d849a4bac0f7 for instance be6603c1-852c-4efc-8442-14b7228cf3d0 on hv-cinder-81914 Jul 06 13:53:26.864319 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [req-3d8504c2-fc54-4fc8-bb79-1ca4a27bad02 req-b764aa88-bb46-4339-8bf1-b0349bc911fa service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032813 Jul 06 13:53:26.865126 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 439/871] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 6 13:53:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 06 13:53:27.063308 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-ca1b1cfc-c3b7-4bca-ac13-7271e917eb82 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d7cacb73c8342579d9f990b0193487c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05df572327d54bd99595974b75898052', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:53:27.073213 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-ca1b1cfc-c3b7-4bca-ac13-7271e917eb82 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] 10.222.0.20 "GET /compute/v2.1/servers/be6603c1-852c-4efc-8442-14b7228cf3d0" status: 200 len: 1362 microversion: 2.1 time: 0.341393 Jul 06 13:53:27.078495 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 433/872] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:53:26 2022] GET /compute/v2.1/servers/be6603c1-852c-4efc-8442-14b7228cf3d0 => generated 1362 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:53:27.743364 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-36e1ca52-2bea-4bfb-827d-ae1da7d83eba tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Calling method '>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:53:27.744079 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-36e1ca52-2bea-4bfb-827d-ae1da7d83eba tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] [instance: 4c0c4bb6-269f-46bc-b460-7d0299277753] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:53:27.750694 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-36e1ca52-2bea-4bfb-827d-ae1da7d83eba tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:53:27.751064 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-36e1ca52-2bea-4bfb-827d-ae1da7d83eba tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:53:27.751857 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-36e1ca52-2bea-4bfb-827d-ae1da7d83eba tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:53:27.752292 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-36e1ca52-2bea-4bfb-827d-ae1da7d83eba tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:53:27.891461 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-36e1ca52-2bea-4bfb-827d-ae1da7d83eba tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c85251638bc64deca16008b696b11ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3edb8d53184b98b7055ffc145f186d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:53:27.902260 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-36e1ca52-2bea-4bfb-827d-ae1da7d83eba tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c85251638bc64deca16008b696b11ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3edb8d53184b98b7055ffc145f186d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:53:27.903867 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-36e1ca52-2bea-4bfb-827d-ae1da7d83eba tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c85251638bc64deca16008b696b11ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3edb8d53184b98b7055ffc145f186d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:53:27.905037 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-36e1ca52-2bea-4bfb-827d-ae1da7d83eba tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] 10.222.0.20 "GET /compute/v2.1/servers/4c0c4bb6-269f-46bc-b460-7d0299277753" status: 200 len: 1407 microversion: 2.20 time: 0.167021 Jul 06 13:53:27.909314 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 440/873] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 6 13:53:27 2022] GET /compute/v2.1/servers/4c0c4bb6-269f-46bc-b460-7d0299277753 => generated 1407 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 06 13:53:28.090956 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-0492d28f-7881-489c-8ebb-6b84a2f8054e tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:53:28.091463 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-0492d28f-7881-489c-8ebb-6b84a2f8054e tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] [instance: be6603c1-852c-4efc-8442-14b7228cf3d0] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:53:28.097906 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-0492d28f-7881-489c-8ebb-6b84a2f8054e tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:53:28.098347 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-0492d28f-7881-489c-8ebb-6b84a2f8054e tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:53:28.099107 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-0492d28f-7881-489c-8ebb-6b84a2f8054e tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:53:28.099544 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-0492d28f-7881-489c-8ebb-6b84a2f8054e tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:53:28.241729 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-0492d28f-7881-489c-8ebb-6b84a2f8054e tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d7cacb73c8342579d9f990b0193487c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05df572327d54bd99595974b75898052', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:53:28.249076 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-0492d28f-7881-489c-8ebb-6b84a2f8054e tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] 10.222.0.20 "GET /compute/v2.1/servers/be6603c1-852c-4efc-8442-14b7228cf3d0" status: 200 len: 1362 microversion: 2.1 time: 0.162115 Jul 06 13:53:28.249647 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 434/874] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:53:28 2022] GET /compute/v2.1/servers/be6603c1-852c-4efc-8442-14b7228cf3d0 => generated 1362 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:53:28.924286 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-3418107f-2ad4-43f0-9fba-295f1545e3c0 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Calling method '>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:53:28.924848 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-3418107f-2ad4-43f0-9fba-295f1545e3c0 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] [instance: 4c0c4bb6-269f-46bc-b460-7d0299277753] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:53:28.931726 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-3418107f-2ad4-43f0-9fba-295f1545e3c0 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:53:28.932176 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-3418107f-2ad4-43f0-9fba-295f1545e3c0 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:53:28.932955 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-3418107f-2ad4-43f0-9fba-295f1545e3c0 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:53:28.933416 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-3418107f-2ad4-43f0-9fba-295f1545e3c0 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:53:29.102540 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-3418107f-2ad4-43f0-9fba-295f1545e3c0 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c85251638bc64deca16008b696b11ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3edb8d53184b98b7055ffc145f186d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:53:29.110954 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-3418107f-2ad4-43f0-9fba-295f1545e3c0 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c85251638bc64deca16008b696b11ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3edb8d53184b98b7055ffc145f186d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:53:29.112472 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-3418107f-2ad4-43f0-9fba-295f1545e3c0 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c85251638bc64deca16008b696b11ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3edb8d53184b98b7055ffc145f186d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:53:29.113916 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-3418107f-2ad4-43f0-9fba-295f1545e3c0 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] 10.222.0.20 "GET /compute/v2.1/servers/4c0c4bb6-269f-46bc-b460-7d0299277753" status: 200 len: 1407 microversion: 2.20 time: 0.194046 Jul 06 13:53:29.114467 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 441/875] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 6 13:53:28 2022] GET /compute/v2.1/servers/4c0c4bb6-269f-46bc-b460-7d0299277753 => generated 1407 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 06 13:53:29.265864 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-23be8bfe-52e9-4bb2-967b-5f6a2499de23 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:53:29.266598 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-23be8bfe-52e9-4bb2-967b-5f6a2499de23 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] [instance: be6603c1-852c-4efc-8442-14b7228cf3d0] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:53:29.268513 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG dbcounter [-] [124367] Writing DB stats nova_api:SELECT=78,nova_api:UPDATE=2,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=124367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:53:29.274881 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-23be8bfe-52e9-4bb2-967b-5f6a2499de23 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:53:29.275342 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-23be8bfe-52e9-4bb2-967b-5f6a2499de23 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:53:29.276099 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-23be8bfe-52e9-4bb2-967b-5f6a2499de23 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:53:29.276530 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-23be8bfe-52e9-4bb2-967b-5f6a2499de23 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:53:29.414296 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-23be8bfe-52e9-4bb2-967b-5f6a2499de23 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d7cacb73c8342579d9f990b0193487c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05df572327d54bd99595974b75898052', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:53:29.421679 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-23be8bfe-52e9-4bb2-967b-5f6a2499de23 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] 10.222.0.20 "GET /compute/v2.1/servers/be6603c1-852c-4efc-8442-14b7228cf3d0" status: 200 len: 1548 microversion: 2.1 time: 0.159803 Jul 06 13:53:29.422242 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 435/876] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:53:29 2022] GET /compute/v2.1/servers/be6603c1-852c-4efc-8442-14b7228cf3d0 => generated 1548 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 06 13:53:29.443271 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-92709da9-9f16-40ce-aea8-ec6ed723676b tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Calling method '>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:53:29.443684 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-92709da9-9f16-40ce-aea8-ec6ed723676b tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] [instance: be6603c1-852c-4efc-8442-14b7228cf3d0] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:53:29.446227 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG dbcounter [-] [124368] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=7,nova_api:DELETE=1 {{(pid=124368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:53:29.452315 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-92709da9-9f16-40ce-aea8-ec6ed723676b tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:53:29.452766 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-92709da9-9f16-40ce-aea8-ec6ed723676b tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:53:29.453565 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-92709da9-9f16-40ce-aea8-ec6ed723676b tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:53:29.454000 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-92709da9-9f16-40ce-aea8-ec6ed723676b tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:53:29.537022 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-92709da9-9f16-40ce-aea8-ec6ed723676b tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] 10.222.0.20 "GET /compute/v2.1/servers/be6603c1-852c-4efc-8442-14b7228cf3d0/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.097535 Jul 06 13:53:29.537670 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 442/877] 10.222.0.20 () {58 vars in 1274 bytes} [Wed Jul 6 13:53:29 2022] GET /compute/v2.1/servers/be6603c1-852c-4efc-8442-14b7228cf3d0/os-interface => generated 285 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 06 13:53:30.132399 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-d8f91489-dc18-4a30-8853-6d0715828451 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:53:30.133119 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-d8f91489-dc18-4a30-8853-6d0715828451 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] [instance: 4c0c4bb6-269f-46bc-b460-7d0299277753] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:53:30.139406 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-d8f91489-dc18-4a30-8853-6d0715828451 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:53:30.139984 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-d8f91489-dc18-4a30-8853-6d0715828451 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:53:30.140758 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-d8f91489-dc18-4a30-8853-6d0715828451 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:53:30.141239 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-d8f91489-dc18-4a30-8853-6d0715828451 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:53:30.301503 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-d8f91489-dc18-4a30-8853-6d0715828451 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c85251638bc64deca16008b696b11ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3edb8d53184b98b7055ffc145f186d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:53:30.312660 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-d8f91489-dc18-4a30-8853-6d0715828451 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c85251638bc64deca16008b696b11ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3edb8d53184b98b7055ffc145f186d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:53:30.314381 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-d8f91489-dc18-4a30-8853-6d0715828451 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c85251638bc64deca16008b696b11ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3edb8d53184b98b7055ffc145f186d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:53:30.315627 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-d8f91489-dc18-4a30-8853-6d0715828451 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] 10.222.0.20 "GET /compute/v2.1/servers/4c0c4bb6-269f-46bc-b460-7d0299277753" status: 200 len: 1407 microversion: 2.20 time: 0.187987 Jul 06 13:53:30.316262 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 436/878] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 6 13:53:30 2022] GET /compute/v2.1/servers/4c0c4bb6-269f-46bc-b460-7d0299277753 => generated 1407 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 06 13:53:30.706433 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [req-2cbba713-189d-43d5-b46c-d28aa12292ab req-ec845288-76cb-46b1-9700-773e434c6d28 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "be6603c1-852c-4efc-8442-14b7228cf3d0", "tag": "73906c58-8548-4ecf-a678-d849a4bac0f7"}]} {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 06 13:53:30.714864 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [req-2cbba713-189d-43d5-b46c-d28aa12292ab req-ec845288-76cb-46b1-9700-773e434c6d28 service nova] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:53:30.715414 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [req-2cbba713-189d-43d5-b46c-d28aa12292ab req-ec845288-76cb-46b1-9700-773e434c6d28 service nova] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:53:30.727260 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.compute.server_external_events [req-2cbba713-189d-43d5-b46c-d28aa12292ab req-ec845288-76cb-46b1-9700-773e434c6d28 service nova] Creating event network-changed:73906c58-8548-4ecf-a678-d849a4bac0f7 for instance be6603c1-852c-4efc-8442-14b7228cf3d0 on hv-cinder-81914 Jul 06 13:53:30.740612 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [req-2cbba713-189d-43d5-b46c-d28aa12292ab req-ec845288-76cb-46b1-9700-773e434c6d28 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038174 Jul 06 13:53:30.741900 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 443/879] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 6 13:53:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 06 13:53:30.781703 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [req-f190cf71-04a5-43c1-9906-d09fe01a9d95 req-bc50940e-78f9-47c6-a176-3fdd63912d3d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4c0c4bb6-269f-46bc-b460-7d0299277753", "name": "network-vif-plugged", "status": "completed", "tag": "92164628-0711-4bbe-835d-289c030d699a"}]} {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 06 13:53:30.791488 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [req-f190cf71-04a5-43c1-9906-d09fe01a9d95 req-bc50940e-78f9-47c6-a176-3fdd63912d3d service nova] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:53:30.792070 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [req-f190cf71-04a5-43c1-9906-d09fe01a9d95 req-bc50940e-78f9-47c6-a176-3fdd63912d3d service nova] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:53:30.807960 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.compute.server_external_events [req-f190cf71-04a5-43c1-9906-d09fe01a9d95 req-bc50940e-78f9-47c6-a176-3fdd63912d3d service nova] Creating event network-vif-plugged:92164628-0711-4bbe-835d-289c030d699a for instance 4c0c4bb6-269f-46bc-b460-7d0299277753 on hv-cinder-81914 Jul 06 13:53:30.815619 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [req-f190cf71-04a5-43c1-9906-d09fe01a9d95 req-bc50940e-78f9-47c6-a176-3fdd63912d3d service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039360 Jul 06 13:53:30.816790 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 437/880] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 6 13:53:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 06 13:53:31.265353 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-3c78a501-07a3-451f-9fe8-4681cc530ad9 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "459c3d2b-06e0-47b9-8753-56aa54431719"}} {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 06 13:53:31.266513 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-3c78a501-07a3-451f-9fe8-4681cc530ad9 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] [instance: d82144a2-d572-4e58-852c-7553331127cc] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:53:31.273516 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-3c78a501-07a3-451f-9fe8-4681cc530ad9 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:53:31.273975 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-3c78a501-07a3-451f-9fe8-4681cc530ad9 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:53:31.274767 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-3c78a501-07a3-451f-9fe8-4681cc530ad9 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:53:31.275216 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-3c78a501-07a3-451f-9fe8-4681cc530ad9 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:53:31.336385 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-4c12f976-736b-40b8-8325-8b0eba2738be tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:53:31.337123 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-4c12f976-736b-40b8-8325-8b0eba2738be tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] [instance: 4c0c4bb6-269f-46bc-b460-7d0299277753] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:53:31.344500 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-4c12f976-736b-40b8-8325-8b0eba2738be tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:53:31.345234 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-4c12f976-736b-40b8-8325-8b0eba2738be tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:53:31.346042 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-4c12f976-736b-40b8-8325-8b0eba2738be tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:53:31.346635 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-4c12f976-736b-40b8-8325-8b0eba2738be tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:53:31.358169 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.wsgi [None req-3c78a501-07a3-451f-9fe8-4681cc530ad9 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] HTTP exception thrown: Invalid volume: volume 459c3d2b-06e0-47b9-8753-56aa54431719 is already attached to instances: d82144a2-d572-4e58-852c-7553331127cc Jul 06 13:53:31.360063 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-3c78a501-07a3-451f-9fe8-4681cc530ad9 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Request method failure captured: Jul 06 13:53:31.360063 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: request: POST /compute/v2.1/servers/d82144a2-d572-4e58-852c-7553331127cc/os-volume_attachments HTTP/1.1 Jul 06 13:53:31.360063 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: Accept: application/json Jul 06 13:53:31.360063 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: Accept-Encoding: identity Jul 06 13:53:31.360063 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: Connection: close Jul 06 13:53:31.360063 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: Content-Length: 74 Jul 06 13:53:31.360063 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: Content-Type: application/json Jul 06 13:53:31.360063 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: Host: 10.222.0.20 Jul 06 13:53:31.360063 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: Openstack-System-Scope: None Jul 06 13:53:31.360063 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: User-Agent: python-urllib3/1.26.9 Jul 06 13:53:31.360063 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Auth-Token: gAAAAABixZH4I4dgmb0Q3wbjrFWrBMh6OmJtrlg6lZ88SjHzAtW3fxMyo3s0_pJVvHdnPyxERhBQTWBNewTHA0QeJRzzLbnn4Csb1lAz3C9NjKcuSHUaArYBZ7P3u01dtbqramyieBExBREkl13A9tBRRuVoPmOumXVJ74UVBAMWWamo1ttSwGg Jul 06 13:53:31.360063 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Domain-Id: None Jul 06 13:53:31.360063 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Domain-Name: None Jul 06 13:53:31.360063 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Identity-Status: Confirmed Jul 06 13:53:31.360063 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Is-Admin-Project: True Jul 06 13:53:31.360063 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Project-Domain-Id: default Jul 06 13:53:31.360063 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Project-Domain-Name: Default Jul 06 13:53:31.360063 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Project-Id: bd85f2a57a0847debf5aaf81aab7a638 Jul 06 13:53:31.360063 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Project-Name: tempest-AttachVolumeNegativeTest-1016924223 Jul 06 13:53:31.360063 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Role: reader,member Jul 06 13:53:31.360063 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Roles: reader,member Jul 06 13:53:31.361494 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_bd85f2a57a0847debf5aaf81aab7a638"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/bd85f2a57a0847debf5aaf81aab7a638"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/bd85f2a57a0847debf5aaf81aab7a638"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/bd85f2a57a0847debf5aaf81aab7a638"}]}] Jul 06 13:53:31.361494 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Tenant: tempest-AttachVolumeNegativeTest-1016924223 Jul 06 13:53:31.361494 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Tenant-Id: bd85f2a57a0847debf5aaf81aab7a638 Jul 06 13:53:31.361494 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1016924223 Jul 06 13:53:31.361494 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-User: tempest-AttachVolumeNegativeTest-1016924223-project Jul 06 13:53:31.361494 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-User-Domain-Id: default Jul 06 13:53:31.361494 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-User-Domain-Name: Default Jul 06 13:53:31.361494 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-User-Id: 7b572a8f465048558fc969b85b2aec5b Jul 06 13:53:31.361494 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-User-Name: tempest-AttachVolumeNegativeTest-1016924223-project Jul 06 13:53:31.361494 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: Jul 06 13:53:31.361494 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: {"volumeAttachment": {"volumeId": "459c3d2b-06e0-47b9-8753-56aa54431719"}} Jul 06 13:53:31.361494 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: method: > Jul 06 13:53:31.362232 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: exception: Invalid volume: volume 459c3d2b-06e0-47b9-8753-56aa54431719 is already attached to instances: d82144a2-d572-4e58-852c-7553331127cc Jul 06 13:53:31.362232 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: action_args: {'server_id': 'd82144a2-d572-4e58-852c-7553331127cc', 'body': {'volumeAttachment': {'volumeId': '459c3d2b-06e0-47b9-8753-56aa54431719'}}} Jul 06 13:53:31.362232 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 06 13:53:31.362232 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 06 13:53:31.362232 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 06 13:53:31.362232 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 06 13:53:31.362232 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 06 13:53:31.362232 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 06 13:53:31.362232 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 06 13:53:31.362232 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 06 13:53:31.362232 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jul 06 13:53:31.362232 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jul 06 13:53:31.362232 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jul 06 13:53:31.362232 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jul 06 13:53:31.362232 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 459c3d2b-06e0-47b9-8753-56aa54431719 is already attached to instances: d82144a2-d572-4e58-852c-7553331127cc Jul 06 13:53:31.362232 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi Jul 06 13:53:31.362232 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 06 13:53:31.362232 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi Jul 06 13:53:31.362232 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 06 13:53:31.363390 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 06 13:53:31.363390 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 06 13:53:31.363390 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 06 13:53:31.363390 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 06 13:53:31.363390 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 06 13:53:31.363390 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 06 13:53:31.363390 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 06 13:53:31.363390 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 06 13:53:31.363390 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 06 13:53:31.363390 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 06 13:53:31.363390 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 06 13:53:31.363390 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 06 13:53:31.363390 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jul 06 13:53:31.363390 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 06 13:53:31.363390 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 459c3d2b-06e0-47b9-8753-56aa54431719 is already attached to instances: d82144a2-d572-4e58-852c-7553331127cc Jul 06 13:53:31.363390 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi Jul 06 13:53:31.363390 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 06 13:53:31.363390 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi Jul 06 13:53:31.363390 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 06 13:53:31.363390 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 06 13:53:31.364596 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 06 13:53:31.364596 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 06 13:53:31.364596 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 06 13:53:31.364596 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 459c3d2b-06e0-47b9-8753-56aa54431719 is already attached to instances: d82144a2-d572-4e58-852c-7553331127cc Jul 06 13:53:31.364596 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi Jul 06 13:53:31.364596 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-3c78a501-07a3-451f-9fe8-4681cc530ad9 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Returning 400 to user: Invalid volume: volume 459c3d2b-06e0-47b9-8753-56aa54431719 is already attached to instances: d82144a2-d572-4e58-852c-7553331127cc {{(pid=124368) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 06 13:53:31.364596 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-3c78a501-07a3-451f-9fe8-4681cc530ad9 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] 10.222.0.20 "POST /compute/v2.1/servers/d82144a2-d572-4e58-852c-7553331127cc/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.100743 Jul 06 13:53:31.368062 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 444/881] 10.222.0.20 () {60 vars in 1322 bytes} [Wed Jul 6 13:53:31 2022] POST /compute/v2.1/servers/d82144a2-d572-4e58-852c-7553331127cc/os-volume_attachments => generated 174 bytes in 105 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 06 13:53:31.427158 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-8fac5c4b-cd9c-4576-861f-74bc9110fdc3 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Calling method '>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:53:31.427669 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-8fac5c4b-cd9c-4576-861f-74bc9110fdc3 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] [instance: d82144a2-d572-4e58-852c-7553331127cc] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:53:31.433827 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-8fac5c4b-cd9c-4576-861f-74bc9110fdc3 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:53:31.434899 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-8fac5c4b-cd9c-4576-861f-74bc9110fdc3 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:53:31.435703 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-8fac5c4b-cd9c-4576-861f-74bc9110fdc3 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:53:31.436483 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-8fac5c4b-cd9c-4576-861f-74bc9110fdc3 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:53:31.490869 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-4c12f976-736b-40b8-8325-8b0eba2738be tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c85251638bc64deca16008b696b11ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3edb8d53184b98b7055ffc145f186d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:53:31.500087 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-4c12f976-736b-40b8-8325-8b0eba2738be tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c85251638bc64deca16008b696b11ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3edb8d53184b98b7055ffc145f186d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:53:31.501869 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-4c12f976-736b-40b8-8325-8b0eba2738be tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c85251638bc64deca16008b696b11ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3edb8d53184b98b7055ffc145f186d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:53:31.503205 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-4c12f976-736b-40b8-8325-8b0eba2738be tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] 10.222.0.20 "GET /compute/v2.1/servers/4c0c4bb6-269f-46bc-b460-7d0299277753" status: 200 len: 1407 microversion: 2.20 time: 0.172540 Jul 06 13:53:31.504080 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 438/882] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 6 13:53:31 2022] GET /compute/v2.1/servers/4c0c4bb6-269f-46bc-b460-7d0299277753 => generated 1407 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 06 13:53:31.521870 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG dbcounter [-] [124368] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:53:31.526478 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.objects.instance [None req-8fac5c4b-cd9c-4576-861f-74bc9110fdc3 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lazy-loading 'services' on Instance uuid d82144a2-d572-4e58-852c-7553331127cc {{(pid=124368) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 06 13:53:31.598903 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-8fac5c4b-cd9c-4576-861f-74bc9110fdc3 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] 10.222.0.20 "DELETE /compute/v2.1/servers/d82144a2-d572-4e58-852c-7553331127cc/os-volume_attachments/459c3d2b-06e0-47b9-8753-56aa54431719" status: 202 len: 0 microversion: 2.1 time: 0.175774 Jul 06 13:53:31.599450 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 445/883] 10.222.0.20 () {58 vars in 1415 bytes} [Wed Jul 6 13:53:31 2022] DELETE /compute/v2.1/servers/d82144a2-d572-4e58-852c-7553331127cc/os-volume_attachments/459c3d2b-06e0-47b9-8753-56aa54431719 => generated 0 bytes in 177 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 06 13:53:31.607968 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-236c6ba2-7fe4-4763-87ba-c87ec07ad998 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:53:31.608930 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-236c6ba2-7fe4-4763-87ba-c87ec07ad998 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] [instance: d82144a2-d572-4e58-852c-7553331127cc] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:53:31.615108 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-236c6ba2-7fe4-4763-87ba-c87ec07ad998 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:53:31.615457 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-236c6ba2-7fe4-4763-87ba-c87ec07ad998 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:53:31.617380 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-236c6ba2-7fe4-4763-87ba-c87ec07ad998 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:53:31.617815 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-236c6ba2-7fe4-4763-87ba-c87ec07ad998 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:53:31.649362 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-236c6ba2-7fe4-4763-87ba-c87ec07ad998 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] 10.222.0.20 "GET /compute/v2.1/servers/d82144a2-d572-4e58-852c-7553331127cc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045190 Jul 06 13:53:31.649940 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 439/884] 10.222.0.20 () {58 vars in 1301 bytes} [Wed Jul 6 13:53:31 2022] GET /compute/v2.1/servers/d82144a2-d572-4e58-852c-7553331127cc/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 06 13:53:32.524877 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-ee644e2e-cf6d-4023-a03d-095e09ce2ccc tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Calling method '>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:53:32.525621 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-ee644e2e-cf6d-4023-a03d-095e09ce2ccc tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] [instance: 4c0c4bb6-269f-46bc-b460-7d0299277753] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:53:32.532199 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-ee644e2e-cf6d-4023-a03d-095e09ce2ccc tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:53:32.532658 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-ee644e2e-cf6d-4023-a03d-095e09ce2ccc tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:53:32.533471 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-ee644e2e-cf6d-4023-a03d-095e09ce2ccc tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:53:32.533912 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-ee644e2e-cf6d-4023-a03d-095e09ce2ccc tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:53:32.661451 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-2f052f20-527f-4051-aa36-64c1a758eeb0 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:53:32.662388 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-2f052f20-527f-4051-aa36-64c1a758eeb0 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] [instance: d82144a2-d572-4e58-852c-7553331127cc] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:53:32.664487 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-ee644e2e-cf6d-4023-a03d-095e09ce2ccc tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c85251638bc64deca16008b696b11ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3edb8d53184b98b7055ffc145f186d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:53:32.669171 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-2f052f20-527f-4051-aa36-64c1a758eeb0 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:53:32.669620 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-2f052f20-527f-4051-aa36-64c1a758eeb0 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:53:32.670391 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-2f052f20-527f-4051-aa36-64c1a758eeb0 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:53:32.670820 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-2f052f20-527f-4051-aa36-64c1a758eeb0 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:53:32.672792 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-ee644e2e-cf6d-4023-a03d-095e09ce2ccc tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c85251638bc64deca16008b696b11ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3edb8d53184b98b7055ffc145f186d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:53:32.674609 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-ee644e2e-cf6d-4023-a03d-095e09ce2ccc tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c85251638bc64deca16008b696b11ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3edb8d53184b98b7055ffc145f186d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:53:32.675729 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-ee644e2e-cf6d-4023-a03d-095e09ce2ccc tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] 10.222.0.20 "GET /compute/v2.1/servers/4c0c4bb6-269f-46bc-b460-7d0299277753" status: 200 len: 1407 microversion: 2.20 time: 0.155738 Jul 06 13:53:32.676285 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 446/885] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 6 13:53:32 2022] GET /compute/v2.1/servers/4c0c4bb6-269f-46bc-b460-7d0299277753 => generated 1407 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 06 13:53:32.701660 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-2f052f20-527f-4051-aa36-64c1a758eeb0 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] 10.222.0.20 "GET /compute/v2.1/servers/d82144a2-d572-4e58-852c-7553331127cc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044355 Jul 06 13:53:32.702211 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 440/886] 10.222.0.20 () {58 vars in 1301 bytes} [Wed Jul 6 13:53:32 2022] GET /compute/v2.1/servers/d82144a2-d572-4e58-852c-7553331127cc/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 06 13:53:33.697875 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-45df3271-d46c-47c9-bca4-ca36143e1248 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Calling method '>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:53:33.698408 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-45df3271-d46c-47c9-bca4-ca36143e1248 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] [instance: 4c0c4bb6-269f-46bc-b460-7d0299277753] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:53:33.706057 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-45df3271-d46c-47c9-bca4-ca36143e1248 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:53:33.706549 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-45df3271-d46c-47c9-bca4-ca36143e1248 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:53:33.707322 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-45df3271-d46c-47c9-bca4-ca36143e1248 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:53:33.707778 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-45df3271-d46c-47c9-bca4-ca36143e1248 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:53:33.713660 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-deee248d-e8e3-4aeb-981f-9c082bf0a497 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:53:33.714720 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-deee248d-e8e3-4aeb-981f-9c082bf0a497 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] [instance: d82144a2-d572-4e58-852c-7553331127cc] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:53:33.721080 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-deee248d-e8e3-4aeb-981f-9c082bf0a497 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:53:33.721528 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-deee248d-e8e3-4aeb-981f-9c082bf0a497 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:53:33.722431 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-deee248d-e8e3-4aeb-981f-9c082bf0a497 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:53:33.722862 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-deee248d-e8e3-4aeb-981f-9c082bf0a497 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:53:33.754055 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-deee248d-e8e3-4aeb-981f-9c082bf0a497 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] 10.222.0.20 "GET /compute/v2.1/servers/d82144a2-d572-4e58-852c-7553331127cc/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044711 Jul 06 13:53:33.754618 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 441/887] 10.222.0.20 () {58 vars in 1301 bytes} [Wed Jul 6 13:53:33 2022] GET /compute/v2.1/servers/d82144a2-d572-4e58-852c-7553331127cc/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 06 13:53:33.818822 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-a5e3fca8-2e75-4a2e-b8ae-d2b0406beb76 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:53:33.819352 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-a5e3fca8-2e75-4a2e-b8ae-d2b0406beb76 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] [instance: d82144a2-d572-4e58-852c-7553331127cc] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:53:33.825352 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-a5e3fca8-2e75-4a2e-b8ae-d2b0406beb76 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:53:33.825808 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-a5e3fca8-2e75-4a2e-b8ae-d2b0406beb76 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:53:33.826580 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-a5e3fca8-2e75-4a2e-b8ae-d2b0406beb76 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:53:33.827019 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-a5e3fca8-2e75-4a2e-b8ae-d2b0406beb76 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:53:33.852856 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-45df3271-d46c-47c9-bca4-ca36143e1248 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c85251638bc64deca16008b696b11ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3edb8d53184b98b7055ffc145f186d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:53:33.854154 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-a5e3fca8-2e75-4a2e-b8ae-d2b0406beb76 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] [instance: d82144a2-d572-4e58-852c-7553331127cc] Going to try to terminate instance {{(pid=124367) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 06 13:53:33.861233 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-45df3271-d46c-47c9-bca4-ca36143e1248 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c85251638bc64deca16008b696b11ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3edb8d53184b98b7055ffc145f186d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:53:33.862758 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-45df3271-d46c-47c9-bca4-ca36143e1248 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c85251638bc64deca16008b696b11ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3edb8d53184b98b7055ffc145f186d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:53:33.863922 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-45df3271-d46c-47c9-bca4-ca36143e1248 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] 10.222.0.20 "GET /compute/v2.1/servers/4c0c4bb6-269f-46bc-b460-7d0299277753" status: 200 len: 1599 microversion: 2.20 time: 0.170527 Jul 06 13:53:33.864689 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 447/888] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 6 13:53:33 2022] GET /compute/v2.1/servers/4c0c4bb6-269f-46bc-b460-7d0299277753 => generated 1599 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 06 13:53:33.881262 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-8c3ac6a6-c145-45f0-89ed-81fd25937faf tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Calling method '>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:53:33.881850 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-8c3ac6a6-c145-45f0-89ed-81fd25937faf tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] [instance: 4c0c4bb6-269f-46bc-b460-7d0299277753] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:53:33.887768 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-8c3ac6a6-c145-45f0-89ed-81fd25937faf tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:53:33.888046 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG dbcounter [-] [124367] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=124367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:53:33.888227 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-8c3ac6a6-c145-45f0-89ed-81fd25937faf tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:53:33.889073 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-8c3ac6a6-c145-45f0-89ed-81fd25937faf tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:53:33.889479 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-8c3ac6a6-c145-45f0-89ed-81fd25937faf tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:53:33.936731 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-a5e3fca8-2e75-4a2e-b8ae-d2b0406beb76 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] 10.222.0.20 "DELETE /compute/v2.1/servers/d82144a2-d572-4e58-852c-7553331127cc" status: 204 len: 0 microversion: 2.1 time: 0.121414 Jul 06 13:53:33.937737 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 442/889] 10.222.0.20 () {58 vars in 1238 bytes} [Wed Jul 6 13:53:33 2022] DELETE /compute/v2.1/servers/d82144a2-d572-4e58-852c-7553331127cc => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 06 13:53:33.946454 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-7fcfedd6-1cb7-451f-8ab8-ce4e598665a1 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:53:33.947136 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-7fcfedd6-1cb7-451f-8ab8-ce4e598665a1 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] [instance: d82144a2-d572-4e58-852c-7553331127cc] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:53:33.953242 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-7fcfedd6-1cb7-451f-8ab8-ce4e598665a1 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:53:33.953618 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-7fcfedd6-1cb7-451f-8ab8-ce4e598665a1 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:53:33.954405 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-7fcfedd6-1cb7-451f-8ab8-ce4e598665a1 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:53:33.954827 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-7fcfedd6-1cb7-451f-8ab8-ce4e598665a1 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:53:33.972346 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-8c3ac6a6-c145-45f0-89ed-81fd25937faf tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] 10.222.0.20 "GET /compute/v2.1/servers/4c0c4bb6-269f-46bc-b460-7d0299277753/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.094952 Jul 06 13:53:33.972978 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 448/890] 10.222.0.20 () {60 vars in 1315 bytes} [Wed Jul 6 13:53:33 2022] GET /compute/v2.1/servers/4c0c4bb6-269f-46bc-b460-7d0299277753/os-interface => generated 284 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 06 13:53:34.089140 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-7fcfedd6-1cb7-451f-8ab8-ce4e598665a1 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b572a8f465048558fc969b85b2aec5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd85f2a57a0847debf5aaf81aab7a638', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:53:34.096546 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-7fcfedd6-1cb7-451f-8ab8-ce4e598665a1 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] 10.222.0.20 "GET /compute/v2.1/servers/d82144a2-d572-4e58-852c-7553331127cc" status: 200 len: 1683 microversion: 2.1 time: 0.154749 Jul 06 13:53:34.097138 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 443/891] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:53:33 2022] GET /compute/v2.1/servers/d82144a2-d572-4e58-852c-7553331127cc => generated 1683 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:53:34.911506 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [req-82a60fe7-f5df-4783-8795-95e8fe90b4b7 req-5dc14b21-19a6-4337-a945-15f02aaff83a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4c0c4bb6-269f-46bc-b460-7d0299277753", "tag": "92164628-0711-4bbe-835d-289c030d699a"}]} {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 06 13:53:34.920239 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [req-82a60fe7-f5df-4783-8795-95e8fe90b4b7 req-5dc14b21-19a6-4337-a945-15f02aaff83a service nova] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:53:34.920239 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [req-82a60fe7-f5df-4783-8795-95e8fe90b4b7 req-5dc14b21-19a6-4337-a945-15f02aaff83a service nova] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:53:34.933290 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.compute.server_external_events [req-82a60fe7-f5df-4783-8795-95e8fe90b4b7 req-5dc14b21-19a6-4337-a945-15f02aaff83a service nova] Creating event network-changed:92164628-0711-4bbe-835d-289c030d699a for instance 4c0c4bb6-269f-46bc-b460-7d0299277753 on hv-cinder-81914 Jul 06 13:53:34.938390 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [req-82a60fe7-f5df-4783-8795-95e8fe90b4b7 req-5dc14b21-19a6-4337-a945-15f02aaff83a service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031170 Jul 06 13:53:34.939035 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 449/892] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 6 13:53:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 06 13:53:35.114143 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-1ec5ae6f-81ec-4b16-b813-11e9f3463502 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:53:35.114680 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-1ec5ae6f-81ec-4b16-b813-11e9f3463502 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] [instance: d82144a2-d572-4e58-852c-7553331127cc] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:53:35.121924 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-1ec5ae6f-81ec-4b16-b813-11e9f3463502 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:53:35.122379 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-1ec5ae6f-81ec-4b16-b813-11e9f3463502 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:53:35.123148 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-1ec5ae6f-81ec-4b16-b813-11e9f3463502 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:53:35.123584 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-1ec5ae6f-81ec-4b16-b813-11e9f3463502 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:53:35.252078 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-1ec5ae6f-81ec-4b16-b813-11e9f3463502 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b572a8f465048558fc969b85b2aec5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd85f2a57a0847debf5aaf81aab7a638', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:53:35.259596 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-1ec5ae6f-81ec-4b16-b813-11e9f3463502 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] 10.222.0.20 "GET /compute/v2.1/servers/d82144a2-d572-4e58-852c-7553331127cc" status: 200 len: 1683 microversion: 2.1 time: 0.149352 Jul 06 13:53:35.260155 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 444/893] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:53:35 2022] GET /compute/v2.1/servers/d82144a2-d572-4e58-852c-7553331127cc => generated 1683 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:53:36.276805 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-dfad8752-c2b4-4b2f-a064-d8f166410ffd tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Calling method '>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:53:36.277478 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-dfad8752-c2b4-4b2f-a064-d8f166410ffd tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] [instance: d82144a2-d572-4e58-852c-7553331127cc] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:53:36.284168 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-dfad8752-c2b4-4b2f-a064-d8f166410ffd tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:53:36.284623 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-dfad8752-c2b4-4b2f-a064-d8f166410ffd tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:53:36.285438 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-dfad8752-c2b4-4b2f-a064-d8f166410ffd tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:53:36.285879 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-dfad8752-c2b4-4b2f-a064-d8f166410ffd tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:53:36.431624 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-dfad8752-c2b4-4b2f-a064-d8f166410ffd tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b572a8f465048558fc969b85b2aec5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd85f2a57a0847debf5aaf81aab7a638', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:53:36.440013 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-dfad8752-c2b4-4b2f-a064-d8f166410ffd tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] 10.222.0.20 "GET /compute/v2.1/servers/d82144a2-d572-4e58-852c-7553331127cc" status: 200 len: 1683 microversion: 2.1 time: 0.167991 Jul 06 13:53:36.440587 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 450/894] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:53:36 2022] GET /compute/v2.1/servers/d82144a2-d572-4e58-852c-7553331127cc => generated 1683 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:53:36.853324 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [req-366e5a1d-7b70-4cd0-9d15-16597b1df5ca req-a4518f0e-6b09-4fa8-9247-abba4c6acc9e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d82144a2-d572-4e58-852c-7553331127cc", "name": "network-vif-deleted", "tag": "07de552b-eff5-4b04-9e8d-032f865a589a"}]} {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 06 13:53:36.864241 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [req-366e5a1d-7b70-4cd0-9d15-16597b1df5ca req-a4518f0e-6b09-4fa8-9247-abba4c6acc9e service nova] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:53:36.864683 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [req-366e5a1d-7b70-4cd0-9d15-16597b1df5ca req-a4518f0e-6b09-4fa8-9247-abba4c6acc9e service nova] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:53:36.879161 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.compute.server_external_events [req-366e5a1d-7b70-4cd0-9d15-16597b1df5ca req-a4518f0e-6b09-4fa8-9247-abba4c6acc9e service nova] Creating event network-vif-deleted:07de552b-eff5-4b04-9e8d-032f865a589a for instance d82144a2-d572-4e58-852c-7553331127cc on hv-cinder-81914 Jul 06 13:53:36.886772 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [req-366e5a1d-7b70-4cd0-9d15-16597b1df5ca req-a4518f0e-6b09-4fa8-9247-abba4c6acc9e service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038169 Jul 06 13:53:36.887373 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 445/895] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 6 13:53:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 06 13:53:37.458445 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-cff2e161-8cbf-43d9-8a27-6f963961168a tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Calling method '>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:53:37.458965 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-cff2e161-8cbf-43d9-8a27-6f963961168a tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] [instance: d82144a2-d572-4e58-852c-7553331127cc] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:53:37.468652 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-cff2e161-8cbf-43d9-8a27-6f963961168a tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:53:37.469379 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-cff2e161-8cbf-43d9-8a27-6f963961168a tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:53:37.470833 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-cff2e161-8cbf-43d9-8a27-6f963961168a tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:53:37.471513 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-cff2e161-8cbf-43d9-8a27-6f963961168a tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:53:37.493489 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.wsgi [None req-cff2e161-8cbf-43d9-8a27-6f963961168a tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] HTTP exception thrown: Instance d82144a2-d572-4e58-852c-7553331127cc could not be found. Jul 06 13:53:37.496227 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-cff2e161-8cbf-43d9-8a27-6f963961168a tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Request method failure captured: Jul 06 13:53:37.496227 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: request: GET /compute/v2.1/servers/d82144a2-d572-4e58-852c-7553331127cc HTTP/1.1 Jul 06 13:53:37.496227 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: Accept: application/json Jul 06 13:53:37.496227 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: Accept-Encoding: identity Jul 06 13:53:37.496227 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: Connection: close Jul 06 13:53:37.496227 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: Content-Length: 0 Jul 06 13:53:37.496227 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: Content-Type: application/json Jul 06 13:53:37.496227 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: Host: 10.222.0.20 Jul 06 13:53:37.496227 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: Openstack-System-Scope: None Jul 06 13:53:37.496227 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: User-Agent: python-urllib3/1.26.9 Jul 06 13:53:37.496227 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Auth-Token: gAAAAABixZH4I4dgmb0Q3wbjrFWrBMh6OmJtrlg6lZ88SjHzAtW3fxMyo3s0_pJVvHdnPyxERhBQTWBNewTHA0QeJRzzLbnn4Csb1lAz3C9NjKcuSHUaArYBZ7P3u01dtbqramyieBExBREkl13A9tBRRuVoPmOumXVJ74UVBAMWWamo1ttSwGg Jul 06 13:53:37.496227 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Domain-Id: None Jul 06 13:53:37.496227 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Domain-Name: None Jul 06 13:53:37.496227 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Identity-Status: Confirmed Jul 06 13:53:37.496227 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Is-Admin-Project: True Jul 06 13:53:37.496227 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Project-Domain-Id: default Jul 06 13:53:37.496227 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Project-Domain-Name: Default Jul 06 13:53:37.496227 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Project-Id: bd85f2a57a0847debf5aaf81aab7a638 Jul 06 13:53:37.496227 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Project-Name: tempest-AttachVolumeNegativeTest-1016924223 Jul 06 13:53:37.496227 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Role: reader,member Jul 06 13:53:37.496227 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Roles: reader,member Jul 06 13:53:37.497759 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_bd85f2a57a0847debf5aaf81aab7a638"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/bd85f2a57a0847debf5aaf81aab7a638"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/bd85f2a57a0847debf5aaf81aab7a638"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/bd85f2a57a0847debf5aaf81aab7a638"}]}] Jul 06 13:53:37.497759 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Tenant: tempest-AttachVolumeNegativeTest-1016924223 Jul 06 13:53:37.497759 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Tenant-Id: bd85f2a57a0847debf5aaf81aab7a638 Jul 06 13:53:37.497759 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1016924223 Jul 06 13:53:37.497759 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-User: tempest-AttachVolumeNegativeTest-1016924223-project Jul 06 13:53:37.497759 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-User-Domain-Id: default Jul 06 13:53:37.497759 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-User-Domain-Name: Default Jul 06 13:53:37.497759 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-User-Id: 7b572a8f465048558fc969b85b2aec5b Jul 06 13:53:37.497759 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-User-Name: tempest-AttachVolumeNegativeTest-1016924223-project Jul 06 13:53:37.497759 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: method: > Jul 06 13:53:37.497759 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: exception: Instance d82144a2-d572-4e58-852c-7553331127cc could not be found. Jul 06 13:53:37.497759 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: action_args: {'id': 'd82144a2-d572-4e58-852c-7553331127cc'} Jul 06 13:53:37.498782 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 06 13:53:37.498782 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 06 13:53:37.498782 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 06 13:53:37.498782 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 06 13:53:37.498782 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 06 13:53:37.498782 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 06 13:53:37.498782 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 06 13:53:37.498782 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 06 13:53:37.498782 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 06 13:53:37.498782 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 06 13:53:37.498782 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d82144a2-d572-4e58-852c-7553331127cc could not be found. Jul 06 13:53:37.498782 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi Jul 06 13:53:37.498782 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 06 13:53:37.498782 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi Jul 06 13:53:37.498782 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 06 13:53:37.498782 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 06 13:53:37.498782 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 06 13:53:37.498782 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 06 13:53:37.498782 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 06 13:53:37.498782 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 06 13:53:37.500318 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 06 13:53:37.500318 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 06 13:53:37.500318 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 06 13:53:37.500318 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 06 13:53:37.500318 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 06 13:53:37.500318 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 06 13:53:37.500318 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 06 13:53:37.500318 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d82144a2-d572-4e58-852c-7553331127cc could not be found. Jul 06 13:53:37.500318 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi Jul 06 13:53:37.500318 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 06 13:53:37.500318 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi Jul 06 13:53:37.500318 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 06 13:53:37.500318 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 06 13:53:37.500318 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 06 13:53:37.500318 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 06 13:53:37.500318 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 06 13:53:37.500318 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d82144a2-d572-4e58-852c-7553331127cc could not be found. Jul 06 13:53:37.500318 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi Jul 06 13:53:37.502043 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-cff2e161-8cbf-43d9-8a27-6f963961168a tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Returning 404 to user: Instance d82144a2-d572-4e58-852c-7553331127cc could not be found. {{(pid=124368) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 06 13:53:37.502043 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-cff2e161-8cbf-43d9-8a27-6f963961168a tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] 10.222.0.20 "GET /compute/v2.1/servers/d82144a2-d572-4e58-852c-7553331127cc" status: 404 len: 111 microversion: 2.1 time: 0.043820 Jul 06 13:53:37.502043 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 451/896] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:53:37 2022] GET /compute/v2.1/servers/d82144a2-d572-4e58-852c-7553331127cc => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 06 13:53:37.508478 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-590ca8f1-6d0f-43c8-ad31-b2956faade06 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Calling method '.version_select at 0x7ffbc429f700>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:53:37.528685 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-590ca8f1-6d0f-43c8-ad31-b2956faade06 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1745217203" status: 202 len: 0 microversion: 2.1 time: 0.025286 Jul 06 13:53:37.529542 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 446/897] 10.222.0.20 () {58 vars in 1220 bytes} [Wed Jul 6 13:53:37 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1745217203 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 06 13:53:38.439303 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-f709301c-bc22-4d1b-be8d-fffadc3bace0 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Action: 'create', calling method: .version_select at 0x7ffbc56f2430>, body: {"keypair": {"name": "tempest-keypair-1778301655", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGMhNJwtkuhxjdtHP89X8p1OZ1YQIllSfAst7ahh53iBwQr42Ba5eeIuRGgJWL36ipfLwxtKYjkeAblo7KJiywq5po3DdUgXHsVaofwvlC2nTBpeIhdUSFXrP9mE4tRgwA=="}} {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 06 13:53:38.453668 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.quota [None req-f709301c-bc22-4d1b-be8d-fffadc3bace0 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Getting quotas for project bd85f2a57a0847debf5aaf81aab7a638. Resources: {'key_pairs'} {{(pid=124368) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 06 13:53:38.457395 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.quota [None req-f709301c-bc22-4d1b-be8d-fffadc3bace0 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Getting quotas for user 7b572a8f465048558fc969b85b2aec5b and project bd85f2a57a0847debf5aaf81aab7a638. Resources: {'key_pairs'} {{(pid=124368) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 06 13:53:38.480040 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-f709301c-bc22-4d1b-be8d-fffadc3bace0 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.044596 Jul 06 13:53:38.480651 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 452/898] 10.222.0.20 () {60 vars in 1158 bytes} [Wed Jul 6 13:53:38 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 06 13:53:39.745462 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-ea17fb58-b195-4a9e-8630-958b0cb230b4 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1366657521", "imageRef": "b08481d9-1e39-41e8-97bd-b05a9c35b377", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "599de418-b206-4788-89c1-e9276ab94414"}], "security_groups": [{"name": "tempest-securitygroup--958773436"}], "key_name": "tempest-keypair-1778301655", "user_data": "}} {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 06 13:53:39.849138 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.network.neutron [None req-ea17fb58-b195-4a9e-8630-958b0cb230b4 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] validate_networks() for [('599de418-b206-4788-89c1-e9276ab94414', None, None, None, None, None)] {{(pid=124367) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 06 13:53:40.299922 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.virt.hardware [None req-ea17fb58-b195-4a9e-8630-958b0cb230b4 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Flavor limits 0:0:0 {{(pid=124367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 06 13:53:40.300411 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.virt.hardware [None req-ea17fb58-b195-4a9e-8630-958b0cb230b4 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Image limits 0:0:0 {{(pid=124367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 06 13:53:40.300957 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.virt.hardware [None req-ea17fb58-b195-4a9e-8630-958b0cb230b4 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Flavor pref 0:0:0 {{(pid=124367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 06 13:53:40.301460 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.virt.hardware [None req-ea17fb58-b195-4a9e-8630-958b0cb230b4 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Image pref 0:0:0 {{(pid=124367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 06 13:53:40.301875 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.virt.hardware [None req-ea17fb58-b195-4a9e-8630-958b0cb230b4 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 06 13:53:40.311078 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-ea17fb58-b195-4a9e-8630-958b0cb230b4 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:53:40.311520 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-ea17fb58-b195-4a9e-8630-958b0cb230b4 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:53:40.312442 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-ea17fb58-b195-4a9e-8630-958b0cb230b4 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:53:40.312880 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-ea17fb58-b195-4a9e-8630-958b0cb230b4 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:53:40.330078 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.quota [None req-ea17fb58-b195-4a9e-8630-958b0cb230b4 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Getting quotas for project bd85f2a57a0847debf5aaf81aab7a638. Resources: {'instances', 'cores', 'ram'} {{(pid=124367) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 06 13:53:40.334024 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.quota [None req-ea17fb58-b195-4a9e-8630-958b0cb230b4 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Getting quotas for user 7b572a8f465048558fc969b85b2aec5b and project bd85f2a57a0847debf5aaf81aab7a638. Resources: {'instances', 'cores', 'ram'} {{(pid=124367) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 06 13:53:40.345605 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-ea17fb58-b195-4a9e-8630-958b0cb230b4 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Going to run 1 instances... {{(pid=124367) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 06 13:53:40.347934 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-ea17fb58-b195-4a9e-8630-958b0cb230b4 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] [instance: 5fa482da-0cca-4e1c-9724-e4d5ee9d73fa] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b08481d9-1e39-41e8-97bd-b05a9c35b377',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124367) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 06 13:53:40.392788 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR oslo.messaging._drivers.impl_rabbit [None req-ea17fb58-b195-4a9e-8630-958b0cb230b4 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] [91c8d03e-5035-42f9-bbe8-d30aeb2530e8] AMQP server on 10.222.0.20:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 06 13:53:41.400468 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO oslo.messaging._drivers.impl_rabbit [None req-ea17fb58-b195-4a9e-8630-958b0cb230b4 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] [91c8d03e-5035-42f9-bbe8-d30aeb2530e8] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 52646. Jul 06 13:53:41.404323 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-ea17fb58-b195-4a9e-8630-958b0cb230b4 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.664574 Jul 06 13:53:41.404968 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 447/899] 10.222.0.20 () {60 vars in 1146 bytes} [Wed Jul 6 13:53:39 2022] POST /compute/v2.1/servers => generated 401 bytes in 1666 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 06 13:53:41.414967 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-d197a61a-c970-4db7-affe-47400be864cc tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Calling method '>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:53:41.415576 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-d197a61a-c970-4db7-affe-47400be864cc tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] [instance: 5fa482da-0cca-4e1c-9724-e4d5ee9d73fa] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:53:41.474190 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-d197a61a-c970-4db7-affe-47400be864cc tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b572a8f465048558fc969b85b2aec5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd85f2a57a0847debf5aaf81aab7a638', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:53:41.481906 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-d197a61a-c970-4db7-affe-47400be864cc tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] 10.222.0.20 "GET /compute/v2.1/servers/5fa482da-0cca-4e1c-9724-e4d5ee9d73fa" status: 200 len: 1242 microversion: 2.1 time: 0.070824 Jul 06 13:53:41.482468 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 453/900] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:53:41 2022] GET /compute/v2.1/servers/5fa482da-0cca-4e1c-9724-e4d5ee9d73fa => generated 1242 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:53:42.499759 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-1c6e88ef-bfa3-4dc9-a4c7-8681925c4ca2 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:53:42.500358 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-1c6e88ef-bfa3-4dc9-a4c7-8681925c4ca2 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] [instance: 5fa482da-0cca-4e1c-9724-e4d5ee9d73fa] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:53:42.508152 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-1c6e88ef-bfa3-4dc9-a4c7-8681925c4ca2 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:53:42.508593 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-1c6e88ef-bfa3-4dc9-a4c7-8681925c4ca2 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:53:42.509579 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-1c6e88ef-bfa3-4dc9-a4c7-8681925c4ca2 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:53:42.510008 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-1c6e88ef-bfa3-4dc9-a4c7-8681925c4ca2 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:53:42.552385 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-83b52e56-a8a5-41f4-ba0e-b233c59f88c0 tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Calling method '>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:53:42.552943 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-83b52e56-a8a5-41f4-ba0e-b233c59f88c0 tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] [instance: ee2271a7-8fab-4455-9c3b-32159f33ad03] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:53:42.559696 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-83b52e56-a8a5-41f4-ba0e-b233c59f88c0 tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:53:42.560157 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-83b52e56-a8a5-41f4-ba0e-b233c59f88c0 tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:53:42.560944 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-83b52e56-a8a5-41f4-ba0e-b233c59f88c0 tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:53:42.561471 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-83b52e56-a8a5-41f4-ba0e-b233c59f88c0 tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:53:42.588784 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-1c6e88ef-bfa3-4dc9-a4c7-8681925c4ca2 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b572a8f465048558fc969b85b2aec5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd85f2a57a0847debf5aaf81aab7a638', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:53:42.595159 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-83b52e56-a8a5-41f4-ba0e-b233c59f88c0 tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] [instance: ee2271a7-8fab-4455-9c3b-32159f33ad03] Going to try to terminate instance {{(pid=124368) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 06 13:53:42.596415 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-1c6e88ef-bfa3-4dc9-a4c7-8681925c4ca2 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] 10.222.0.20 "GET /compute/v2.1/servers/5fa482da-0cca-4e1c-9724-e4d5ee9d73fa" status: 200 len: 1312 microversion: 2.1 time: 0.100606 Jul 06 13:53:42.596985 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 448/901] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:53:42 2022] GET /compute/v2.1/servers/5fa482da-0cca-4e1c-9724-e4d5ee9d73fa => generated 1312 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:53:42.673986 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-83b52e56-a8a5-41f4-ba0e-b233c59f88c0 tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] 10.222.0.20 "DELETE /compute/v2.1/servers/ee2271a7-8fab-4455-9c3b-32159f33ad03" status: 204 len: 0 microversion: 2.1 time: 0.125262 Jul 06 13:53:42.674553 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 454/902] 10.222.0.20 () {58 vars in 1238 bytes} [Wed Jul 6 13:53:42 2022] DELETE /compute/v2.1/servers/ee2271a7-8fab-4455-9c3b-32159f33ad03 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 06 13:53:42.683120 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-623d2bd9-358e-4d39-87d2-2ce95cd5be29 tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:53:42.683736 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-623d2bd9-358e-4d39-87d2-2ce95cd5be29 tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] [instance: ee2271a7-8fab-4455-9c3b-32159f33ad03] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:53:42.689755 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-623d2bd9-358e-4d39-87d2-2ce95cd5be29 tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:53:42.690209 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-623d2bd9-358e-4d39-87d2-2ce95cd5be29 tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:53:42.690970 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-623d2bd9-358e-4d39-87d2-2ce95cd5be29 tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:53:42.691408 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-623d2bd9-358e-4d39-87d2-2ce95cd5be29 tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:53:42.898270 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-623d2bd9-358e-4d39-87d2-2ce95cd5be29 tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32a8191b1c184c75b428579ace2da61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bf864bb1764452e8e3a6f0d5929da9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:53:42.905906 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-623d2bd9-358e-4d39-87d2-2ce95cd5be29 tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] 10.222.0.20 "GET /compute/v2.1/servers/ee2271a7-8fab-4455-9c3b-32159f33ad03" status: 200 len: 1576 microversion: 2.1 time: 0.226506 Jul 06 13:53:42.906532 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 449/903] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:53:42 2022] GET /compute/v2.1/servers/ee2271a7-8fab-4455-9c3b-32159f33ad03 => generated 1576 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:53:43.614293 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-b60735f6-f349-4ea3-a294-1ddf39919164 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Calling method '>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:53:43.614991 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-b60735f6-f349-4ea3-a294-1ddf39919164 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] [instance: 5fa482da-0cca-4e1c-9724-e4d5ee9d73fa] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:53:43.621415 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-b60735f6-f349-4ea3-a294-1ddf39919164 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:53:43.621865 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-b60735f6-f349-4ea3-a294-1ddf39919164 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:53:43.622622 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-b60735f6-f349-4ea3-a294-1ddf39919164 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:53:43.623058 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-b60735f6-f349-4ea3-a294-1ddf39919164 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:53:43.751056 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-b60735f6-f349-4ea3-a294-1ddf39919164 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b572a8f465048558fc969b85b2aec5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd85f2a57a0847debf5aaf81aab7a638', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:53:43.759112 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-b60735f6-f349-4ea3-a294-1ddf39919164 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] 10.222.0.20 "GET /compute/v2.1/servers/5fa482da-0cca-4e1c-9724-e4d5ee9d73fa" status: 200 len: 1367 microversion: 2.1 time: 0.149002 Jul 06 13:53:43.759709 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 455/904] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:53:43 2022] GET /compute/v2.1/servers/5fa482da-0cca-4e1c-9724-e4d5ee9d73fa => generated 1367 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:53:43.923534 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-8218a110-6aa6-4ac1-9b09-8910abfc52b4 tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:53:43.924410 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-8218a110-6aa6-4ac1-9b09-8910abfc52b4 tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] [instance: ee2271a7-8fab-4455-9c3b-32159f33ad03] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:53:43.931147 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-8218a110-6aa6-4ac1-9b09-8910abfc52b4 tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:53:43.931598 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-8218a110-6aa6-4ac1-9b09-8910abfc52b4 tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:53:43.932368 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-8218a110-6aa6-4ac1-9b09-8910abfc52b4 tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:53:43.932799 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-8218a110-6aa6-4ac1-9b09-8910abfc52b4 tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:53:44.132815 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-8218a110-6aa6-4ac1-9b09-8910abfc52b4 tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32a8191b1c184c75b428579ace2da61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bf864bb1764452e8e3a6f0d5929da9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:53:44.140250 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-8218a110-6aa6-4ac1-9b09-8910abfc52b4 tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] 10.222.0.20 "GET /compute/v2.1/servers/ee2271a7-8fab-4455-9c3b-32159f33ad03" status: 200 len: 1576 microversion: 2.1 time: 0.220587 Jul 06 13:53:44.140819 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 450/905] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:53:43 2022] GET /compute/v2.1/servers/ee2271a7-8fab-4455-9c3b-32159f33ad03 => generated 1576 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:53:44.687089 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [req-77ebedab-82fe-4b61-bfe7-81de266c437f req-da5f7489-88ca-41d3-957c-ef3cfbd62957 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5fa482da-0cca-4e1c-9724-e4d5ee9d73fa", "tag": "ff54c39f-c144-43d9-b98e-674c20269a43"}]} {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 06 13:53:44.702111 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [req-77ebedab-82fe-4b61-bfe7-81de266c437f req-da5f7489-88ca-41d3-957c-ef3cfbd62957 service nova] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:53:44.702646 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [req-77ebedab-82fe-4b61-bfe7-81de266c437f req-da5f7489-88ca-41d3-957c-ef3cfbd62957 service nova] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:53:44.721768 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.compute.server_external_events [req-77ebedab-82fe-4b61-bfe7-81de266c437f req-da5f7489-88ca-41d3-957c-ef3cfbd62957 service nova] Creating event network-changed:ff54c39f-c144-43d9-b98e-674c20269a43 for instance 5fa482da-0cca-4e1c-9724-e4d5ee9d73fa on hv-cinder-81914 Jul 06 13:53:44.727906 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [req-77ebedab-82fe-4b61-bfe7-81de266c437f req-da5f7489-88ca-41d3-957c-ef3cfbd62957 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046597 Jul 06 13:53:44.729111 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 456/906] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 6 13:53:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 06 13:53:44.776441 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-b1b8e1a1-e769-49e3-ab90-fc947e3eb60f tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:53:44.777073 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-b1b8e1a1-e769-49e3-ab90-fc947e3eb60f tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] [instance: 5fa482da-0cca-4e1c-9724-e4d5ee9d73fa] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:53:44.784132 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-b1b8e1a1-e769-49e3-ab90-fc947e3eb60f tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:53:44.784586 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-b1b8e1a1-e769-49e3-ab90-fc947e3eb60f tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:53:44.785386 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-b1b8e1a1-e769-49e3-ab90-fc947e3eb60f tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:53:44.786001 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-b1b8e1a1-e769-49e3-ab90-fc947e3eb60f tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:53:45.116476 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-b1b8e1a1-e769-49e3-ab90-fc947e3eb60f tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b572a8f465048558fc969b85b2aec5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd85f2a57a0847debf5aaf81aab7a638', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:53:45.123850 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-b1b8e1a1-e769-49e3-ab90-fc947e3eb60f tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] 10.222.0.20 "GET /compute/v2.1/servers/5fa482da-0cca-4e1c-9724-e4d5ee9d73fa" status: 200 len: 1367 microversion: 2.1 time: 0.352039 Jul 06 13:53:45.124836 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 451/907] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:53:44 2022] GET /compute/v2.1/servers/5fa482da-0cca-4e1c-9724-e4d5ee9d73fa => generated 1367 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:53:45.158624 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-abf50423-e98d-4b61-9f34-2e3af4c77989 tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Calling method '>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:53:45.159324 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-abf50423-e98d-4b61-9f34-2e3af4c77989 tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] [instance: ee2271a7-8fab-4455-9c3b-32159f33ad03] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:53:45.166356 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-abf50423-e98d-4b61-9f34-2e3af4c77989 tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:53:45.166809 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-abf50423-e98d-4b61-9f34-2e3af4c77989 tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:53:45.167583 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-abf50423-e98d-4b61-9f34-2e3af4c77989 tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:53:45.168023 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-abf50423-e98d-4b61-9f34-2e3af4c77989 tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:53:45.307939 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-abf50423-e98d-4b61-9f34-2e3af4c77989 tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32a8191b1c184c75b428579ace2da61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bf864bb1764452e8e3a6f0d5929da9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:53:45.315664 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-abf50423-e98d-4b61-9f34-2e3af4c77989 tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] 10.222.0.20 "GET /compute/v2.1/servers/ee2271a7-8fab-4455-9c3b-32159f33ad03" status: 200 len: 1576 microversion: 2.1 time: 0.161322 Jul 06 13:53:45.316277 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 457/908] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:53:45 2022] GET /compute/v2.1/servers/ee2271a7-8fab-4455-9c3b-32159f33ad03 => generated 1576 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:53:46.141537 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-85df6693-4049-4f93-963c-14f3e59ab995 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:53:46.142221 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-85df6693-4049-4f93-963c-14f3e59ab995 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] [instance: 5fa482da-0cca-4e1c-9724-e4d5ee9d73fa] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:53:46.149713 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-85df6693-4049-4f93-963c-14f3e59ab995 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:53:46.150164 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-85df6693-4049-4f93-963c-14f3e59ab995 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:53:46.150924 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-85df6693-4049-4f93-963c-14f3e59ab995 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:53:46.151350 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-85df6693-4049-4f93-963c-14f3e59ab995 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:53:46.280739 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-85df6693-4049-4f93-963c-14f3e59ab995 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b572a8f465048558fc969b85b2aec5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd85f2a57a0847debf5aaf81aab7a638', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:53:46.288341 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-85df6693-4049-4f93-963c-14f3e59ab995 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] 10.222.0.20 "GET /compute/v2.1/servers/5fa482da-0cca-4e1c-9724-e4d5ee9d73fa" status: 200 len: 1367 microversion: 2.1 time: 0.151425 Jul 06 13:53:46.288910 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 452/909] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:53:46 2022] GET /compute/v2.1/servers/5fa482da-0cca-4e1c-9724-e4d5ee9d73fa => generated 1367 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:53:46.332738 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-e49e10bb-720f-40c3-8b2e-f67d8b909bb7 tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Calling method '>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:53:46.333385 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-e49e10bb-720f-40c3-8b2e-f67d8b909bb7 tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] [instance: ee2271a7-8fab-4455-9c3b-32159f33ad03] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:53:46.342457 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-e49e10bb-720f-40c3-8b2e-f67d8b909bb7 tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:53:46.343256 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-e49e10bb-720f-40c3-8b2e-f67d8b909bb7 tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:53:46.344344 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-e49e10bb-720f-40c3-8b2e-f67d8b909bb7 tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:53:46.344795 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-e49e10bb-720f-40c3-8b2e-f67d8b909bb7 tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:53:46.413448 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-e49e10bb-720f-40c3-8b2e-f67d8b909bb7 tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32a8191b1c184c75b428579ace2da61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bf864bb1764452e8e3a6f0d5929da9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:53:46.421583 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-e49e10bb-720f-40c3-8b2e-f67d8b909bb7 tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] 10.222.0.20 "GET /compute/v2.1/servers/ee2271a7-8fab-4455-9c3b-32159f33ad03" status: 200 len: 1509 microversion: 2.1 time: 0.092767 Jul 06 13:53:46.422171 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 458/910] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:53:46 2022] GET /compute/v2.1/servers/ee2271a7-8fab-4455-9c3b-32159f33ad03 => generated 1509 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:53:46.750292 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [req-c51ceb61-cf5a-4e66-a2c6-ddf62dd95baa req-c8ee55c0-e2e0-413c-99a8-129c475e0c72 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ee2271a7-8fab-4455-9c3b-32159f33ad03", "name": "network-vif-deleted", "tag": "45301213-2dd0-47c7-bd88-caba9757cb8d"}]} {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 06 13:53:46.759006 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [req-c51ceb61-cf5a-4e66-a2c6-ddf62dd95baa req-c8ee55c0-e2e0-413c-99a8-129c475e0c72 service nova] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:53:46.759456 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [req-c51ceb61-cf5a-4e66-a2c6-ddf62dd95baa req-c8ee55c0-e2e0-413c-99a8-129c475e0c72 service nova] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:53:46.770276 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.compute.server_external_events [req-c51ceb61-cf5a-4e66-a2c6-ddf62dd95baa req-c8ee55c0-e2e0-413c-99a8-129c475e0c72 service nova] Creating event network-vif-deleted:45301213-2dd0-47c7-bd88-caba9757cb8d for instance ee2271a7-8fab-4455-9c3b-32159f33ad03 on hv-cinder-81914 Jul 06 13:53:46.775801 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [req-c51ceb61-cf5a-4e66-a2c6-ddf62dd95baa req-c8ee55c0-e2e0-413c-99a8-129c475e0c72 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029164 Jul 06 13:53:46.776388 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 453/911] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 6 13:53:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 06 13:53:47.305988 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-35e1a165-666d-4330-90fd-bf697f2f0c20 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Calling method '>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:53:47.306602 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-35e1a165-666d-4330-90fd-bf697f2f0c20 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] [instance: 5fa482da-0cca-4e1c-9724-e4d5ee9d73fa] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:53:47.312571 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-35e1a165-666d-4330-90fd-bf697f2f0c20 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:53:47.313054 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-35e1a165-666d-4330-90fd-bf697f2f0c20 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:53:47.313817 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-35e1a165-666d-4330-90fd-bf697f2f0c20 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:53:47.314253 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-35e1a165-666d-4330-90fd-bf697f2f0c20 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:53:47.439994 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-35e1a165-666d-4330-90fd-bf697f2f0c20 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b572a8f465048558fc969b85b2aec5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd85f2a57a0847debf5aaf81aab7a638', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:53:47.448014 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-35e1a165-666d-4330-90fd-bf697f2f0c20 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] 10.222.0.20 "GET /compute/v2.1/servers/5fa482da-0cca-4e1c-9724-e4d5ee9d73fa" status: 200 len: 1367 microversion: 2.1 time: 0.146633 Jul 06 13:53:47.448590 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 459/912] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:53:47 2022] GET /compute/v2.1/servers/5fa482da-0cca-4e1c-9724-e4d5ee9d73fa => generated 1367 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:53:47.494524 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-0961116a-1898-41b3-97af-6a471ff65f70 tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:53:47.495212 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-0961116a-1898-41b3-97af-6a471ff65f70 tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] [instance: ee2271a7-8fab-4455-9c3b-32159f33ad03] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:53:47.501796 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-0961116a-1898-41b3-97af-6a471ff65f70 tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:53:47.502239 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-0961116a-1898-41b3-97af-6a471ff65f70 tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:53:47.502989 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-0961116a-1898-41b3-97af-6a471ff65f70 tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:53:47.503417 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-0961116a-1898-41b3-97af-6a471ff65f70 tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:53:47.570108 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-0961116a-1898-41b3-97af-6a471ff65f70 tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32a8191b1c184c75b428579ace2da61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bf864bb1764452e8e3a6f0d5929da9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:53:47.577544 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-0961116a-1898-41b3-97af-6a471ff65f70 tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] 10.222.0.20 "GET /compute/v2.1/servers/ee2271a7-8fab-4455-9c3b-32159f33ad03" status: 200 len: 1509 microversion: 2.1 time: 0.087296 Jul 06 13:53:47.578107 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 454/913] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:53:47 2022] GET /compute/v2.1/servers/ee2271a7-8fab-4455-9c3b-32159f33ad03 => generated 1509 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:53:48.466075 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-dec8db20-ede6-4cc8-b5d7-72ab0c726a8c tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Calling method '>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:53:48.466707 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-dec8db20-ede6-4cc8-b5d7-72ab0c726a8c tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] [instance: 5fa482da-0cca-4e1c-9724-e4d5ee9d73fa] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:53:48.474211 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-dec8db20-ede6-4cc8-b5d7-72ab0c726a8c tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:53:48.475613 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-dec8db20-ede6-4cc8-b5d7-72ab0c726a8c tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:53:48.476589 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-dec8db20-ede6-4cc8-b5d7-72ab0c726a8c tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:53:48.477130 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-dec8db20-ede6-4cc8-b5d7-72ab0c726a8c tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:53:48.594912 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-2593945b-41a0-458c-9e01-f4954ec8cc84 tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:53:48.596105 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-2593945b-41a0-458c-9e01-f4954ec8cc84 tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] [instance: ee2271a7-8fab-4455-9c3b-32159f33ad03] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:53:48.602971 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-2593945b-41a0-458c-9e01-f4954ec8cc84 tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:53:48.603679 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-2593945b-41a0-458c-9e01-f4954ec8cc84 tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:53:48.604447 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-2593945b-41a0-458c-9e01-f4954ec8cc84 tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:53:48.605057 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-2593945b-41a0-458c-9e01-f4954ec8cc84 tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:53:48.614855 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-dec8db20-ede6-4cc8-b5d7-72ab0c726a8c tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b572a8f465048558fc969b85b2aec5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd85f2a57a0847debf5aaf81aab7a638', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:53:48.627665 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-dec8db20-ede6-4cc8-b5d7-72ab0c726a8c tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] 10.222.0.20 "GET /compute/v2.1/servers/5fa482da-0cca-4e1c-9724-e4d5ee9d73fa" status: 200 len: 1367 microversion: 2.1 time: 0.166074 Jul 06 13:53:48.629045 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 460/914] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:53:48 2022] GET /compute/v2.1/servers/5fa482da-0cca-4e1c-9724-e4d5ee9d73fa => generated 1367 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:53:48.642145 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-2593945b-41a0-458c-9e01-f4954ec8cc84 tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:53:48.642857 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-2593945b-41a0-458c-9e01-f4954ec8cc84 tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:53:48.643448 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.objects.instance [None req-2593945b-41a0-458c-9e01-f4954ec8cc84 tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Lazy-loading 'fault' on Instance uuid ee2271a7-8fab-4455-9c3b-32159f33ad03 {{(pid=124367) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 06 13:53:48.697319 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-2593945b-41a0-458c-9e01-f4954ec8cc84 tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32a8191b1c184c75b428579ace2da61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bf864bb1764452e8e3a6f0d5929da9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:53:48.704800 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-2593945b-41a0-458c-9e01-f4954ec8cc84 tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] 10.222.0.20 "GET /compute/v2.1/servers/ee2271a7-8fab-4455-9c3b-32159f33ad03" status: 200 len: 1184 microversion: 2.1 time: 0.113682 Jul 06 13:53:48.705392 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 455/915] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:53:48 2022] GET /compute/v2.1/servers/ee2271a7-8fab-4455-9c3b-32159f33ad03 => generated 1184 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 06 13:53:49.644159 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-4438950b-f431-4e98-b322-c954bf0bfb29 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Calling method '>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:53:49.644773 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-4438950b-f431-4e98-b322-c954bf0bfb29 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] [instance: 5fa482da-0cca-4e1c-9724-e4d5ee9d73fa] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:53:49.651945 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-4438950b-f431-4e98-b322-c954bf0bfb29 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:53:49.652398 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-4438950b-f431-4e98-b322-c954bf0bfb29 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:53:49.653195 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-4438950b-f431-4e98-b322-c954bf0bfb29 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:53:49.653641 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-4438950b-f431-4e98-b322-c954bf0bfb29 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:53:49.722153 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-aa5b1561-1297-4e11-a7d3-4d50bc0845f6 tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:53:49.723018 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-aa5b1561-1297-4e11-a7d3-4d50bc0845f6 tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] [instance: ee2271a7-8fab-4455-9c3b-32159f33ad03] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:53:49.730746 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-aa5b1561-1297-4e11-a7d3-4d50bc0845f6 tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:53:49.731199 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-aa5b1561-1297-4e11-a7d3-4d50bc0845f6 tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:53:49.731966 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-aa5b1561-1297-4e11-a7d3-4d50bc0845f6 tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:53:49.732399 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-aa5b1561-1297-4e11-a7d3-4d50bc0845f6 tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:53:49.747907 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.wsgi [None req-aa5b1561-1297-4e11-a7d3-4d50bc0845f6 tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] HTTP exception thrown: Instance ee2271a7-8fab-4455-9c3b-32159f33ad03 could not be found. Jul 06 13:53:49.749587 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-aa5b1561-1297-4e11-a7d3-4d50bc0845f6 tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Request method failure captured: Jul 06 13:53:49.749587 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: request: GET /compute/v2.1/servers/ee2271a7-8fab-4455-9c3b-32159f33ad03 HTTP/1.1 Jul 06 13:53:49.749587 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: Accept: application/json Jul 06 13:53:49.749587 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: Accept-Encoding: identity Jul 06 13:53:49.749587 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: Connection: close Jul 06 13:53:49.749587 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: Content-Length: 0 Jul 06 13:53:49.749587 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: Content-Type: application/json Jul 06 13:53:49.749587 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: Host: 10.222.0.20 Jul 06 13:53:49.749587 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: Openstack-System-Scope: None Jul 06 13:53:49.749587 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: User-Agent: python-urllib3/1.26.9 Jul 06 13:53:49.749587 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: X-Auth-Token: gAAAAABixZMbzmQPuLb9eh7_wXbVtplKuSudXuDoBzcGG0h6H9K75eus4_iB1ZFKy4bESIau_fZym9tMOHqvZk7NQzyFwFdJ9Jwex7NZc4b081tafcq6ScHtYips0bVDv_wr4GybhPEVGesDE24fRD-oc850BV4RrzVUwtUsD3NO364nPnk60A8 Jul 06 13:53:49.749587 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: X-Domain-Id: None Jul 06 13:53:49.749587 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: X-Domain-Name: None Jul 06 13:53:49.749587 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: X-Identity-Status: Confirmed Jul 06 13:53:49.749587 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: X-Is-Admin-Project: True Jul 06 13:53:49.749587 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: X-Project-Domain-Id: default Jul 06 13:53:49.749587 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: X-Project-Domain-Name: Default Jul 06 13:53:49.749587 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: X-Project-Id: 7bf864bb1764452e8e3a6f0d5929da9f Jul 06 13:53:49.749587 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: X-Project-Name: tempest-TestVolumeBootPattern-1396741004 Jul 06 13:53:49.749587 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: X-Role: reader,member Jul 06 13:53:49.749587 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: X-Roles: reader,member Jul 06 13:53:49.751254 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_7bf864bb1764452e8e3a6f0d5929da9f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/7bf864bb1764452e8e3a6f0d5929da9f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/7bf864bb1764452e8e3a6f0d5929da9f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/7bf864bb1764452e8e3a6f0d5929da9f"}]}] Jul 06 13:53:49.751254 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: X-Tenant: tempest-TestVolumeBootPattern-1396741004 Jul 06 13:53:49.751254 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: X-Tenant-Id: 7bf864bb1764452e8e3a6f0d5929da9f Jul 06 13:53:49.751254 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: X-Tenant-Name: tempest-TestVolumeBootPattern-1396741004 Jul 06 13:53:49.751254 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: X-User: tempest-TestVolumeBootPattern-1396741004-project Jul 06 13:53:49.751254 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: X-User-Domain-Id: default Jul 06 13:53:49.751254 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: X-User-Domain-Name: Default Jul 06 13:53:49.751254 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: X-User-Id: 32a8191b1c184c75b428579ace2da61c Jul 06 13:53:49.751254 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: X-User-Name: tempest-TestVolumeBootPattern-1396741004-project Jul 06 13:53:49.751254 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: method: > Jul 06 13:53:49.751254 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: exception: Instance ee2271a7-8fab-4455-9c3b-32159f33ad03 could not be found. Jul 06 13:53:49.751254 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: action_args: {'id': 'ee2271a7-8fab-4455-9c3b-32159f33ad03'} Jul 06 13:53:49.752051 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 06 13:53:49.752051 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 06 13:53:49.752051 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 06 13:53:49.752051 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 06 13:53:49.752051 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 06 13:53:49.752051 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 06 13:53:49.752051 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 06 13:53:49.752051 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 06 13:53:49.752051 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 06 13:53:49.752051 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 06 13:53:49.752051 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ee2271a7-8fab-4455-9c3b-32159f33ad03 could not be found. Jul 06 13:53:49.752051 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi Jul 06 13:53:49.752051 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 06 13:53:49.752051 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi Jul 06 13:53:49.752051 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 06 13:53:49.752051 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 06 13:53:49.752051 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 06 13:53:49.752051 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 06 13:53:49.752051 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 06 13:53:49.752051 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 06 13:53:49.753465 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 06 13:53:49.753465 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 06 13:53:49.753465 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 06 13:53:49.753465 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 06 13:53:49.753465 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 06 13:53:49.753465 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 06 13:53:49.753465 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 06 13:53:49.753465 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ee2271a7-8fab-4455-9c3b-32159f33ad03 could not be found. Jul 06 13:53:49.753465 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi Jul 06 13:53:49.753465 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 06 13:53:49.753465 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi Jul 06 13:53:49.753465 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 06 13:53:49.753465 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 06 13:53:49.753465 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 06 13:53:49.753465 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 06 13:53:49.753465 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 06 13:53:49.753465 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ee2271a7-8fab-4455-9c3b-32159f33ad03 could not be found. Jul 06 13:53:49.753465 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi Jul 06 13:53:49.755024 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-aa5b1561-1297-4e11-a7d3-4d50bc0845f6 tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Returning 404 to user: Instance ee2271a7-8fab-4455-9c3b-32159f33ad03 could not be found. {{(pid=124367) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 06 13:53:49.755024 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-aa5b1561-1297-4e11-a7d3-4d50bc0845f6 tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] 10.222.0.20 "GET /compute/v2.1/servers/ee2271a7-8fab-4455-9c3b-32159f33ad03" status: 404 len: 111 microversion: 2.1 time: 0.032743 Jul 06 13:53:49.755024 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 456/916] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:53:49 2022] GET /compute/v2.1/servers/ee2271a7-8fab-4455-9c3b-32159f33ad03 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 06 13:53:49.792185 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-4438950b-f431-4e98-b322-c954bf0bfb29 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b572a8f465048558fc969b85b2aec5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd85f2a57a0847debf5aaf81aab7a638', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:53:49.800001 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-4438950b-f431-4e98-b322-c954bf0bfb29 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] 10.222.0.20 "GET /compute/v2.1/servers/5fa482da-0cca-4e1c-9724-e4d5ee9d73fa" status: 200 len: 1367 microversion: 2.1 time: 0.159720 Jul 06 13:53:49.800568 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 461/917] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:53:49 2022] GET /compute/v2.1/servers/5fa482da-0cca-4e1c-9724-e4d5ee9d73fa => generated 1367 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:53:49.856045 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-a9f5fda7-f9d0-477c-a2ec-ff63641484e7 tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1752753659", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1950493681", "security_groups": [{"name": "tempest-secgroup-smoke-113773701"}], "block_device_mapping_v2": [{"uuid": "732d4d00-624a-4902-b655-7ce2bb16af77", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "6522e807-4f7f-4722-945c-07724b4eff64"}]}} {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 06 13:53:49.978034 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.network.neutron [None req-a9f5fda7-f9d0-477c-a2ec-ff63641484e7 tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] validate_networks() for [('6522e807-4f7f-4722-945c-07724b4eff64', None, None, None, None, None)] {{(pid=124367) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 06 13:53:50.321837 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG dbcounter [-] [124367] Writing DB stats nova_cell0:SELECT=2 {{(pid=124367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:53:50.341246 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG dbcounter [-] [124367] Writing DB stats nova_cell0:SELECT=6 {{(pid=124367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:53:50.403794 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.virt.hardware [None req-a9f5fda7-f9d0-477c-a2ec-ff63641484e7 tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Flavor limits 0:0:0 {{(pid=124367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 06 13:53:50.404021 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.virt.hardware [None req-a9f5fda7-f9d0-477c-a2ec-ff63641484e7 tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Image limits 0:0:0 {{(pid=124367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 06 13:53:50.404527 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.virt.hardware [None req-a9f5fda7-f9d0-477c-a2ec-ff63641484e7 tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Flavor pref 0:0:0 {{(pid=124367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 06 13:53:50.404959 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.virt.hardware [None req-a9f5fda7-f9d0-477c-a2ec-ff63641484e7 tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Image pref 0:0:0 {{(pid=124367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 06 13:53:50.405415 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.virt.hardware [None req-a9f5fda7-f9d0-477c-a2ec-ff63641484e7 tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 06 13:53:50.416178 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-a9f5fda7-f9d0-477c-a2ec-ff63641484e7 tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:53:50.416717 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-a9f5fda7-f9d0-477c-a2ec-ff63641484e7 tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:53:50.417576 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-a9f5fda7-f9d0-477c-a2ec-ff63641484e7 tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:53:50.418021 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-a9f5fda7-f9d0-477c-a2ec-ff63641484e7 tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:53:50.435617 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.quota [None req-a9f5fda7-f9d0-477c-a2ec-ff63641484e7 tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Getting quotas for project 7bf864bb1764452e8e3a6f0d5929da9f. Resources: {'instances', 'cores', 'ram'} {{(pid=124367) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 06 13:53:50.440371 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.quota [None req-a9f5fda7-f9d0-477c-a2ec-ff63641484e7 tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Getting quotas for user 32a8191b1c184c75b428579ace2da61c and project 7bf864bb1764452e8e3a6f0d5929da9f. Resources: {'instances', 'cores', 'ram'} {{(pid=124367) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 06 13:53:50.500733 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-a9f5fda7-f9d0-477c-a2ec-ff63641484e7 tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Going to run 1 instances... {{(pid=124367) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 06 13:53:50.502933 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-a9f5fda7-f9d0-477c-a2ec-ff63641484e7 tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] [instance: 9875fc3c-1cca-43d0-8856-2bc17d3f6eb7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='732d4d00-624a-4902-b655-7ce2bb16af77',volume_size=None,volume_type=None)] {{(pid=124367) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 06 13:53:50.639753 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-a9f5fda7-f9d0-477c-a2ec-ff63641484e7 tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.787556 Jul 06 13:53:50.641050 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 457/918] 10.222.0.20 () {60 vars in 1146 bytes} [Wed Jul 6 13:53:49 2022] POST /compute/v2.1/servers => generated 405 bytes in 789 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 06 13:53:50.650427 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-94285fef-6404-4d42-9317-c871f42dcda5 tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Calling method '>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:53:50.651133 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-94285fef-6404-4d42-9317-c871f42dcda5 tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] [instance: 9875fc3c-1cca-43d0-8856-2bc17d3f6eb7] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:53:50.731710 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-94285fef-6404-4d42-9317-c871f42dcda5 tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32a8191b1c184c75b428579ace2da61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bf864bb1764452e8e3a6f0d5929da9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:53:50.738485 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-94285fef-6404-4d42-9317-c871f42dcda5 tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] 10.222.0.20 "GET /compute/v2.1/servers/9875fc3c-1cca-43d0-8856-2bc17d3f6eb7" status: 200 len: 1095 microversion: 2.1 time: 0.091877 Jul 06 13:53:50.739149 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 462/919] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:53:50 2022] GET /compute/v2.1/servers/9875fc3c-1cca-43d0-8856-2bc17d3f6eb7 => generated 1095 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:53:50.796821 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [req-9e6f38c9-892d-40d8-9fd1-af33c7fd26bf req-eabba8a8-1302-4e2e-9925-3b301f637921 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5fa482da-0cca-4e1c-9724-e4d5ee9d73fa", "name": "network-vif-plugged", "status": "completed", "tag": "ff54c39f-c144-43d9-b98e-674c20269a43"}]} {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 06 13:53:50.807705 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [req-9e6f38c9-892d-40d8-9fd1-af33c7fd26bf req-eabba8a8-1302-4e2e-9925-3b301f637921 service nova] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:53:50.808248 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [req-9e6f38c9-892d-40d8-9fd1-af33c7fd26bf req-eabba8a8-1302-4e2e-9925-3b301f637921 service nova] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:53:50.818451 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-517d1813-a81d-4886-8115-753cda13f630 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Calling method '>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:53:50.819510 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-517d1813-a81d-4886-8115-753cda13f630 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] [instance: 5fa482da-0cca-4e1c-9724-e4d5ee9d73fa] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:53:50.825965 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.compute.server_external_events [req-9e6f38c9-892d-40d8-9fd1-af33c7fd26bf req-eabba8a8-1302-4e2e-9925-3b301f637921 service nova] Creating event network-vif-plugged:ff54c39f-c144-43d9-b98e-674c20269a43 for instance 5fa482da-0cca-4e1c-9724-e4d5ee9d73fa on hv-cinder-81914 Jul 06 13:53:50.827273 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-517d1813-a81d-4886-8115-753cda13f630 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:53:50.827960 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-517d1813-a81d-4886-8115-753cda13f630 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:53:50.829110 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-517d1813-a81d-4886-8115-753cda13f630 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:53:50.829789 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-517d1813-a81d-4886-8115-753cda13f630 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:53:50.832062 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [req-9e6f38c9-892d-40d8-9fd1-af33c7fd26bf req-eabba8a8-1302-4e2e-9925-3b301f637921 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039205 Jul 06 13:53:50.833405 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 458/920] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 6 13:53:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 06 13:53:51.000271 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-517d1813-a81d-4886-8115-753cda13f630 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b572a8f465048558fc969b85b2aec5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd85f2a57a0847debf5aaf81aab7a638', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:53:51.008057 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-517d1813-a81d-4886-8115-753cda13f630 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] 10.222.0.20 "GET /compute/v2.1/servers/5fa482da-0cca-4e1c-9724-e4d5ee9d73fa" status: 200 len: 1367 microversion: 2.1 time: 0.194765 Jul 06 13:53:51.008755 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 463/921] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:53:50 2022] GET /compute/v2.1/servers/5fa482da-0cca-4e1c-9724-e4d5ee9d73fa => generated 1367 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 06 13:53:51.756703 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-74c95326-127d-4857-8c08-9638d27483e2 tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:53:51.757394 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-74c95326-127d-4857-8c08-9638d27483e2 tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] [instance: 9875fc3c-1cca-43d0-8856-2bc17d3f6eb7] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:53:51.763516 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-74c95326-127d-4857-8c08-9638d27483e2 tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:53:51.763958 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-74c95326-127d-4857-8c08-9638d27483e2 tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:53:51.764710 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-74c95326-127d-4857-8c08-9638d27483e2 tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:53:51.765174 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-74c95326-127d-4857-8c08-9638d27483e2 tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:53:51.829439 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-74c95326-127d-4857-8c08-9638d27483e2 tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32a8191b1c184c75b428579ace2da61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bf864bb1764452e8e3a6f0d5929da9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:53:51.837491 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-74c95326-127d-4857-8c08-9638d27483e2 tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] 10.222.0.20 "GET /compute/v2.1/servers/9875fc3c-1cca-43d0-8856-2bc17d3f6eb7" status: 200 len: 1193 microversion: 2.1 time: 0.085545 Jul 06 13:53:51.838044 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 459/922] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:53:51 2022] GET /compute/v2.1/servers/9875fc3c-1cca-43d0-8856-2bc17d3f6eb7 => generated 1193 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:53:52.025731 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-8053027a-d86e-4b28-a903-9dce0050d642 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Calling method '>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:53:52.026341 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-8053027a-d86e-4b28-a903-9dce0050d642 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] [instance: 5fa482da-0cca-4e1c-9724-e4d5ee9d73fa] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:53:52.032950 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-8053027a-d86e-4b28-a903-9dce0050d642 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:53:52.033430 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-8053027a-d86e-4b28-a903-9dce0050d642 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:53:52.034227 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-8053027a-d86e-4b28-a903-9dce0050d642 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:53:52.034660 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-8053027a-d86e-4b28-a903-9dce0050d642 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:53:52.165408 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-8053027a-d86e-4b28-a903-9dce0050d642 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b572a8f465048558fc969b85b2aec5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd85f2a57a0847debf5aaf81aab7a638', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:53:52.172859 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-8053027a-d86e-4b28-a903-9dce0050d642 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] 10.222.0.20 "GET /compute/v2.1/servers/5fa482da-0cca-4e1c-9724-e4d5ee9d73fa" status: 200 len: 1367 microversion: 2.1 time: 0.150998 Jul 06 13:53:52.173451 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 464/923] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:53:52 2022] GET /compute/v2.1/servers/5fa482da-0cca-4e1c-9724-e4d5ee9d73fa => generated 1367 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:53:52.854909 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-245f9956-5340-49c0-aba8-5b4272ace68b tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:53:52.855659 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-245f9956-5340-49c0-aba8-5b4272ace68b tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] [instance: 9875fc3c-1cca-43d0-8856-2bc17d3f6eb7] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:53:52.862160 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-245f9956-5340-49c0-aba8-5b4272ace68b tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:53:52.862615 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-245f9956-5340-49c0-aba8-5b4272ace68b tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:53:52.863388 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-245f9956-5340-49c0-aba8-5b4272ace68b tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:53:52.863822 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-245f9956-5340-49c0-aba8-5b4272ace68b tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:53:53.188714 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-245f9956-5340-49c0-aba8-5b4272ace68b tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32a8191b1c184c75b428579ace2da61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bf864bb1764452e8e3a6f0d5929da9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:53:53.197604 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-a7dd53a9-b6b1-4163-ada7-ae6e576de7fb tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Calling method '>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:53:53.199036 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-245f9956-5340-49c0-aba8-5b4272ace68b tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] 10.222.0.20 "GET /compute/v2.1/servers/9875fc3c-1cca-43d0-8856-2bc17d3f6eb7" status: 200 len: 1201 microversion: 2.1 time: 0.347009 Jul 06 13:53:53.199321 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-a7dd53a9-b6b1-4163-ada7-ae6e576de7fb tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] [instance: 5fa482da-0cca-4e1c-9724-e4d5ee9d73fa] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:53:53.199750 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 460/924] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:53:52 2022] GET /compute/v2.1/servers/9875fc3c-1cca-43d0-8856-2bc17d3f6eb7 => generated 1201 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 06 13:53:53.206037 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-a7dd53a9-b6b1-4163-ada7-ae6e576de7fb tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:53:53.206574 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-a7dd53a9-b6b1-4163-ada7-ae6e576de7fb tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:53:53.207370 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-a7dd53a9-b6b1-4163-ada7-ae6e576de7fb tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:53:53.207810 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-a7dd53a9-b6b1-4163-ada7-ae6e576de7fb tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:53:53.228587 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG dbcounter [-] [124368] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=124368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:53:53.351765 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-a7dd53a9-b6b1-4163-ada7-ae6e576de7fb tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b572a8f465048558fc969b85b2aec5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd85f2a57a0847debf5aaf81aab7a638', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:53:53.359208 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-a7dd53a9-b6b1-4163-ada7-ae6e576de7fb tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] 10.222.0.20 "GET /compute/v2.1/servers/5fa482da-0cca-4e1c-9724-e4d5ee9d73fa" status: 200 len: 1557 microversion: 2.1 time: 0.170979 Jul 06 13:53:53.359904 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 465/925] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:53:53 2022] GET /compute/v2.1/servers/5fa482da-0cca-4e1c-9724-e4d5ee9d73fa => generated 1557 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:53:53.376519 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-bc155262-dfb9-4b7b-bd8b-db876dac04c6 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:53:53.377117 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-bc155262-dfb9-4b7b-bd8b-db876dac04c6 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] [instance: 5fa482da-0cca-4e1c-9724-e4d5ee9d73fa] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:53:53.386559 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-bc155262-dfb9-4b7b-bd8b-db876dac04c6 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:53:53.387089 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-bc155262-dfb9-4b7b-bd8b-db876dac04c6 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:53:53.387968 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-bc155262-dfb9-4b7b-bd8b-db876dac04c6 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:53:53.388470 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-bc155262-dfb9-4b7b-bd8b-db876dac04c6 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:53:53.511458 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-bc155262-dfb9-4b7b-bd8b-db876dac04c6 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] 10.222.0.20 "GET /compute/v2.1/servers/5fa482da-0cca-4e1c-9724-e4d5ee9d73fa/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.138907 Jul 06 13:53:53.512047 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 461/926] 10.222.0.20 () {58 vars in 1274 bytes} [Wed Jul 6 13:53:53 2022] GET /compute/v2.1/servers/5fa482da-0cca-4e1c-9724-e4d5ee9d73fa/os-interface => generated 284 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 06 13:53:54.217462 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-9c753836-aed7-4911-b539-2f29d943947c tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Calling method '>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:53:54.218098 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-9c753836-aed7-4911-b539-2f29d943947c tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] [instance: 9875fc3c-1cca-43d0-8856-2bc17d3f6eb7] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:53:54.227174 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-9c753836-aed7-4911-b539-2f29d943947c tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:53:54.227632 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-9c753836-aed7-4911-b539-2f29d943947c tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:53:54.228658 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-9c753836-aed7-4911-b539-2f29d943947c tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:53:54.229340 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-9c753836-aed7-4911-b539-2f29d943947c tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:53:54.654767 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-9c753836-aed7-4911-b539-2f29d943947c tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32a8191b1c184c75b428579ace2da61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bf864bb1764452e8e3a6f0d5929da9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:53:54.664884 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-9c753836-aed7-4911-b539-2f29d943947c tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] 10.222.0.20 "GET /compute/v2.1/servers/9875fc3c-1cca-43d0-8856-2bc17d3f6eb7" status: 200 len: 1266 microversion: 2.1 time: 0.452301 Jul 06 13:53:54.665754 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 466/927] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:53:54 2022] GET /compute/v2.1/servers/9875fc3c-1cca-43d0-8856-2bc17d3f6eb7 => generated 1266 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:53:54.769850 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [req-a39aea52-7e3d-4a89-878a-f09aa083b65a req-645ee1ad-98ff-4456-9ab2-043b123a1102 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9875fc3c-1cca-43d0-8856-2bc17d3f6eb7", "tag": "e4a21c4c-d429-4422-94d4-fcf1670202ed"}]} {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 06 13:53:54.792473 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [req-a39aea52-7e3d-4a89-878a-f09aa083b65a req-645ee1ad-98ff-4456-9ab2-043b123a1102 service nova] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:53:54.795275 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [req-a39aea52-7e3d-4a89-878a-f09aa083b65a req-645ee1ad-98ff-4456-9ab2-043b123a1102 service nova] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:53:54.817455 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.compute.server_external_events [req-a39aea52-7e3d-4a89-878a-f09aa083b65a req-645ee1ad-98ff-4456-9ab2-043b123a1102 service nova] Creating event network-changed:e4a21c4c-d429-4422-94d4-fcf1670202ed for instance 9875fc3c-1cca-43d0-8856-2bc17d3f6eb7 on hv-cinder-81914 Jul 06 13:53:54.823159 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [req-a39aea52-7e3d-4a89-878a-f09aa083b65a req-645ee1ad-98ff-4456-9ab2-043b123a1102 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056916 Jul 06 13:53:54.824446 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 462/928] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 6 13:53:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 06 13:53:54.902329 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [req-cc61cd51-e478-459c-af50-bf1f7c7902b2 req-a153d1b2-0695-4060-830c-6ecb4d14723d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5fa482da-0cca-4e1c-9724-e4d5ee9d73fa", "tag": "ff54c39f-c144-43d9-b98e-674c20269a43"}]} {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 06 13:53:54.910726 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [req-cc61cd51-e478-459c-af50-bf1f7c7902b2 req-a153d1b2-0695-4060-830c-6ecb4d14723d service nova] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:53:54.911542 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [req-cc61cd51-e478-459c-af50-bf1f7c7902b2 req-a153d1b2-0695-4060-830c-6ecb4d14723d service nova] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:53:54.925194 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.compute.server_external_events [req-cc61cd51-e478-459c-af50-bf1f7c7902b2 req-a153d1b2-0695-4060-830c-6ecb4d14723d service nova] Creating event network-changed:ff54c39f-c144-43d9-b98e-674c20269a43 for instance 5fa482da-0cca-4e1c-9724-e4d5ee9d73fa on hv-cinder-81914 Jul 06 13:53:54.932501 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [req-cc61cd51-e478-459c-af50-bf1f7c7902b2 req-a153d1b2-0695-4060-830c-6ecb4d14723d service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033161 Jul 06 13:53:54.937853 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 467/929] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 6 13:53:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 06 13:53:55.683701 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-79c4edb9-a4d9-44f5-86ba-20144dad983d tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:53:55.684395 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-79c4edb9-a4d9-44f5-86ba-20144dad983d tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] [instance: 9875fc3c-1cca-43d0-8856-2bc17d3f6eb7] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:53:55.690760 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-79c4edb9-a4d9-44f5-86ba-20144dad983d tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:53:55.691211 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-79c4edb9-a4d9-44f5-86ba-20144dad983d tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:53:55.691968 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-79c4edb9-a4d9-44f5-86ba-20144dad983d tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:53:55.692403 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-79c4edb9-a4d9-44f5-86ba-20144dad983d tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:53:55.828481 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-79c4edb9-a4d9-44f5-86ba-20144dad983d tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32a8191b1c184c75b428579ace2da61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bf864bb1764452e8e3a6f0d5929da9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:53:55.836503 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-79c4edb9-a4d9-44f5-86ba-20144dad983d tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] 10.222.0.20 "GET /compute/v2.1/servers/9875fc3c-1cca-43d0-8856-2bc17d3f6eb7" status: 200 len: 1266 microversion: 2.1 time: 0.156866 Jul 06 13:53:55.837082 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 463/930] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:53:55 2022] GET /compute/v2.1/servers/9875fc3c-1cca-43d0-8856-2bc17d3f6eb7 => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 06 13:53:56.853545 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-ae8abd20-351a-4cad-b044-d7f67c5b7a84 tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Calling method '>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:53:56.854194 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-ae8abd20-351a-4cad-b044-d7f67c5b7a84 tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] [instance: 9875fc3c-1cca-43d0-8856-2bc17d3f6eb7] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:53:56.860501 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-ae8abd20-351a-4cad-b044-d7f67c5b7a84 tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:53:56.860958 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-ae8abd20-351a-4cad-b044-d7f67c5b7a84 tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:53:56.861754 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-ae8abd20-351a-4cad-b044-d7f67c5b7a84 tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:53:56.862196 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-ae8abd20-351a-4cad-b044-d7f67c5b7a84 tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:53:56.995042 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-ae8abd20-351a-4cad-b044-d7f67c5b7a84 tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32a8191b1c184c75b428579ace2da61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bf864bb1764452e8e3a6f0d5929da9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:53:57.002430 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-ae8abd20-351a-4cad-b044-d7f67c5b7a84 tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] 10.222.0.20 "GET /compute/v2.1/servers/9875fc3c-1cca-43d0-8856-2bc17d3f6eb7" status: 200 len: 1266 microversion: 2.1 time: 0.153893 Jul 06 13:53:57.002997 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 468/931] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:53:56 2022] GET /compute/v2.1/servers/9875fc3c-1cca-43d0-8856-2bc17d3f6eb7 => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:53:58.019473 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-7786acf4-62ab-457d-9ae8-2c262590e699 tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:53:58.020111 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-7786acf4-62ab-457d-9ae8-2c262590e699 tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] [instance: 9875fc3c-1cca-43d0-8856-2bc17d3f6eb7] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:53:58.023471 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG dbcounter [-] [124367] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=6 {{(pid=124367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:53:58.028965 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-7786acf4-62ab-457d-9ae8-2c262590e699 tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:53:58.029431 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-7786acf4-62ab-457d-9ae8-2c262590e699 tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:53:58.030196 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-7786acf4-62ab-457d-9ae8-2c262590e699 tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:53:58.030651 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-7786acf4-62ab-457d-9ae8-2c262590e699 tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:53:58.046377 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG dbcounter [-] [124367] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=124367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:53:58.168510 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-7786acf4-62ab-457d-9ae8-2c262590e699 tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32a8191b1c184c75b428579ace2da61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bf864bb1764452e8e3a6f0d5929da9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:53:58.176080 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-7786acf4-62ab-457d-9ae8-2c262590e699 tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] 10.222.0.20 "GET /compute/v2.1/servers/9875fc3c-1cca-43d0-8856-2bc17d3f6eb7" status: 200 len: 1266 microversion: 2.1 time: 0.160457 Jul 06 13:53:58.176652 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 464/932] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:53:58 2022] GET /compute/v2.1/servers/9875fc3c-1cca-43d0-8856-2bc17d3f6eb7 => generated 1266 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:53:59.192541 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-dd3181fe-360b-4b86-a407-0c89921de6af tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Calling method '>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:53:59.193246 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-dd3181fe-360b-4b86-a407-0c89921de6af tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] [instance: 9875fc3c-1cca-43d0-8856-2bc17d3f6eb7] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:53:59.199753 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-dd3181fe-360b-4b86-a407-0c89921de6af tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:53:59.200203 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-dd3181fe-360b-4b86-a407-0c89921de6af tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:53:59.200978 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-dd3181fe-360b-4b86-a407-0c89921de6af tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:53:59.201443 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-dd3181fe-360b-4b86-a407-0c89921de6af tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:53:59.334688 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-dd3181fe-360b-4b86-a407-0c89921de6af tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32a8191b1c184c75b428579ace2da61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bf864bb1764452e8e3a6f0d5929da9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:53:59.342201 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-dd3181fe-360b-4b86-a407-0c89921de6af tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] 10.222.0.20 "GET /compute/v2.1/servers/9875fc3c-1cca-43d0-8856-2bc17d3f6eb7" status: 200 len: 1266 microversion: 2.1 time: 0.153613 Jul 06 13:53:59.342763 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 469/933] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:53:59 2022] GET /compute/v2.1/servers/9875fc3c-1cca-43d0-8856-2bc17d3f6eb7 => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:54:00.359310 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-3aa0f7b5-8875-457c-a26f-0c471f077f76 tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:54:00.359950 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-3aa0f7b5-8875-457c-a26f-0c471f077f76 tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] [instance: 9875fc3c-1cca-43d0-8856-2bc17d3f6eb7] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:54:00.366692 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-3aa0f7b5-8875-457c-a26f-0c471f077f76 tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:54:00.367147 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-3aa0f7b5-8875-457c-a26f-0c471f077f76 tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:54:00.367911 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-3aa0f7b5-8875-457c-a26f-0c471f077f76 tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:54:00.368347 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-3aa0f7b5-8875-457c-a26f-0c471f077f76 tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:54:00.425556 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG dbcounter [-] [124367] Writing DB stats nova_cell0:SELECT=2 {{(pid=124367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:54:00.451571 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG dbcounter [-] [124367] Writing DB stats nova_cell0:SELECT=6 {{(pid=124367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:54:00.502780 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-3aa0f7b5-8875-457c-a26f-0c471f077f76 tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32a8191b1c184c75b428579ace2da61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bf864bb1764452e8e3a6f0d5929da9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:54:00.510229 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-3aa0f7b5-8875-457c-a26f-0c471f077f76 tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] 10.222.0.20 "GET /compute/v2.1/servers/9875fc3c-1cca-43d0-8856-2bc17d3f6eb7" status: 200 len: 1266 microversion: 2.1 time: 0.154907 Jul 06 13:54:00.510785 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 465/934] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:54:00 2022] GET /compute/v2.1/servers/9875fc3c-1cca-43d0-8856-2bc17d3f6eb7 => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:54:01.527361 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-b70e3158-d4c9-4fd6-9eb9-c8cd40199484 tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Calling method '>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:54:01.527979 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-b70e3158-d4c9-4fd6-9eb9-c8cd40199484 tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] [instance: 9875fc3c-1cca-43d0-8856-2bc17d3f6eb7] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:54:01.530393 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG dbcounter [-] [124368] Writing DB stats nova_cell0:SELECT=8 {{(pid=124368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:54:01.531196 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG dbcounter [-] [124368] Writing DB stats nova_api:SELECT=74,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=124368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:54:01.536769 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-b70e3158-d4c9-4fd6-9eb9-c8cd40199484 tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:54:01.537246 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-b70e3158-d4c9-4fd6-9eb9-c8cd40199484 tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:54:01.538089 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-b70e3158-d4c9-4fd6-9eb9-c8cd40199484 tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:54:01.538524 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-b70e3158-d4c9-4fd6-9eb9-c8cd40199484 tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:54:01.670101 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-b70e3158-d4c9-4fd6-9eb9-c8cd40199484 tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32a8191b1c184c75b428579ace2da61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bf864bb1764452e8e3a6f0d5929da9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:54:01.677744 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-b70e3158-d4c9-4fd6-9eb9-c8cd40199484 tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] 10.222.0.20 "GET /compute/v2.1/servers/9875fc3c-1cca-43d0-8856-2bc17d3f6eb7" status: 200 len: 1266 microversion: 2.1 time: 0.154980 Jul 06 13:54:01.679065 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 470/935] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:54:01 2022] GET /compute/v2.1/servers/9875fc3c-1cca-43d0-8856-2bc17d3f6eb7 => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:54:02.694798 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-abb1b7c1-733a-45a0-a4a6-c0ce13eeafc8 tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:54:02.695356 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-abb1b7c1-733a-45a0-a4a6-c0ce13eeafc8 tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] [instance: 9875fc3c-1cca-43d0-8856-2bc17d3f6eb7] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:54:02.701724 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-abb1b7c1-733a-45a0-a4a6-c0ce13eeafc8 tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:54:02.702175 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-abb1b7c1-733a-45a0-a4a6-c0ce13eeafc8 tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:54:02.702935 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-abb1b7c1-733a-45a0-a4a6-c0ce13eeafc8 tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:54:02.703370 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-abb1b7c1-733a-45a0-a4a6-c0ce13eeafc8 tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:54:02.832879 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-abb1b7c1-733a-45a0-a4a6-c0ce13eeafc8 tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32a8191b1c184c75b428579ace2da61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bf864bb1764452e8e3a6f0d5929da9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:54:02.841047 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-abb1b7c1-733a-45a0-a4a6-c0ce13eeafc8 tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] 10.222.0.20 "GET /compute/v2.1/servers/9875fc3c-1cca-43d0-8856-2bc17d3f6eb7" status: 200 len: 1266 microversion: 2.1 time: 0.150842 Jul 06 13:54:02.841607 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 466/936] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:54:02 2022] GET /compute/v2.1/servers/9875fc3c-1cca-43d0-8856-2bc17d3f6eb7 => generated 1266 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:54:03.857835 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-db47484b-ba65-459f-a842-4b7716a7955d tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Calling method '>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:54:03.858477 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-db47484b-ba65-459f-a842-4b7716a7955d tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] [instance: 9875fc3c-1cca-43d0-8856-2bc17d3f6eb7] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:54:03.864979 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-db47484b-ba65-459f-a842-4b7716a7955d tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:54:03.865476 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-db47484b-ba65-459f-a842-4b7716a7955d tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:54:03.866361 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-db47484b-ba65-459f-a842-4b7716a7955d tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:54:03.866808 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-db47484b-ba65-459f-a842-4b7716a7955d tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:54:04.000872 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-db47484b-ba65-459f-a842-4b7716a7955d tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32a8191b1c184c75b428579ace2da61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bf864bb1764452e8e3a6f0d5929da9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:54:04.008356 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-db47484b-ba65-459f-a842-4b7716a7955d tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] 10.222.0.20 "GET /compute/v2.1/servers/9875fc3c-1cca-43d0-8856-2bc17d3f6eb7" status: 200 len: 1266 microversion: 2.1 time: 0.154374 Jul 06 13:54:04.008911 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 471/937] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:54:03 2022] GET /compute/v2.1/servers/9875fc3c-1cca-43d0-8856-2bc17d3f6eb7 => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:54:05.024654 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-4d6d02af-8425-4ad7-a387-dbd53b38393e tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:54:05.025284 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-4d6d02af-8425-4ad7-a387-dbd53b38393e tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] [instance: 9875fc3c-1cca-43d0-8856-2bc17d3f6eb7] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:54:05.031855 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-4d6d02af-8425-4ad7-a387-dbd53b38393e tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:54:05.032308 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-4d6d02af-8425-4ad7-a387-dbd53b38393e tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:54:05.033112 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-4d6d02af-8425-4ad7-a387-dbd53b38393e tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:54:05.033548 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-4d6d02af-8425-4ad7-a387-dbd53b38393e tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:54:05.172021 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-4d6d02af-8425-4ad7-a387-dbd53b38393e tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32a8191b1c184c75b428579ace2da61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bf864bb1764452e8e3a6f0d5929da9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:54:05.181656 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-4d6d02af-8425-4ad7-a387-dbd53b38393e tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] 10.222.0.20 "GET /compute/v2.1/servers/9875fc3c-1cca-43d0-8856-2bc17d3f6eb7" status: 200 len: 1266 microversion: 2.1 time: 0.160942 Jul 06 13:54:05.182317 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 467/938] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:54:05 2022] GET /compute/v2.1/servers/9875fc3c-1cca-43d0-8856-2bc17d3f6eb7 => generated 1266 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:54:06.198324 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-06847185-c934-4d8c-8285-fa74e24fa152 tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Calling method '>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:54:06.198971 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-06847185-c934-4d8c-8285-fa74e24fa152 tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] [instance: 9875fc3c-1cca-43d0-8856-2bc17d3f6eb7] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:54:06.205624 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-06847185-c934-4d8c-8285-fa74e24fa152 tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:54:06.206080 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-06847185-c934-4d8c-8285-fa74e24fa152 tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:54:06.206853 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-06847185-c934-4d8c-8285-fa74e24fa152 tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:54:06.207294 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-06847185-c934-4d8c-8285-fa74e24fa152 tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:54:06.344008 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-06847185-c934-4d8c-8285-fa74e24fa152 tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32a8191b1c184c75b428579ace2da61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bf864bb1764452e8e3a6f0d5929da9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:54:06.352260 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-06847185-c934-4d8c-8285-fa74e24fa152 tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] 10.222.0.20 "GET /compute/v2.1/servers/9875fc3c-1cca-43d0-8856-2bc17d3f6eb7" status: 200 len: 1266 microversion: 2.1 time: 0.157789 Jul 06 13:54:06.352832 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 472/939] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:54:06 2022] GET /compute/v2.1/servers/9875fc3c-1cca-43d0-8856-2bc17d3f6eb7 => generated 1266 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:54:06.875658 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [req-1739a4b7-a8ad-441a-a13f-52899fd3a680 req-fe3be4fd-cfc8-4e2e-862e-bbd456bcaef5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9875fc3c-1cca-43d0-8856-2bc17d3f6eb7", "name": "network-vif-plugged", "status": "completed", "tag": "e4a21c4c-d429-4422-94d4-fcf1670202ed"}]} {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 06 13:54:06.886359 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [req-1739a4b7-a8ad-441a-a13f-52899fd3a680 req-fe3be4fd-cfc8-4e2e-862e-bbd456bcaef5 service nova] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:54:06.886804 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [req-1739a4b7-a8ad-441a-a13f-52899fd3a680 req-fe3be4fd-cfc8-4e2e-862e-bbd456bcaef5 service nova] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:54:06.899134 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.compute.server_external_events [req-1739a4b7-a8ad-441a-a13f-52899fd3a680 req-fe3be4fd-cfc8-4e2e-862e-bbd456bcaef5 service nova] Creating event network-vif-plugged:e4a21c4c-d429-4422-94d4-fcf1670202ed for instance 9875fc3c-1cca-43d0-8856-2bc17d3f6eb7 on hv-cinder-81914 Jul 06 13:54:06.904100 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [req-1739a4b7-a8ad-441a-a13f-52899fd3a680 req-fe3be4fd-cfc8-4e2e-862e-bbd456bcaef5 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032124 Jul 06 13:54:06.904697 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 468/940] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 6 13:54:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 06 13:54:07.369485 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-60b393e9-3193-4a9d-85c9-e21807214f20 tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Calling method '>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:54:07.370038 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-60b393e9-3193-4a9d-85c9-e21807214f20 tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] [instance: 9875fc3c-1cca-43d0-8856-2bc17d3f6eb7] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:54:07.376490 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-60b393e9-3193-4a9d-85c9-e21807214f20 tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:54:07.376939 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-60b393e9-3193-4a9d-85c9-e21807214f20 tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:54:07.377738 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-60b393e9-3193-4a9d-85c9-e21807214f20 tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:54:07.378175 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-60b393e9-3193-4a9d-85c9-e21807214f20 tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:54:07.510125 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-60b393e9-3193-4a9d-85c9-e21807214f20 tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32a8191b1c184c75b428579ace2da61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bf864bb1764452e8e3a6f0d5929da9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:54:07.517512 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-60b393e9-3193-4a9d-85c9-e21807214f20 tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] 10.222.0.20 "GET /compute/v2.1/servers/9875fc3c-1cca-43d0-8856-2bc17d3f6eb7" status: 200 len: 1266 microversion: 2.1 time: 0.152978 Jul 06 13:54:07.518074 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 473/941] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:54:07 2022] GET /compute/v2.1/servers/9875fc3c-1cca-43d0-8856-2bc17d3f6eb7 => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:54:08.534760 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-cab40a04-4e15-4351-80dd-3ed02e4d30a1 tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:54:08.535444 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-cab40a04-4e15-4351-80dd-3ed02e4d30a1 tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] [instance: 9875fc3c-1cca-43d0-8856-2bc17d3f6eb7] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:54:08.542077 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-cab40a04-4e15-4351-80dd-3ed02e4d30a1 tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:54:08.542523 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-cab40a04-4e15-4351-80dd-3ed02e4d30a1 tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:54:08.543271 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-cab40a04-4e15-4351-80dd-3ed02e4d30a1 tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:54:08.543699 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-cab40a04-4e15-4351-80dd-3ed02e4d30a1 tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:54:08.679062 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-cab40a04-4e15-4351-80dd-3ed02e4d30a1 tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32a8191b1c184c75b428579ace2da61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bf864bb1764452e8e3a6f0d5929da9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:54:08.687416 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-cab40a04-4e15-4351-80dd-3ed02e4d30a1 tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] 10.222.0.20 "GET /compute/v2.1/servers/9875fc3c-1cca-43d0-8856-2bc17d3f6eb7" status: 200 len: 1266 microversion: 2.1 time: 0.156852 Jul 06 13:54:08.687994 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 469/942] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:54:08 2022] GET /compute/v2.1/servers/9875fc3c-1cca-43d0-8856-2bc17d3f6eb7 => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:54:09.704450 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-539faa99-f65f-40f0-9aa9-f0b2ea5baeb4 tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Calling method '>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:54:09.704969 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-539faa99-f65f-40f0-9aa9-f0b2ea5baeb4 tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] [instance: 9875fc3c-1cca-43d0-8856-2bc17d3f6eb7] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:54:09.717014 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-539faa99-f65f-40f0-9aa9-f0b2ea5baeb4 tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:54:09.717489 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-539faa99-f65f-40f0-9aa9-f0b2ea5baeb4 tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:54:09.718264 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-539faa99-f65f-40f0-9aa9-f0b2ea5baeb4 tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:54:09.718708 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-539faa99-f65f-40f0-9aa9-f0b2ea5baeb4 tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:54:09.852203 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-539faa99-f65f-40f0-9aa9-f0b2ea5baeb4 tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32a8191b1c184c75b428579ace2da61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bf864bb1764452e8e3a6f0d5929da9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:54:09.859707 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-539faa99-f65f-40f0-9aa9-f0b2ea5baeb4 tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] 10.222.0.20 "GET /compute/v2.1/servers/9875fc3c-1cca-43d0-8856-2bc17d3f6eb7" status: 200 len: 1454 microversion: 2.1 time: 0.159316 Jul 06 13:54:09.860272 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 474/943] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:54:09 2022] GET /compute/v2.1/servers/9875fc3c-1cca-43d0-8856-2bc17d3f6eb7 => generated 1454 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:54:09.875514 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-b453c749-6813-4313-bbd0-64f85a3fc1f6 tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:54:09.876120 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-b453c749-6813-4313-bbd0-64f85a3fc1f6 tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] [instance: 9875fc3c-1cca-43d0-8856-2bc17d3f6eb7] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:54:09.882909 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-b453c749-6813-4313-bbd0-64f85a3fc1f6 tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:54:09.883353 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-b453c749-6813-4313-bbd0-64f85a3fc1f6 tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:54:09.884108 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-b453c749-6813-4313-bbd0-64f85a3fc1f6 tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:54:09.884537 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-b453c749-6813-4313-bbd0-64f85a3fc1f6 tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:54:10.026188 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-b453c749-6813-4313-bbd0-64f85a3fc1f6 tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32a8191b1c184c75b428579ace2da61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bf864bb1764452e8e3a6f0d5929da9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:54:10.033599 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-b453c749-6813-4313-bbd0-64f85a3fc1f6 tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] 10.222.0.20 "GET /compute/v2.1/servers/9875fc3c-1cca-43d0-8856-2bc17d3f6eb7" status: 200 len: 1454 microversion: 2.1 time: 0.161840 Jul 06 13:54:10.034161 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 470/944] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:54:09 2022] GET /compute/v2.1/servers/9875fc3c-1cca-43d0-8856-2bc17d3f6eb7 => generated 1454 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:54:11.853510 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [req-acfc57da-3d0e-4088-b2f0-d9751f79f7eb req-67905c59-4391-4e2b-9e64-22973b4189ee service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9875fc3c-1cca-43d0-8856-2bc17d3f6eb7", "tag": "e4a21c4c-d429-4422-94d4-fcf1670202ed"}]} {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 06 13:54:11.861792 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [req-acfc57da-3d0e-4088-b2f0-d9751f79f7eb req-67905c59-4391-4e2b-9e64-22973b4189ee service nova] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:54:11.862231 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [req-acfc57da-3d0e-4088-b2f0-d9751f79f7eb req-67905c59-4391-4e2b-9e64-22973b4189ee service nova] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:54:11.874111 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.compute.server_external_events [req-acfc57da-3d0e-4088-b2f0-d9751f79f7eb req-67905c59-4391-4e2b-9e64-22973b4189ee service nova] Creating event network-changed:e4a21c4c-d429-4422-94d4-fcf1670202ed for instance 9875fc3c-1cca-43d0-8856-2bc17d3f6eb7 on hv-cinder-81914 Jul 06 13:54:11.879038 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [req-acfc57da-3d0e-4088-b2f0-d9751f79f7eb req-67905c59-4391-4e2b-9e64-22973b4189ee service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030824 Jul 06 13:54:11.879643 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 475/945] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 6 13:54:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 06 13:54:58.410413 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-8dd755aa-c69c-4a9f-bedc-43117898b2e4 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:54:58.410962 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-8dd755aa-c69c-4a9f-bedc-43117898b2e4 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] [instance: be6603c1-852c-4efc-8442-14b7228cf3d0] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:54:58.413028 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG dbcounter [-] [124367] Writing DB stats nova_api:SELECT=13 {{(pid=124367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:54:58.413790 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG dbcounter [-] [124367] Writing DB stats nova_cell1:SELECT=35 {{(pid=124367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:54:58.421036 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-8dd755aa-c69c-4a9f-bedc-43117898b2e4 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:54:58.421488 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-8dd755aa-c69c-4a9f-bedc-43117898b2e4 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:54:58.422257 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-8dd755aa-c69c-4a9f-bedc-43117898b2e4 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:54:58.422694 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-8dd755aa-c69c-4a9f-bedc-43117898b2e4 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:54:58.446070 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-8dd755aa-c69c-4a9f-bedc-43117898b2e4 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] 10.222.0.20 "GET /compute/v2.1/servers/be6603c1-852c-4efc-8442-14b7228cf3d0/ips" status: 200 len: 146 microversion: 2.1 time: 0.039679 Jul 06 13:54:58.446632 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 471/946] 10.222.0.20 () {58 vars in 1247 bytes} [Wed Jul 6 13:54:58 2022] GET /compute/v2.1/servers/be6603c1-852c-4efc-8442-14b7228cf3d0/ips => generated 146 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 06 13:54:59.757857 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG dbcounter [-] [124368] Writing DB stats nova_api:SELECT=11 {{(pid=124368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:54:59.758593 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG dbcounter [-] [124368] Writing DB stats nova_cell1:SELECT=54 {{(pid=124368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:54:59.762832 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-a6f29176-71d0-4cba-95cb-97a379c55a7d tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b9a0e289-9630-4a9c-97e6-1ec413fe9c68"}} {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 06 13:54:59.763972 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-a6f29176-71d0-4cba-95cb-97a379c55a7d tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] [instance: be6603c1-852c-4efc-8442-14b7228cf3d0] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:54:59.770808 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-a6f29176-71d0-4cba-95cb-97a379c55a7d tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:54:59.771259 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-a6f29176-71d0-4cba-95cb-97a379c55a7d tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:54:59.772019 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-a6f29176-71d0-4cba-95cb-97a379c55a7d tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:54:59.772455 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-a6f29176-71d0-4cba-95cb-97a379c55a7d tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:55:00.036614 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-a6f29176-71d0-4cba-95cb-97a379c55a7d tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] 10.222.0.20 "POST /compute/v2.1/servers/be6603c1-852c-4efc-8442-14b7228cf3d0/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.280260 Jul 06 13:55:00.037292 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 476/947] 10.222.0.20 () {60 vars in 1322 bytes} [Wed Jul 6 13:54:59 2022] POST /compute/v2.1/servers/be6603c1-852c-4efc-8442-14b7228cf3d0/os-volume_attachments => generated 194 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 06 13:55:01.482588 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-895c6112-fe15-4cfc-b5b1-e063c95c7704 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:55:01.483105 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-895c6112-fe15-4cfc-b5b1-e063c95c7704 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] [instance: 4c0c4bb6-269f-46bc-b460-7d0299277753] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:55:01.488905 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-895c6112-fe15-4cfc-b5b1-e063c95c7704 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:55:01.489380 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-895c6112-fe15-4cfc-b5b1-e063c95c7704 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:55:01.490132 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-895c6112-fe15-4cfc-b5b1-e063c95c7704 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:55:01.490560 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-895c6112-fe15-4cfc-b5b1-e063c95c7704 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:55:01.515125 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-895c6112-fe15-4cfc-b5b1-e063c95c7704 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] 10.222.0.20 "GET /compute/v2.1/servers/4c0c4bb6-269f-46bc-b460-7d0299277753/ips" status: 200 len: 151 microversion: 2.20 time: 0.037232 Jul 06 13:55:01.515679 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 472/948] 10.222.0.20 () {60 vars in 1288 bytes} [Wed Jul 6 13:55:01 2022] GET /compute/v2.1/servers/4c0c4bb6-269f-46bc-b460-7d0299277753/ips => generated 151 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 06 13:55:03.317680 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-ab22972f-60e6-4ac1-9ffa-38f34b5e6b5f tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 06 13:55:03.318371 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-ab22972f-60e6-4ac1-9ffa-38f34b5e6b5f tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] [instance: 4c0c4bb6-269f-46bc-b460-7d0299277753] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:55:03.324644 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-ab22972f-60e6-4ac1-9ffa-38f34b5e6b5f tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:55:03.325139 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-ab22972f-60e6-4ac1-9ffa-38f34b5e6b5f tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:55:03.325912 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-ab22972f-60e6-4ac1-9ffa-38f34b5e6b5f tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:55:03.326358 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-ab22972f-60e6-4ac1-9ffa-38f34b5e6b5f tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:55:03.351995 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.objects.instance [None req-ab22972f-60e6-4ac1-9ffa-38f34b5e6b5f tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lazy-loading 'flavor' on Instance uuid 4c0c4bb6-269f-46bc-b460-7d0299277753 {{(pid=124368) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 06 13:55:03.612145 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-ab22972f-60e6-4ac1-9ffa-38f34b5e6b5f tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] 10.222.0.20 "POST /compute/v2.1/servers/4c0c4bb6-269f-46bc-b460-7d0299277753/action" status: 202 len: 0 microversion: 2.20 time: 0.299124 Jul 06 13:55:03.612962 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 477/949] 10.222.0.20 () {62 vars in 1318 bytes} [Wed Jul 6 13:55:03 2022] POST /compute/v2.1/servers/4c0c4bb6-269f-46bc-b460-7d0299277753/action => generated 0 bytes in 301 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 06 13:55:03.621577 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-81364e62-3223-4a69-bc3f-ed80ffdbf331 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:55:03.622181 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-81364e62-3223-4a69-bc3f-ed80ffdbf331 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] [instance: 4c0c4bb6-269f-46bc-b460-7d0299277753] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:55:03.629180 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-81364e62-3223-4a69-bc3f-ed80ffdbf331 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:55:03.629813 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-81364e62-3223-4a69-bc3f-ed80ffdbf331 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:55:03.630564 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-81364e62-3223-4a69-bc3f-ed80ffdbf331 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:55:03.631022 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-81364e62-3223-4a69-bc3f-ed80ffdbf331 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:55:03.764819 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-81364e62-3223-4a69-bc3f-ed80ffdbf331 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c85251638bc64deca16008b696b11ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3edb8d53184b98b7055ffc145f186d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:55:03.772664 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-81364e62-3223-4a69-bc3f-ed80ffdbf331 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c85251638bc64deca16008b696b11ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3edb8d53184b98b7055ffc145f186d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:55:03.774219 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-81364e62-3223-4a69-bc3f-ed80ffdbf331 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c85251638bc64deca16008b696b11ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3edb8d53184b98b7055ffc145f186d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:55:03.775375 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-81364e62-3223-4a69-bc3f-ed80ffdbf331 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] 10.222.0.20 "GET /compute/v2.1/servers/4c0c4bb6-269f-46bc-b460-7d0299277753" status: 200 len: 1723 microversion: 2.20 time: 0.158141 Jul 06 13:55:03.775933 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 473/950] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 6 13:55:03 2022] GET /compute/v2.1/servers/4c0c4bb6-269f-46bc-b460-7d0299277753 => generated 1723 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 06 13:55:04.795798 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-18fa322b-b76f-4002-9359-0fa97ca061d4 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Calling method '>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:55:04.796522 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-18fa322b-b76f-4002-9359-0fa97ca061d4 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] [instance: 4c0c4bb6-269f-46bc-b460-7d0299277753] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:55:04.803050 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-18fa322b-b76f-4002-9359-0fa97ca061d4 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:55:04.803501 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-18fa322b-b76f-4002-9359-0fa97ca061d4 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:55:04.804267 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-18fa322b-b76f-4002-9359-0fa97ca061d4 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:55:04.804708 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-18fa322b-b76f-4002-9359-0fa97ca061d4 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:55:04.936706 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-18fa322b-b76f-4002-9359-0fa97ca061d4 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c85251638bc64deca16008b696b11ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3edb8d53184b98b7055ffc145f186d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:55:04.944559 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-18fa322b-b76f-4002-9359-0fa97ca061d4 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c85251638bc64deca16008b696b11ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3edb8d53184b98b7055ffc145f186d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:55:04.946090 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-18fa322b-b76f-4002-9359-0fa97ca061d4 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c85251638bc64deca16008b696b11ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3edb8d53184b98b7055ffc145f186d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:55:04.947234 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-18fa322b-b76f-4002-9359-0fa97ca061d4 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] 10.222.0.20 "GET /compute/v2.1/servers/4c0c4bb6-269f-46bc-b460-7d0299277753" status: 200 len: 1723 microversion: 2.20 time: 0.156650 Jul 06 13:55:04.947786 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 478/951] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 6 13:55:04 2022] GET /compute/v2.1/servers/4c0c4bb6-269f-46bc-b460-7d0299277753 => generated 1723 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 06 13:55:05.966206 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-a57d2a8d-dec2-4bb8-8815-e27b29c5fb8a tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:55:05.966884 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-a57d2a8d-dec2-4bb8-8815-e27b29c5fb8a tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] [instance: 4c0c4bb6-269f-46bc-b460-7d0299277753] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:55:05.973283 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-a57d2a8d-dec2-4bb8-8815-e27b29c5fb8a tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:55:05.973738 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-a57d2a8d-dec2-4bb8-8815-e27b29c5fb8a tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:55:05.974500 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-a57d2a8d-dec2-4bb8-8815-e27b29c5fb8a tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:55:05.974935 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-a57d2a8d-dec2-4bb8-8815-e27b29c5fb8a tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:55:06.102521 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-a57d2a8d-dec2-4bb8-8815-e27b29c5fb8a tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c85251638bc64deca16008b696b11ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3edb8d53184b98b7055ffc145f186d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:55:06.110498 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-a57d2a8d-dec2-4bb8-8815-e27b29c5fb8a tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c85251638bc64deca16008b696b11ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3edb8d53184b98b7055ffc145f186d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:55:06.112029 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-a57d2a8d-dec2-4bb8-8815-e27b29c5fb8a tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c85251638bc64deca16008b696b11ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3edb8d53184b98b7055ffc145f186d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:55:06.113204 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-a57d2a8d-dec2-4bb8-8815-e27b29c5fb8a tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] 10.222.0.20 "GET /compute/v2.1/servers/4c0c4bb6-269f-46bc-b460-7d0299277753" status: 200 len: 1723 microversion: 2.20 time: 0.151656 Jul 06 13:55:06.113762 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 474/952] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 6 13:55:05 2022] GET /compute/v2.1/servers/4c0c4bb6-269f-46bc-b460-7d0299277753 => generated 1723 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 06 13:55:07.131435 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-9be93289-0e6b-4ff4-9de8-0f1e0464e86f tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Calling method '>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:55:07.131974 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-9be93289-0e6b-4ff4-9de8-0f1e0464e86f tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] [instance: 4c0c4bb6-269f-46bc-b460-7d0299277753] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:55:07.138488 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-9be93289-0e6b-4ff4-9de8-0f1e0464e86f tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:55:07.138944 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-9be93289-0e6b-4ff4-9de8-0f1e0464e86f tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:55:07.139710 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-9be93289-0e6b-4ff4-9de8-0f1e0464e86f tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:55:07.140151 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-9be93289-0e6b-4ff4-9de8-0f1e0464e86f tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:55:07.267276 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-9be93289-0e6b-4ff4-9de8-0f1e0464e86f tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c85251638bc64deca16008b696b11ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3edb8d53184b98b7055ffc145f186d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:55:07.275178 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-9be93289-0e6b-4ff4-9de8-0f1e0464e86f tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c85251638bc64deca16008b696b11ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3edb8d53184b98b7055ffc145f186d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:55:07.276692 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-9be93289-0e6b-4ff4-9de8-0f1e0464e86f tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c85251638bc64deca16008b696b11ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3edb8d53184b98b7055ffc145f186d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:55:07.278996 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-9be93289-0e6b-4ff4-9de8-0f1e0464e86f tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] 10.222.0.20 "GET /compute/v2.1/servers/4c0c4bb6-269f-46bc-b460-7d0299277753" status: 200 len: 1723 microversion: 2.20 time: 0.151571 Jul 06 13:55:07.279553 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 479/953] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 6 13:55:07 2022] GET /compute/v2.1/servers/4c0c4bb6-269f-46bc-b460-7d0299277753 => generated 1723 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 06 13:55:07.519871 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-1731a754-74e8-4fd8-833b-35997f7312e9 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:55:07.520784 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-1731a754-74e8-4fd8-833b-35997f7312e9 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] [instance: be6603c1-852c-4efc-8442-14b7228cf3d0] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:55:07.527746 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-1731a754-74e8-4fd8-833b-35997f7312e9 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:55:07.528188 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-1731a754-74e8-4fd8-833b-35997f7312e9 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:55:07.528944 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-1731a754-74e8-4fd8-833b-35997f7312e9 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:55:07.529400 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-1731a754-74e8-4fd8-833b-35997f7312e9 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:55:07.557082 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-1731a754-74e8-4fd8-833b-35997f7312e9 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] 10.222.0.20 "GET /compute/v2.1/servers/be6603c1-852c-4efc-8442-14b7228cf3d0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041050 Jul 06 13:55:07.557618 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 475/954] 10.222.0.20 () {58 vars in 1301 bytes} [Wed Jul 6 13:55:07 2022] GET /compute/v2.1/servers/be6603c1-852c-4efc-8442-14b7228cf3d0/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 06 13:55:07.567351 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-6c4ab6b8-19a5-45a1-aa79-508413f4bf6c tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Calling method '>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:55:07.567854 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-6c4ab6b8-19a5-45a1-aa79-508413f4bf6c tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] [instance: be6603c1-852c-4efc-8442-14b7228cf3d0] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:55:07.574274 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-6c4ab6b8-19a5-45a1-aa79-508413f4bf6c tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:55:07.574831 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-6c4ab6b8-19a5-45a1-aa79-508413f4bf6c tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:55:07.575601 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-6c4ab6b8-19a5-45a1-aa79-508413f4bf6c tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:55:07.576044 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-6c4ab6b8-19a5-45a1-aa79-508413f4bf6c tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:55:07.604169 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-6c4ab6b8-19a5-45a1-aa79-508413f4bf6c tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] 10.222.0.20 "GET /compute/v2.1/servers/be6603c1-852c-4efc-8442-14b7228cf3d0/os-volume_attachments/b9a0e289-9630-4a9c-97e6-1ec413fe9c68" status: 200 len: 194 microversion: 2.1 time: 0.040775 Jul 06 13:55:07.604733 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 480/955] 10.222.0.20 () {58 vars in 1412 bytes} [Wed Jul 6 13:55:07 2022] GET /compute/v2.1/servers/be6603c1-852c-4efc-8442-14b7228cf3d0/os-volume_attachments/b9a0e289-9630-4a9c-97e6-1ec413fe9c68 => generated 194 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 06 13:55:08.297722 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-c7b2ff0f-672b-45af-acb1-870a34ee4393 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:55:08.298323 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-c7b2ff0f-672b-45af-acb1-870a34ee4393 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] [instance: 4c0c4bb6-269f-46bc-b460-7d0299277753] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:55:08.304672 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-c7b2ff0f-672b-45af-acb1-870a34ee4393 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:55:08.305151 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-c7b2ff0f-672b-45af-acb1-870a34ee4393 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:55:08.305906 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-c7b2ff0f-672b-45af-acb1-870a34ee4393 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:55:08.306331 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-c7b2ff0f-672b-45af-acb1-870a34ee4393 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:55:08.437690 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-c7b2ff0f-672b-45af-acb1-870a34ee4393 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c85251638bc64deca16008b696b11ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3edb8d53184b98b7055ffc145f186d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:55:08.445433 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-c7b2ff0f-672b-45af-acb1-870a34ee4393 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c85251638bc64deca16008b696b11ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3edb8d53184b98b7055ffc145f186d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:55:08.446920 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-c7b2ff0f-672b-45af-acb1-870a34ee4393 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c85251638bc64deca16008b696b11ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3edb8d53184b98b7055ffc145f186d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:55:08.448057 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-c7b2ff0f-672b-45af-acb1-870a34ee4393 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] 10.222.0.20 "GET /compute/v2.1/servers/4c0c4bb6-269f-46bc-b460-7d0299277753" status: 200 len: 1723 microversion: 2.20 time: 0.154317 Jul 06 13:55:08.448616 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 476/956] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 6 13:55:08 2022] GET /compute/v2.1/servers/4c0c4bb6-269f-46bc-b460-7d0299277753 => generated 1723 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 06 13:55:08.915998 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-8684d3a8-31a4-466f-b7d8-ac1a5f2a6bce tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "67e8529f-eb0b-49ed-a454-faecce5d792e"}} {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 06 13:55:08.917171 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-8684d3a8-31a4-466f-b7d8-ac1a5f2a6bce tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] [instance: be6603c1-852c-4efc-8442-14b7228cf3d0] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:55:08.924400 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-8684d3a8-31a4-466f-b7d8-ac1a5f2a6bce tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:55:08.924857 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-8684d3a8-31a4-466f-b7d8-ac1a5f2a6bce tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:55:08.925656 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-8684d3a8-31a4-466f-b7d8-ac1a5f2a6bce tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:55:08.926096 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-8684d3a8-31a4-466f-b7d8-ac1a5f2a6bce tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:55:09.186628 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-8684d3a8-31a4-466f-b7d8-ac1a5f2a6bce tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] 10.222.0.20 "POST /compute/v2.1/servers/be6603c1-852c-4efc-8442-14b7228cf3d0/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.274490 Jul 06 13:55:09.187408 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 481/957] 10.222.0.20 () {60 vars in 1322 bytes} [Wed Jul 6 13:55:08 2022] POST /compute/v2.1/servers/be6603c1-852c-4efc-8442-14b7228cf3d0/os-volume_attachments => generated 194 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 06 13:55:09.467138 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-1ee132d3-c262-4c7e-8e7a-1bac725ff892 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:55:09.467779 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-1ee132d3-c262-4c7e-8e7a-1bac725ff892 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] [instance: 4c0c4bb6-269f-46bc-b460-7d0299277753] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:55:09.474255 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-1ee132d3-c262-4c7e-8e7a-1bac725ff892 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:55:09.474707 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-1ee132d3-c262-4c7e-8e7a-1bac725ff892 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:55:09.475468 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-1ee132d3-c262-4c7e-8e7a-1bac725ff892 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:55:09.475927 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-1ee132d3-c262-4c7e-8e7a-1bac725ff892 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:55:09.603695 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-1ee132d3-c262-4c7e-8e7a-1bac725ff892 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c85251638bc64deca16008b696b11ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3edb8d53184b98b7055ffc145f186d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:55:09.612828 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-1ee132d3-c262-4c7e-8e7a-1bac725ff892 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c85251638bc64deca16008b696b11ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3edb8d53184b98b7055ffc145f186d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:55:09.614367 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-1ee132d3-c262-4c7e-8e7a-1bac725ff892 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c85251638bc64deca16008b696b11ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3edb8d53184b98b7055ffc145f186d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:55:09.615507 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-1ee132d3-c262-4c7e-8e7a-1bac725ff892 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] 10.222.0.20 "GET /compute/v2.1/servers/4c0c4bb6-269f-46bc-b460-7d0299277753" status: 200 len: 1723 microversion: 2.20 time: 0.152906 Jul 06 13:55:09.616059 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 477/958] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 6 13:55:09 2022] GET /compute/v2.1/servers/4c0c4bb6-269f-46bc-b460-7d0299277753 => generated 1723 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 06 13:55:10.634919 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-fead3226-c968-4979-a1c8-da65bd2148ae tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Calling method '>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:55:10.635523 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-fead3226-c968-4979-a1c8-da65bd2148ae tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] [instance: 4c0c4bb6-269f-46bc-b460-7d0299277753] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:55:10.642568 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-fead3226-c968-4979-a1c8-da65bd2148ae tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:55:10.643018 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-fead3226-c968-4979-a1c8-da65bd2148ae tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:55:10.643780 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-fead3226-c968-4979-a1c8-da65bd2148ae tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:55:10.644215 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-fead3226-c968-4979-a1c8-da65bd2148ae tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:55:10.778032 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-fead3226-c968-4979-a1c8-da65bd2148ae tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c85251638bc64deca16008b696b11ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3edb8d53184b98b7055ffc145f186d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:55:10.785890 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-fead3226-c968-4979-a1c8-da65bd2148ae tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c85251638bc64deca16008b696b11ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3edb8d53184b98b7055ffc145f186d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:55:10.787381 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-fead3226-c968-4979-a1c8-da65bd2148ae tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c85251638bc64deca16008b696b11ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3edb8d53184b98b7055ffc145f186d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:55:10.788528 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-fead3226-c968-4979-a1c8-da65bd2148ae tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] 10.222.0.20 "GET /compute/v2.1/servers/4c0c4bb6-269f-46bc-b460-7d0299277753" status: 200 len: 1723 microversion: 2.20 time: 0.157983 Jul 06 13:55:10.789089 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 482/959] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 6 13:55:10 2022] GET /compute/v2.1/servers/4c0c4bb6-269f-46bc-b460-7d0299277753 => generated 1723 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 06 13:55:11.807882 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-210180fd-39fd-4d6c-a515-aff4356d5df2 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:55:11.808435 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-210180fd-39fd-4d6c-a515-aff4356d5df2 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] [instance: 4c0c4bb6-269f-46bc-b460-7d0299277753] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:55:11.815008 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-210180fd-39fd-4d6c-a515-aff4356d5df2 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:55:11.815454 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-210180fd-39fd-4d6c-a515-aff4356d5df2 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:55:11.816206 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-210180fd-39fd-4d6c-a515-aff4356d5df2 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:55:11.816632 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-210180fd-39fd-4d6c-a515-aff4356d5df2 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:55:11.947092 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-210180fd-39fd-4d6c-a515-aff4356d5df2 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c85251638bc64deca16008b696b11ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3edb8d53184b98b7055ffc145f186d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:55:11.955739 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-210180fd-39fd-4d6c-a515-aff4356d5df2 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c85251638bc64deca16008b696b11ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3edb8d53184b98b7055ffc145f186d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:55:11.957272 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-210180fd-39fd-4d6c-a515-aff4356d5df2 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c85251638bc64deca16008b696b11ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3edb8d53184b98b7055ffc145f186d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:55:11.958458 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-210180fd-39fd-4d6c-a515-aff4356d5df2 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] 10.222.0.20 "GET /compute/v2.1/servers/4c0c4bb6-269f-46bc-b460-7d0299277753" status: 200 len: 1723 microversion: 2.20 time: 0.154614 Jul 06 13:55:11.963120 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 478/960] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 6 13:55:11 2022] GET /compute/v2.1/servers/4c0c4bb6-269f-46bc-b460-7d0299277753 => generated 1723 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 06 13:55:12.977477 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-9cde349e-1302-43e7-806a-8d5ff64c71c4 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Calling method '>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:55:12.978084 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-9cde349e-1302-43e7-806a-8d5ff64c71c4 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] [instance: 4c0c4bb6-269f-46bc-b460-7d0299277753] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:55:12.985047 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-9cde349e-1302-43e7-806a-8d5ff64c71c4 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:55:12.985499 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-9cde349e-1302-43e7-806a-8d5ff64c71c4 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:55:12.986256 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-9cde349e-1302-43e7-806a-8d5ff64c71c4 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:55:12.986691 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-9cde349e-1302-43e7-806a-8d5ff64c71c4 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:55:13.115532 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-9cde349e-1302-43e7-806a-8d5ff64c71c4 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c85251638bc64deca16008b696b11ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3edb8d53184b98b7055ffc145f186d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:55:13.123579 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-9cde349e-1302-43e7-806a-8d5ff64c71c4 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c85251638bc64deca16008b696b11ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3edb8d53184b98b7055ffc145f186d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:55:13.125105 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-9cde349e-1302-43e7-806a-8d5ff64c71c4 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c85251638bc64deca16008b696b11ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3edb8d53184b98b7055ffc145f186d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:55:13.126257 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-9cde349e-1302-43e7-806a-8d5ff64c71c4 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] 10.222.0.20 "GET /compute/v2.1/servers/4c0c4bb6-269f-46bc-b460-7d0299277753" status: 200 len: 1723 microversion: 2.20 time: 0.152673 Jul 06 13:55:13.127091 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 483/961] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 6 13:55:12 2022] GET /compute/v2.1/servers/4c0c4bb6-269f-46bc-b460-7d0299277753 => generated 1723 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 06 13:55:14.145101 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-9446d4fb-1340-4432-be44-32d364bd46c4 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:55:14.145743 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-9446d4fb-1340-4432-be44-32d364bd46c4 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] [instance: 4c0c4bb6-269f-46bc-b460-7d0299277753] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:55:14.152433 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-9446d4fb-1340-4432-be44-32d364bd46c4 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:55:14.152974 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-9446d4fb-1340-4432-be44-32d364bd46c4 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:55:14.153829 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-9446d4fb-1340-4432-be44-32d364bd46c4 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:55:14.154262 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-9446d4fb-1340-4432-be44-32d364bd46c4 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:55:14.286118 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-9446d4fb-1340-4432-be44-32d364bd46c4 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c85251638bc64deca16008b696b11ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3edb8d53184b98b7055ffc145f186d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:55:14.296613 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-9446d4fb-1340-4432-be44-32d364bd46c4 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c85251638bc64deca16008b696b11ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3edb8d53184b98b7055ffc145f186d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:55:14.297837 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-9446d4fb-1340-4432-be44-32d364bd46c4 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c85251638bc64deca16008b696b11ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3edb8d53184b98b7055ffc145f186d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:55:14.299011 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-9446d4fb-1340-4432-be44-32d364bd46c4 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] 10.222.0.20 "GET /compute/v2.1/servers/4c0c4bb6-269f-46bc-b460-7d0299277753" status: 200 len: 1723 microversion: 2.20 time: 0.157986 Jul 06 13:55:14.300129 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 479/962] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 6 13:55:14 2022] GET /compute/v2.1/servers/4c0c4bb6-269f-46bc-b460-7d0299277753 => generated 1723 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 06 13:55:15.317932 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-59f56bb5-128f-41be-a9c3-f75ef8d8ac46 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Calling method '>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:55:15.318547 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-59f56bb5-128f-41be-a9c3-f75ef8d8ac46 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] [instance: 4c0c4bb6-269f-46bc-b460-7d0299277753] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:55:15.326231 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-59f56bb5-128f-41be-a9c3-f75ef8d8ac46 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:55:15.326687 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-59f56bb5-128f-41be-a9c3-f75ef8d8ac46 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:55:15.327455 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-59f56bb5-128f-41be-a9c3-f75ef8d8ac46 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:55:15.327898 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-59f56bb5-128f-41be-a9c3-f75ef8d8ac46 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:55:15.459163 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-59f56bb5-128f-41be-a9c3-f75ef8d8ac46 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c85251638bc64deca16008b696b11ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3edb8d53184b98b7055ffc145f186d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:55:15.467039 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-59f56bb5-128f-41be-a9c3-f75ef8d8ac46 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c85251638bc64deca16008b696b11ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3edb8d53184b98b7055ffc145f186d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:55:15.468542 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-59f56bb5-128f-41be-a9c3-f75ef8d8ac46 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c85251638bc64deca16008b696b11ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3edb8d53184b98b7055ffc145f186d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:55:15.469715 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-59f56bb5-128f-41be-a9c3-f75ef8d8ac46 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] 10.222.0.20 "GET /compute/v2.1/servers/4c0c4bb6-269f-46bc-b460-7d0299277753" status: 200 len: 1744 microversion: 2.20 time: 0.155744 Jul 06 13:55:15.470264 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 484/963] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 6 13:55:15 2022] GET /compute/v2.1/servers/4c0c4bb6-269f-46bc-b460-7d0299277753 => generated 1744 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 06 13:55:16.488194 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-3a863c7f-f2b6-4bc0-9634-f62979e42ac2 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:55:16.488802 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-3a863c7f-f2b6-4bc0-9634-f62979e42ac2 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] [instance: 4c0c4bb6-269f-46bc-b460-7d0299277753] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:55:16.496705 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-3a863c7f-f2b6-4bc0-9634-f62979e42ac2 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:55:16.497224 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-3a863c7f-f2b6-4bc0-9634-f62979e42ac2 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:55:16.498004 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-3a863c7f-f2b6-4bc0-9634-f62979e42ac2 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:55:16.498444 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-3a863c7f-f2b6-4bc0-9634-f62979e42ac2 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:55:16.630755 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-3a863c7f-f2b6-4bc0-9634-f62979e42ac2 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c85251638bc64deca16008b696b11ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3edb8d53184b98b7055ffc145f186d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:55:16.638912 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-3a863c7f-f2b6-4bc0-9634-f62979e42ac2 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c85251638bc64deca16008b696b11ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3edb8d53184b98b7055ffc145f186d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:55:16.640491 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-3a863c7f-f2b6-4bc0-9634-f62979e42ac2 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c85251638bc64deca16008b696b11ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3edb8d53184b98b7055ffc145f186d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:55:16.641738 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-3a863c7f-f2b6-4bc0-9634-f62979e42ac2 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] 10.222.0.20 "GET /compute/v2.1/servers/4c0c4bb6-269f-46bc-b460-7d0299277753" status: 200 len: 1744 microversion: 2.20 time: 0.157630 Jul 06 13:55:16.642481 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 480/964] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 6 13:55:16 2022] GET /compute/v2.1/servers/4c0c4bb6-269f-46bc-b460-7d0299277753 => generated 1744 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 06 13:55:16.675227 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-1c1d49c1-5c48-482c-9507-0f8e1f50d015 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Calling method '>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:55:16.676151 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-1c1d49c1-5c48-482c-9507-0f8e1f50d015 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] [instance: be6603c1-852c-4efc-8442-14b7228cf3d0] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:55:16.682574 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-1c1d49c1-5c48-482c-9507-0f8e1f50d015 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:55:16.683021 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-1c1d49c1-5c48-482c-9507-0f8e1f50d015 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:55:16.684475 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-1c1d49c1-5c48-482c-9507-0f8e1f50d015 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:55:16.684916 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-1c1d49c1-5c48-482c-9507-0f8e1f50d015 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:55:16.713634 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-1c1d49c1-5c48-482c-9507-0f8e1f50d015 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] 10.222.0.20 "GET /compute/v2.1/servers/be6603c1-852c-4efc-8442-14b7228cf3d0/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042522 Jul 06 13:55:16.714178 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 485/965] 10.222.0.20 () {58 vars in 1301 bytes} [Wed Jul 6 13:55:16 2022] GET /compute/v2.1/servers/be6603c1-852c-4efc-8442-14b7228cf3d0/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 06 13:55:16.856283 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-214fecc2-00a2-4e1b-a154-5d8288883587 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:55:16.856696 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-214fecc2-00a2-4e1b-a154-5d8288883587 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] [instance: be6603c1-852c-4efc-8442-14b7228cf3d0] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:55:16.862934 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-214fecc2-00a2-4e1b-a154-5d8288883587 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:55:16.863410 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-214fecc2-00a2-4e1b-a154-5d8288883587 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:55:16.864225 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-214fecc2-00a2-4e1b-a154-5d8288883587 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:55:16.864709 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-214fecc2-00a2-4e1b-a154-5d8288883587 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:55:16.894778 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-214fecc2-00a2-4e1b-a154-5d8288883587 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] 10.222.0.20 "GET /compute/v2.1/servers/be6603c1-852c-4efc-8442-14b7228cf3d0/os-volume_attachments/b9a0e289-9630-4a9c-97e6-1ec413fe9c68" status: 200 len: 194 microversion: 2.1 time: 0.042553 Jul 06 13:55:16.895394 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 481/966] 10.222.0.20 () {58 vars in 1412 bytes} [Wed Jul 6 13:55:16 2022] GET /compute/v2.1/servers/be6603c1-852c-4efc-8442-14b7228cf3d0/os-volume_attachments/b9a0e289-9630-4a9c-97e6-1ec413fe9c68 => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 06 13:55:16.905718 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-8d512c79-f511-4ffa-be6c-eea1d3a540d0 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Calling method '>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:55:16.906241 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-8d512c79-f511-4ffa-be6c-eea1d3a540d0 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] [instance: be6603c1-852c-4efc-8442-14b7228cf3d0] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:55:16.912483 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-8d512c79-f511-4ffa-be6c-eea1d3a540d0 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:55:16.912942 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-8d512c79-f511-4ffa-be6c-eea1d3a540d0 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:55:16.913754 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-8d512c79-f511-4ffa-be6c-eea1d3a540d0 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:55:16.914220 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-8d512c79-f511-4ffa-be6c-eea1d3a540d0 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:55:16.995396 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.objects.instance [None req-8d512c79-f511-4ffa-be6c-eea1d3a540d0 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lazy-loading 'services' on Instance uuid be6603c1-852c-4efc-8442-14b7228cf3d0 {{(pid=124368) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 06 13:55:17.065417 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-8d512c79-f511-4ffa-be6c-eea1d3a540d0 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] 10.222.0.20 "DELETE /compute/v2.1/servers/be6603c1-852c-4efc-8442-14b7228cf3d0/os-volume_attachments/b9a0e289-9630-4a9c-97e6-1ec413fe9c68" status: 202 len: 0 microversion: 2.1 time: 0.163851 Jul 06 13:55:17.066190 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 486/967] 10.222.0.20 () {58 vars in 1415 bytes} [Wed Jul 6 13:55:16 2022] DELETE /compute/v2.1/servers/be6603c1-852c-4efc-8442-14b7228cf3d0/os-volume_attachments/b9a0e289-9630-4a9c-97e6-1ec413fe9c68 => generated 0 bytes in 165 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 06 13:55:17.665107 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-03c6ae89-bf0e-4049-bc73-436cdd9afafc tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:55:17.665704 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-03c6ae89-bf0e-4049-bc73-436cdd9afafc tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] [instance: 4c0c4bb6-269f-46bc-b460-7d0299277753] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:55:17.673209 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-03c6ae89-bf0e-4049-bc73-436cdd9afafc tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:55:17.673813 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-03c6ae89-bf0e-4049-bc73-436cdd9afafc tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:55:17.674866 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-03c6ae89-bf0e-4049-bc73-436cdd9afafc tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:55:17.675293 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-03c6ae89-bf0e-4049-bc73-436cdd9afafc tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:55:17.807449 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-03c6ae89-bf0e-4049-bc73-436cdd9afafc tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c85251638bc64deca16008b696b11ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3edb8d53184b98b7055ffc145f186d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:55:17.816270 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-03c6ae89-bf0e-4049-bc73-436cdd9afafc tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c85251638bc64deca16008b696b11ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3edb8d53184b98b7055ffc145f186d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:55:17.817807 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-03c6ae89-bf0e-4049-bc73-436cdd9afafc tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c85251638bc64deca16008b696b11ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3edb8d53184b98b7055ffc145f186d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:55:17.818949 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-03c6ae89-bf0e-4049-bc73-436cdd9afafc tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] 10.222.0.20 "GET /compute/v2.1/servers/4c0c4bb6-269f-46bc-b460-7d0299277753" status: 200 len: 1744 microversion: 2.20 time: 0.157839 Jul 06 13:55:17.819507 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 482/968] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 6 13:55:17 2022] GET /compute/v2.1/servers/4c0c4bb6-269f-46bc-b460-7d0299277753 => generated 1744 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 06 13:55:18.838924 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-ff9f1dec-1ff0-446b-b11f-ee84932f74e0 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Calling method '>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:55:18.839622 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-ff9f1dec-1ff0-446b-b11f-ee84932f74e0 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] [instance: 4c0c4bb6-269f-46bc-b460-7d0299277753] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:55:18.846398 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-ff9f1dec-1ff0-446b-b11f-ee84932f74e0 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:55:18.846850 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-ff9f1dec-1ff0-446b-b11f-ee84932f74e0 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:55:18.847603 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-ff9f1dec-1ff0-446b-b11f-ee84932f74e0 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:55:18.848036 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-ff9f1dec-1ff0-446b-b11f-ee84932f74e0 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:55:18.852132 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG dbcounter [-] [124368] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=6,nova_cell1:INSERT=4 {{(pid=124368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:55:18.977102 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-ff9f1dec-1ff0-446b-b11f-ee84932f74e0 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c85251638bc64deca16008b696b11ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3edb8d53184b98b7055ffc145f186d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:55:18.985537 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-ff9f1dec-1ff0-446b-b11f-ee84932f74e0 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c85251638bc64deca16008b696b11ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3edb8d53184b98b7055ffc145f186d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:55:18.987043 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-ff9f1dec-1ff0-446b-b11f-ee84932f74e0 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c85251638bc64deca16008b696b11ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3edb8d53184b98b7055ffc145f186d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:55:18.988193 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-ff9f1dec-1ff0-446b-b11f-ee84932f74e0 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] 10.222.0.20 "GET /compute/v2.1/servers/4c0c4bb6-269f-46bc-b460-7d0299277753" status: 200 len: 1744 microversion: 2.20 time: 0.153553 Jul 06 13:55:18.988772 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 487/969] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 6 13:55:18 2022] GET /compute/v2.1/servers/4c0c4bb6-269f-46bc-b460-7d0299277753 => generated 1744 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 06 13:55:19.233372 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [req-dffcc268-a02c-4c03-a58c-966fdfa8964c req-0eb61f1d-01f7-4cea-9a6e-0892144381fc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4c0c4bb6-269f-46bc-b460-7d0299277753", "name": "network-vif-plugged", "status": "completed", "tag": "92164628-0711-4bbe-835d-289c030d699a"}]} {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 06 13:55:19.236253 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-d76997f1-5370-4d2b-a53f-ed94f79d4cb6 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Calling method '>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:55:19.236759 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-d76997f1-5370-4d2b-a53f-ed94f79d4cb6 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] [instance: be6603c1-852c-4efc-8442-14b7228cf3d0] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:55:19.242630 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [req-dffcc268-a02c-4c03-a58c-966fdfa8964c req-0eb61f1d-01f7-4cea-9a6e-0892144381fc service nova] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:55:19.243192 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [req-dffcc268-a02c-4c03-a58c-966fdfa8964c req-0eb61f1d-01f7-4cea-9a6e-0892144381fc service nova] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:55:19.243367 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-d76997f1-5370-4d2b-a53f-ed94f79d4cb6 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:55:19.243827 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-d76997f1-5370-4d2b-a53f-ed94f79d4cb6 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:55:19.244706 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-d76997f1-5370-4d2b-a53f-ed94f79d4cb6 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:55:19.245182 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-d76997f1-5370-4d2b-a53f-ed94f79d4cb6 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:55:19.257258 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.compute.server_external_events [req-dffcc268-a02c-4c03-a58c-966fdfa8964c req-0eb61f1d-01f7-4cea-9a6e-0892144381fc service nova] Creating event network-vif-plugged:92164628-0711-4bbe-835d-289c030d699a for instance 4c0c4bb6-269f-46bc-b460-7d0299277753 on hv-cinder-81914 Jul 06 13:55:19.262316 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [req-dffcc268-a02c-4c03-a58c-966fdfa8964c req-0eb61f1d-01f7-4cea-9a6e-0892144381fc service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033306 Jul 06 13:55:19.263801 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 483/970] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 6 13:55:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 06 13:55:19.278244 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-d76997f1-5370-4d2b-a53f-ed94f79d4cb6 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] 10.222.0.20 "GET /compute/v2.1/servers/be6603c1-852c-4efc-8442-14b7228cf3d0/os-volume_attachments/67e8529f-eb0b-49ed-a454-faecce5d792e" status: 200 len: 194 microversion: 2.1 time: 0.046451 Jul 06 13:55:19.279309 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 488/971] 10.222.0.20 () {58 vars in 1412 bytes} [Wed Jul 6 13:55:19 2022] GET /compute/v2.1/servers/be6603c1-852c-4efc-8442-14b7228cf3d0/os-volume_attachments/67e8529f-eb0b-49ed-a454-faecce5d792e => generated 194 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 06 13:55:19.289611 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-a71757e2-4ec3-4d70-aa1b-169a955c2dc3 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:55:19.290184 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-a71757e2-4ec3-4d70-aa1b-169a955c2dc3 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] [instance: be6603c1-852c-4efc-8442-14b7228cf3d0] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:55:19.297315 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-a71757e2-4ec3-4d70-aa1b-169a955c2dc3 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:55:19.297663 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-a71757e2-4ec3-4d70-aa1b-169a955c2dc3 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:55:19.298440 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-a71757e2-4ec3-4d70-aa1b-169a955c2dc3 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:55:19.298871 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-a71757e2-4ec3-4d70-aa1b-169a955c2dc3 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:55:19.381569 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.objects.instance [None req-a71757e2-4ec3-4d70-aa1b-169a955c2dc3 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lazy-loading 'services' on Instance uuid be6603c1-852c-4efc-8442-14b7228cf3d0 {{(pid=124367) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 06 13:55:19.456451 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-a71757e2-4ec3-4d70-aa1b-169a955c2dc3 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] 10.222.0.20 "DELETE /compute/v2.1/servers/be6603c1-852c-4efc-8442-14b7228cf3d0/os-volume_attachments/67e8529f-eb0b-49ed-a454-faecce5d792e" status: 202 len: 0 microversion: 2.1 time: 0.170907 Jul 06 13:55:19.457093 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 484/972] 10.222.0.20 () {58 vars in 1415 bytes} [Wed Jul 6 13:55:19 2022] DELETE /compute/v2.1/servers/be6603c1-852c-4efc-8442-14b7228cf3d0/os-volume_attachments/67e8529f-eb0b-49ed-a454-faecce5d792e => generated 0 bytes in 173 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 06 13:55:20.007484 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-1165f5bf-25d3-4033-a88b-058a967757ed tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Calling method '>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:55:20.008101 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-1165f5bf-25d3-4033-a88b-058a967757ed tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] [instance: 4c0c4bb6-269f-46bc-b460-7d0299277753] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:55:20.015705 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-1165f5bf-25d3-4033-a88b-058a967757ed tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:55:20.016211 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-1165f5bf-25d3-4033-a88b-058a967757ed tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:55:20.016993 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-1165f5bf-25d3-4033-a88b-058a967757ed tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:55:20.017471 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-1165f5bf-25d3-4033-a88b-058a967757ed tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:55:20.145467 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-1165f5bf-25d3-4033-a88b-058a967757ed tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c85251638bc64deca16008b696b11ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3edb8d53184b98b7055ffc145f186d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:55:20.153508 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-1165f5bf-25d3-4033-a88b-058a967757ed tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c85251638bc64deca16008b696b11ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3edb8d53184b98b7055ffc145f186d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:55:20.155049 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-1165f5bf-25d3-4033-a88b-058a967757ed tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c85251638bc64deca16008b696b11ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3edb8d53184b98b7055ffc145f186d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:55:20.156217 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-1165f5bf-25d3-4033-a88b-058a967757ed tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] 10.222.0.20 "GET /compute/v2.1/servers/4c0c4bb6-269f-46bc-b460-7d0299277753" status: 200 len: 1744 microversion: 2.20 time: 0.152888 Jul 06 13:55:20.156943 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 489/973] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 6 13:55:20 2022] GET /compute/v2.1/servers/4c0c4bb6-269f-46bc-b460-7d0299277753 => generated 1744 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 06 13:55:20.636746 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-4d396b5a-41e5-44ed-8c3f-37683f95f0a5 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:55:20.637821 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-4d396b5a-41e5-44ed-8c3f-37683f95f0a5 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] [instance: be6603c1-852c-4efc-8442-14b7228cf3d0] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:55:20.645040 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-4d396b5a-41e5-44ed-8c3f-37683f95f0a5 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:55:20.645474 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-4d396b5a-41e5-44ed-8c3f-37683f95f0a5 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:55:20.646238 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-4d396b5a-41e5-44ed-8c3f-37683f95f0a5 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:55:20.646660 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-4d396b5a-41e5-44ed-8c3f-37683f95f0a5 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:55:20.675782 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-4d396b5a-41e5-44ed-8c3f-37683f95f0a5 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] 10.222.0.20 "GET /compute/v2.1/servers/be6603c1-852c-4efc-8442-14b7228cf3d0/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043786 Jul 06 13:55:20.676325 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 485/974] 10.222.0.20 () {58 vars in 1301 bytes} [Wed Jul 6 13:55:20 2022] GET /compute/v2.1/servers/be6603c1-852c-4efc-8442-14b7228cf3d0/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 06 13:55:20.780887 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-9e11375a-9df0-4fbe-9997-0e7ba74ae331 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Calling method '>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:55:20.781902 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-9e11375a-9df0-4fbe-9997-0e7ba74ae331 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] [instance: be6603c1-852c-4efc-8442-14b7228cf3d0] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:55:20.787905 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-9e11375a-9df0-4fbe-9997-0e7ba74ae331 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:55:20.788361 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-9e11375a-9df0-4fbe-9997-0e7ba74ae331 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:55:20.789161 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-9e11375a-9df0-4fbe-9997-0e7ba74ae331 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:55:20.789607 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-9e11375a-9df0-4fbe-9997-0e7ba74ae331 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:55:20.817722 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-9e11375a-9df0-4fbe-9997-0e7ba74ae331 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] 10.222.0.20 "GET /compute/v2.1/servers/be6603c1-852c-4efc-8442-14b7228cf3d0/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.041350 Jul 06 13:55:20.818271 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 490/975] 10.222.0.20 () {58 vars in 1301 bytes} [Wed Jul 6 13:55:20 2022] GET /compute/v2.1/servers/be6603c1-852c-4efc-8442-14b7228cf3d0/os-volume_attachments => generated 25 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 06 13:55:20.875688 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-926a64db-8bf3-4253-893c-990c36989545 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:55:20.876179 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-926a64db-8bf3-4253-893c-990c36989545 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] [instance: be6603c1-852c-4efc-8442-14b7228cf3d0] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:55:20.882068 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-926a64db-8bf3-4253-893c-990c36989545 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:55:20.882515 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-926a64db-8bf3-4253-893c-990c36989545 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:55:20.883261 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-926a64db-8bf3-4253-893c-990c36989545 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:55:20.883690 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-926a64db-8bf3-4253-893c-990c36989545 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:55:20.917263 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-926a64db-8bf3-4253-893c-990c36989545 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] [instance: be6603c1-852c-4efc-8442-14b7228cf3d0] Going to try to terminate instance {{(pid=124367) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 06 13:55:20.971390 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG dbcounter [-] [124367] Writing DB stats nova_cell1:SELECT=98,nova_cell1:INSERT=1,nova_cell1:UPDATE=1 {{(pid=124367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:55:21.000644 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-926a64db-8bf3-4253-893c-990c36989545 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] 10.222.0.20 "DELETE /compute/v2.1/servers/be6603c1-852c-4efc-8442-14b7228cf3d0" status: 204 len: 0 microversion: 2.1 time: 0.128704 Jul 06 13:55:21.001248 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 486/976] 10.222.0.20 () {58 vars in 1238 bytes} [Wed Jul 6 13:55:20 2022] DELETE /compute/v2.1/servers/be6603c1-852c-4efc-8442-14b7228cf3d0 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 06 13:55:21.009668 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-91b41c74-1087-48b6-aeed-ac5d7f014e7f tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Calling method '>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:55:21.010317 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-91b41c74-1087-48b6-aeed-ac5d7f014e7f tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] [instance: be6603c1-852c-4efc-8442-14b7228cf3d0] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:55:21.018582 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-91b41c74-1087-48b6-aeed-ac5d7f014e7f tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:55:21.019035 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-91b41c74-1087-48b6-aeed-ac5d7f014e7f tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:55:21.019804 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-91b41c74-1087-48b6-aeed-ac5d7f014e7f tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:55:21.020245 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-91b41c74-1087-48b6-aeed-ac5d7f014e7f tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:55:21.155921 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-91b41c74-1087-48b6-aeed-ac5d7f014e7f tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d7cacb73c8342579d9f990b0193487c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05df572327d54bd99595974b75898052', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:55:21.163424 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-91b41c74-1087-48b6-aeed-ac5d7f014e7f tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] 10.222.0.20 "GET /compute/v2.1/servers/be6603c1-852c-4efc-8442-14b7228cf3d0" status: 200 len: 1673 microversion: 2.1 time: 0.157611 Jul 06 13:55:21.163975 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 491/977] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:55:21 2022] GET /compute/v2.1/servers/be6603c1-852c-4efc-8442-14b7228cf3d0 => generated 1673 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 06 13:55:21.176445 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-962008c0-2517-4b73-9f65-d8f627351efa tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:55:21.177172 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-962008c0-2517-4b73-9f65-d8f627351efa tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] [instance: 4c0c4bb6-269f-46bc-b460-7d0299277753] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:55:21.183094 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-962008c0-2517-4b73-9f65-d8f627351efa tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:55:21.183546 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-962008c0-2517-4b73-9f65-d8f627351efa tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:55:21.184303 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-962008c0-2517-4b73-9f65-d8f627351efa tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:55:21.184738 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-962008c0-2517-4b73-9f65-d8f627351efa tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:55:21.317207 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-962008c0-2517-4b73-9f65-d8f627351efa tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c85251638bc64deca16008b696b11ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3edb8d53184b98b7055ffc145f186d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:55:21.325173 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-962008c0-2517-4b73-9f65-d8f627351efa tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c85251638bc64deca16008b696b11ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3edb8d53184b98b7055ffc145f186d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:55:21.326849 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-962008c0-2517-4b73-9f65-d8f627351efa tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c85251638bc64deca16008b696b11ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3edb8d53184b98b7055ffc145f186d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:55:21.328030 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-962008c0-2517-4b73-9f65-d8f627351efa tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] 10.222.0.20 "GET /compute/v2.1/servers/4c0c4bb6-269f-46bc-b460-7d0299277753" status: 200 len: 1744 microversion: 2.20 time: 0.156075 Jul 06 13:55:21.328585 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 487/978] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 6 13:55:21 2022] GET /compute/v2.1/servers/4c0c4bb6-269f-46bc-b460-7d0299277753 => generated 1744 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 06 13:55:21.583319 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-5ff8dc2b-267b-4527-ba13-ff0c5c347445 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Calling method '>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:55:21.583730 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-5ff8dc2b-267b-4527-ba13-ff0c5c347445 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] [instance: 5fa482da-0cca-4e1c-9724-e4d5ee9d73fa] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:55:21.589691 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-5ff8dc2b-267b-4527-ba13-ff0c5c347445 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:55:21.590137 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-5ff8dc2b-267b-4527-ba13-ff0c5c347445 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:55:21.590900 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-5ff8dc2b-267b-4527-ba13-ff0c5c347445 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:55:21.591826 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-5ff8dc2b-267b-4527-ba13-ff0c5c347445 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:55:21.614405 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-5ff8dc2b-267b-4527-ba13-ff0c5c347445 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] 10.222.0.20 "GET /compute/v2.1/servers/5fa482da-0cca-4e1c-9724-e4d5ee9d73fa/ips" status: 200 len: 150 microversion: 2.1 time: 0.035115 Jul 06 13:55:21.614951 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 492/979] 10.222.0.20 () {58 vars in 1247 bytes} [Wed Jul 6 13:55:21 2022] GET /compute/v2.1/servers/5fa482da-0cca-4e1c-9724-e4d5ee9d73fa/ips => generated 150 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 06 13:55:22.181281 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-3b52e8c0-b4ed-4a74-a844-26c228fd70e0 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:55:22.181819 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-3b52e8c0-b4ed-4a74-a844-26c228fd70e0 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] [instance: be6603c1-852c-4efc-8442-14b7228cf3d0] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:55:22.189268 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-3b52e8c0-b4ed-4a74-a844-26c228fd70e0 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:55:22.189715 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-3b52e8c0-b4ed-4a74-a844-26c228fd70e0 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:55:22.190478 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-3b52e8c0-b4ed-4a74-a844-26c228fd70e0 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:55:22.190910 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-3b52e8c0-b4ed-4a74-a844-26c228fd70e0 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:55:22.322815 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-3b52e8c0-b4ed-4a74-a844-26c228fd70e0 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d7cacb73c8342579d9f990b0193487c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05df572327d54bd99595974b75898052', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:55:22.330842 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-3b52e8c0-b4ed-4a74-a844-26c228fd70e0 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] 10.222.0.20 "GET /compute/v2.1/servers/be6603c1-852c-4efc-8442-14b7228cf3d0" status: 200 len: 1673 microversion: 2.1 time: 0.153510 Jul 06 13:55:22.331404 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 488/980] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:55:22 2022] GET /compute/v2.1/servers/be6603c1-852c-4efc-8442-14b7228cf3d0 => generated 1673 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:55:22.346149 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-aa0d7395-ae1c-44a3-bc7f-38af9ab35a31 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Calling method '>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:55:22.346774 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-aa0d7395-ae1c-44a3-bc7f-38af9ab35a31 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] [instance: 4c0c4bb6-269f-46bc-b460-7d0299277753] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:55:22.353253 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-aa0d7395-ae1c-44a3-bc7f-38af9ab35a31 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:55:22.353716 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-aa0d7395-ae1c-44a3-bc7f-38af9ab35a31 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:55:22.354489 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-aa0d7395-ae1c-44a3-bc7f-38af9ab35a31 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:55:22.354932 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-aa0d7395-ae1c-44a3-bc7f-38af9ab35a31 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:55:22.485980 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-aa0d7395-ae1c-44a3-bc7f-38af9ab35a31 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c85251638bc64deca16008b696b11ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3edb8d53184b98b7055ffc145f186d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:55:22.493872 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-aa0d7395-ae1c-44a3-bc7f-38af9ab35a31 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c85251638bc64deca16008b696b11ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3edb8d53184b98b7055ffc145f186d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:55:22.495400 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-aa0d7395-ae1c-44a3-bc7f-38af9ab35a31 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c85251638bc64deca16008b696b11ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3edb8d53184b98b7055ffc145f186d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:55:22.496564 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-aa0d7395-ae1c-44a3-bc7f-38af9ab35a31 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] 10.222.0.20 "GET /compute/v2.1/servers/4c0c4bb6-269f-46bc-b460-7d0299277753" status: 200 len: 1744 microversion: 2.20 time: 0.154295 Jul 06 13:55:22.497157 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 493/981] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 6 13:55:22 2022] GET /compute/v2.1/servers/4c0c4bb6-269f-46bc-b460-7d0299277753 => generated 1744 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 06 13:55:22.928033 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-100eba59-b447-4a69-ac4d-792222a11e09 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3f3dbdf8-ac2a-44ed-97fd-711ccab89b65"}} {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 06 13:55:22.929202 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-100eba59-b447-4a69-ac4d-792222a11e09 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] [instance: 5fa482da-0cca-4e1c-9724-e4d5ee9d73fa] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:55:22.935522 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-100eba59-b447-4a69-ac4d-792222a11e09 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:55:22.936088 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-100eba59-b447-4a69-ac4d-792222a11e09 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:55:22.936861 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-100eba59-b447-4a69-ac4d-792222a11e09 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:55:22.937329 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-100eba59-b447-4a69-ac4d-792222a11e09 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:55:23.350917 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-501c0579-ca84-432b-a85b-a992dad3351c tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Calling method '>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:55:23.351767 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-501c0579-ca84-432b-a85b-a992dad3351c tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] [instance: be6603c1-852c-4efc-8442-14b7228cf3d0] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:55:23.359301 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-501c0579-ca84-432b-a85b-a992dad3351c tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:55:23.360096 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-501c0579-ca84-432b-a85b-a992dad3351c tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:55:23.361276 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-501c0579-ca84-432b-a85b-a992dad3351c tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:55:23.361832 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-501c0579-ca84-432b-a85b-a992dad3351c tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:55:23.512362 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-501c0579-ca84-432b-a85b-a992dad3351c tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d7cacb73c8342579d9f990b0193487c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05df572327d54bd99595974b75898052', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:55:23.516344 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-100eba59-b447-4a69-ac4d-792222a11e09 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] 10.222.0.20 "POST /compute/v2.1/servers/5fa482da-0cca-4e1c-9724-e4d5ee9d73fa/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.592463 Jul 06 13:55:23.521203 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-501c0579-ca84-432b-a85b-a992dad3351c tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] 10.222.0.20 "GET /compute/v2.1/servers/be6603c1-852c-4efc-8442-14b7228cf3d0" status: 200 len: 1673 microversion: 2.1 time: 0.176784 Jul 06 13:55:23.531876 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 494/982] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:55:23 2022] GET /compute/v2.1/servers/be6603c1-852c-4efc-8442-14b7228cf3d0 => generated 1673 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 06 13:55:23.533651 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 489/983] 10.222.0.20 () {60 vars in 1322 bytes} [Wed Jul 6 13:55:22 2022] POST /compute/v2.1/servers/5fa482da-0cca-4e1c-9724-e4d5ee9d73fa/os-volume_attachments => generated 194 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 06 13:55:23.538948 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-b78e42c2-0da1-46bc-b7a9-922c8b3ecb79 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Calling method '>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:55:23.539895 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-b78e42c2-0da1-46bc-b7a9-922c8b3ecb79 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] [instance: 4c0c4bb6-269f-46bc-b460-7d0299277753] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:55:23.547212 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-b78e42c2-0da1-46bc-b7a9-922c8b3ecb79 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:55:23.547931 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-b78e42c2-0da1-46bc-b7a9-922c8b3ecb79 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:55:23.549079 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-b78e42c2-0da1-46bc-b7a9-922c8b3ecb79 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:55:23.550160 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-b78e42c2-0da1-46bc-b7a9-922c8b3ecb79 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:55:23.700411 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-b78e42c2-0da1-46bc-b7a9-922c8b3ecb79 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c85251638bc64deca16008b696b11ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3edb8d53184b98b7055ffc145f186d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:55:23.711527 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-b78e42c2-0da1-46bc-b7a9-922c8b3ecb79 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c85251638bc64deca16008b696b11ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3edb8d53184b98b7055ffc145f186d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:55:23.713422 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-b78e42c2-0da1-46bc-b7a9-922c8b3ecb79 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c85251638bc64deca16008b696b11ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3edb8d53184b98b7055ffc145f186d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:55:23.714872 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-b78e42c2-0da1-46bc-b7a9-922c8b3ecb79 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] 10.222.0.20 "GET /compute/v2.1/servers/4c0c4bb6-269f-46bc-b460-7d0299277753" status: 200 len: 1739 microversion: 2.20 time: 0.181732 Jul 06 13:55:23.715965 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 495/984] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 6 13:55:23 2022] GET /compute/v2.1/servers/4c0c4bb6-269f-46bc-b460-7d0299277753 => generated 1739 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 06 13:55:24.417718 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [req-ace1c5f6-19cd-4a3e-b440-4e215726aa60 req-4c46155c-ee70-4075-a3ed-b0377b8355e7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "be6603c1-852c-4efc-8442-14b7228cf3d0", "name": "network-vif-deleted", "tag": "73906c58-8548-4ecf-a678-d849a4bac0f7"}]} {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 06 13:55:24.429977 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [req-ace1c5f6-19cd-4a3e-b440-4e215726aa60 req-4c46155c-ee70-4075-a3ed-b0377b8355e7 service nova] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:55:24.430822 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [req-ace1c5f6-19cd-4a3e-b440-4e215726aa60 req-4c46155c-ee70-4075-a3ed-b0377b8355e7 service nova] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:55:24.450290 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.compute.server_external_events [req-ace1c5f6-19cd-4a3e-b440-4e215726aa60 req-4c46155c-ee70-4075-a3ed-b0377b8355e7 service nova] Creating event network-vif-deleted:73906c58-8548-4ecf-a678-d849a4bac0f7 for instance be6603c1-852c-4efc-8442-14b7228cf3d0 on hv-cinder-81914 Jul 06 13:55:24.456976 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [req-ace1c5f6-19cd-4a3e-b440-4e215726aa60 req-4c46155c-ee70-4075-a3ed-b0377b8355e7 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055001 Jul 06 13:55:24.459142 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 490/985] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 6 13:55:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 06 13:55:24.541633 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-f8867494-68c4-47a4-87cd-bfd10d39a21a tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Calling method '>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:55:24.543006 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-f8867494-68c4-47a4-87cd-bfd10d39a21a tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] [instance: be6603c1-852c-4efc-8442-14b7228cf3d0] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:55:24.559690 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-f8867494-68c4-47a4-87cd-bfd10d39a21a tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:55:24.560795 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-f8867494-68c4-47a4-87cd-bfd10d39a21a tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:55:24.564525 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-f8867494-68c4-47a4-87cd-bfd10d39a21a tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:55:24.564978 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-f8867494-68c4-47a4-87cd-bfd10d39a21a tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:55:24.638319 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-f8867494-68c4-47a4-87cd-bfd10d39a21a tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:55:24.639080 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-f8867494-68c4-47a4-87cd-bfd10d39a21a tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:55:24.640099 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.objects.instance [None req-f8867494-68c4-47a4-87cd-bfd10d39a21a tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lazy-loading 'fault' on Instance uuid be6603c1-852c-4efc-8442-14b7228cf3d0 {{(pid=124368) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 06 13:55:24.690940 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-f8867494-68c4-47a4-87cd-bfd10d39a21a tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d7cacb73c8342579d9f990b0193487c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05df572327d54bd99595974b75898052', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:55:24.699228 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-f8867494-68c4-47a4-87cd-bfd10d39a21a tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] 10.222.0.20 "GET /compute/v2.1/servers/be6603c1-852c-4efc-8442-14b7228cf3d0" status: 200 len: 1326 microversion: 2.1 time: 0.162559 Jul 06 13:55:24.709925 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 496/986] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:55:24 2022] GET /compute/v2.1/servers/be6603c1-852c-4efc-8442-14b7228cf3d0 => generated 1326 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:55:24.739642 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-325781da-ab9f-4b3f-8979-fb4baad269a4 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:55:24.742006 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-325781da-ab9f-4b3f-8979-fb4baad269a4 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] [instance: 4c0c4bb6-269f-46bc-b460-7d0299277753] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:55:24.753631 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-325781da-ab9f-4b3f-8979-fb4baad269a4 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:55:24.754720 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-325781da-ab9f-4b3f-8979-fb4baad269a4 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:55:24.755735 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-325781da-ab9f-4b3f-8979-fb4baad269a4 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:55:24.756390 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-325781da-ab9f-4b3f-8979-fb4baad269a4 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:55:24.933182 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-325781da-ab9f-4b3f-8979-fb4baad269a4 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c85251638bc64deca16008b696b11ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3edb8d53184b98b7055ffc145f186d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:55:24.946045 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-325781da-ab9f-4b3f-8979-fb4baad269a4 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c85251638bc64deca16008b696b11ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3edb8d53184b98b7055ffc145f186d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:55:24.950331 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-325781da-ab9f-4b3f-8979-fb4baad269a4 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c85251638bc64deca16008b696b11ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3edb8d53184b98b7055ffc145f186d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:55:24.951752 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-325781da-ab9f-4b3f-8979-fb4baad269a4 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] 10.222.0.20 "GET /compute/v2.1/servers/4c0c4bb6-269f-46bc-b460-7d0299277753" status: 200 len: 1739 microversion: 2.20 time: 0.221333 Jul 06 13:55:24.952863 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 491/987] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 6 13:55:24 2022] GET /compute/v2.1/servers/4c0c4bb6-269f-46bc-b460-7d0299277753 => generated 1739 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 06 13:55:25.717500 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-b3de0bfb-86b8-4d33-bcd8-9cffe21ea568 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Calling method '>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:55:25.728592 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-b3de0bfb-86b8-4d33-bcd8-9cffe21ea568 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] [instance: be6603c1-852c-4efc-8442-14b7228cf3d0] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:55:25.743738 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-b3de0bfb-86b8-4d33-bcd8-9cffe21ea568 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:55:25.749408 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-b3de0bfb-86b8-4d33-bcd8-9cffe21ea568 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:55:25.750471 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-b3de0bfb-86b8-4d33-bcd8-9cffe21ea568 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:55:25.751073 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-b3de0bfb-86b8-4d33-bcd8-9cffe21ea568 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:55:25.794931 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.wsgi [None req-b3de0bfb-86b8-4d33-bcd8-9cffe21ea568 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] HTTP exception thrown: Instance be6603c1-852c-4efc-8442-14b7228cf3d0 could not be found. Jul 06 13:55:25.796758 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-b3de0bfb-86b8-4d33-bcd8-9cffe21ea568 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Request method failure captured: Jul 06 13:55:25.796758 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: request: GET /compute/v2.1/servers/be6603c1-852c-4efc-8442-14b7228cf3d0 HTTP/1.1 Jul 06 13:55:25.796758 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: Accept: application/json Jul 06 13:55:25.796758 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: Accept-Encoding: identity Jul 06 13:55:25.796758 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: Connection: close Jul 06 13:55:25.796758 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: Content-Length: 0 Jul 06 13:55:25.796758 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: Content-Type: application/json Jul 06 13:55:25.796758 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: Host: 10.222.0.20 Jul 06 13:55:25.796758 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: Openstack-System-Scope: None Jul 06 13:55:25.796758 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: User-Agent: python-urllib3/1.26.9 Jul 06 13:55:25.796758 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Auth-Token: gAAAAABixZH5S3knz4fvYX5rMVzIRaVsYzIKLfrrz8lDPVem74Mg_DTbdjOjiuIblg7Yv_5KYUCq8cU5CAPyveLkwoLjHq0KpmoFJl1HEbcs8GS4ExBwATXjRnPlECQAMq-F6w3rOAPGgVuvSxjNdgiF89mYcHWuNREzSrBRKyP00YlMZ9-oZ94 Jul 06 13:55:25.796758 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Domain-Id: None Jul 06 13:55:25.796758 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Domain-Name: None Jul 06 13:55:25.796758 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Identity-Status: Confirmed Jul 06 13:55:25.796758 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Is-Admin-Project: True Jul 06 13:55:25.796758 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Project-Domain-Id: default Jul 06 13:55:25.796758 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Project-Domain-Name: Default Jul 06 13:55:25.796758 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Project-Id: 05df572327d54bd99595974b75898052 Jul 06 13:55:25.796758 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Project-Name: tempest-AttachVolumeTestJSON-1571746075 Jul 06 13:55:25.796758 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Role: reader,member Jul 06 13:55:25.796758 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Roles: reader,member Jul 06 13:55:25.798217 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_05df572327d54bd99595974b75898052"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/05df572327d54bd99595974b75898052"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/05df572327d54bd99595974b75898052"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/05df572327d54bd99595974b75898052"}]}] Jul 06 13:55:25.798217 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Tenant: tempest-AttachVolumeTestJSON-1571746075 Jul 06 13:55:25.798217 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Tenant-Id: 05df572327d54bd99595974b75898052 Jul 06 13:55:25.798217 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1571746075 Jul 06 13:55:25.798217 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-User: tempest-AttachVolumeTestJSON-1571746075-project Jul 06 13:55:25.798217 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-User-Domain-Id: default Jul 06 13:55:25.798217 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-User-Domain-Name: Default Jul 06 13:55:25.798217 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-User-Id: 3d7cacb73c8342579d9f990b0193487c Jul 06 13:55:25.798217 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-User-Name: tempest-AttachVolumeTestJSON-1571746075-project Jul 06 13:55:25.798217 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: method: > Jul 06 13:55:25.798217 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: exception: Instance be6603c1-852c-4efc-8442-14b7228cf3d0 could not be found. Jul 06 13:55:25.798217 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: action_args: {'id': 'be6603c1-852c-4efc-8442-14b7228cf3d0'} Jul 06 13:55:25.798982 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 06 13:55:25.798982 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 06 13:55:25.798982 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 06 13:55:25.798982 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 06 13:55:25.798982 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 06 13:55:25.798982 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 06 13:55:25.798982 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 06 13:55:25.798982 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 06 13:55:25.798982 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 06 13:55:25.798982 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 06 13:55:25.798982 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance be6603c1-852c-4efc-8442-14b7228cf3d0 could not be found. Jul 06 13:55:25.798982 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi Jul 06 13:55:25.798982 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 06 13:55:25.798982 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi Jul 06 13:55:25.798982 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 06 13:55:25.798982 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 06 13:55:25.798982 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 06 13:55:25.798982 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 06 13:55:25.798982 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 06 13:55:25.798982 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 06 13:55:25.801411 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 06 13:55:25.801411 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 06 13:55:25.801411 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 06 13:55:25.801411 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 06 13:55:25.801411 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 06 13:55:25.801411 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 06 13:55:25.801411 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 06 13:55:25.801411 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance be6603c1-852c-4efc-8442-14b7228cf3d0 could not be found. Jul 06 13:55:25.801411 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi Jul 06 13:55:25.801411 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 06 13:55:25.801411 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi Jul 06 13:55:25.801411 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 06 13:55:25.801411 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 06 13:55:25.801411 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 06 13:55:25.801411 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 06 13:55:25.801411 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 06 13:55:25.801411 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance be6603c1-852c-4efc-8442-14b7228cf3d0 could not be found. Jul 06 13:55:25.801411 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi Jul 06 13:55:25.803966 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-b3de0bfb-86b8-4d33-bcd8-9cffe21ea568 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Returning 404 to user: Instance be6603c1-852c-4efc-8442-14b7228cf3d0 could not be found. {{(pid=124368) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 06 13:55:25.804531 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-b3de0bfb-86b8-4d33-bcd8-9cffe21ea568 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] 10.222.0.20 "GET /compute/v2.1/servers/be6603c1-852c-4efc-8442-14b7228cf3d0" status: 404 len: 111 microversion: 2.1 time: 0.091366 Jul 06 13:55:25.808669 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 497/988] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:55:25 2022] GET /compute/v2.1/servers/be6603c1-852c-4efc-8442-14b7228cf3d0 => generated 111 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 06 13:55:25.817059 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-3c46df61-fd08-47f7-a9a4-809eacb3ed95 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Calling method '.version_select at 0x7ffbc40d8700>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:55:25.858885 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-3c46df61-fd08-47f7-a9a4-809eacb3ed95 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-717089440" status: 202 len: 0 microversion: 2.1 time: 0.045415 Jul 06 13:55:25.861195 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 492/989] 10.222.0.20 () {58 vars in 1217 bytes} [Wed Jul 6 13:55:25 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-717089440 => generated 0 bytes in 48 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 06 13:55:25.972482 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-2b32eec5-08ec-4bf7-9aaf-e468ad84a6da tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Calling method '>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:55:25.973497 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-2b32eec5-08ec-4bf7-9aaf-e468ad84a6da tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] [instance: 4c0c4bb6-269f-46bc-b460-7d0299277753] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:55:25.985023 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-2b32eec5-08ec-4bf7-9aaf-e468ad84a6da tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:55:25.985473 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-2b32eec5-08ec-4bf7-9aaf-e468ad84a6da tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:55:25.986262 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-2b32eec5-08ec-4bf7-9aaf-e468ad84a6da tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:55:25.990634 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-2b32eec5-08ec-4bf7-9aaf-e468ad84a6da tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:55:26.217411 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-2b32eec5-08ec-4bf7-9aaf-e468ad84a6da tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c85251638bc64deca16008b696b11ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3edb8d53184b98b7055ffc145f186d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:55:26.225798 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-2b32eec5-08ec-4bf7-9aaf-e468ad84a6da tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c85251638bc64deca16008b696b11ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3edb8d53184b98b7055ffc145f186d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:55:26.227550 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-2b32eec5-08ec-4bf7-9aaf-e468ad84a6da tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c85251638bc64deca16008b696b11ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3edb8d53184b98b7055ffc145f186d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:55:26.228893 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-2b32eec5-08ec-4bf7-9aaf-e468ad84a6da tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] 10.222.0.20 "GET /compute/v2.1/servers/4c0c4bb6-269f-46bc-b460-7d0299277753" status: 200 len: 1739 microversion: 2.20 time: 0.262698 Jul 06 13:55:26.229981 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 498/990] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 6 13:55:25 2022] GET /compute/v2.1/servers/4c0c4bb6-269f-46bc-b460-7d0299277753 => generated 1739 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 06 13:55:27.248776 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-e0c0f884-4e67-44c7-b15c-c92c9700858d tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:55:27.249982 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-e0c0f884-4e67-44c7-b15c-c92c9700858d tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] [instance: 4c0c4bb6-269f-46bc-b460-7d0299277753] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:55:27.257944 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-e0c0f884-4e67-44c7-b15c-c92c9700858d tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:55:27.258394 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-e0c0f884-4e67-44c7-b15c-c92c9700858d tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:55:27.259162 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-e0c0f884-4e67-44c7-b15c-c92c9700858d tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:55:27.259615 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-e0c0f884-4e67-44c7-b15c-c92c9700858d tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:55:27.421675 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-e0c0f884-4e67-44c7-b15c-c92c9700858d tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c85251638bc64deca16008b696b11ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3edb8d53184b98b7055ffc145f186d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:55:27.433278 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-e0c0f884-4e67-44c7-b15c-c92c9700858d tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c85251638bc64deca16008b696b11ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3edb8d53184b98b7055ffc145f186d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:55:27.435477 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-e0c0f884-4e67-44c7-b15c-c92c9700858d tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c85251638bc64deca16008b696b11ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3edb8d53184b98b7055ffc145f186d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:55:27.436859 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-e0c0f884-4e67-44c7-b15c-c92c9700858d tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] 10.222.0.20 "GET /compute/v2.1/servers/4c0c4bb6-269f-46bc-b460-7d0299277753" status: 200 len: 1739 microversion: 2.20 time: 0.192713 Jul 06 13:55:27.437439 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 493/991] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 6 13:55:27 2022] GET /compute/v2.1/servers/4c0c4bb6-269f-46bc-b460-7d0299277753 => generated 1739 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 06 13:55:28.456909 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-5d879dc2-78d0-46e3-80ac-d3b0845edbbe tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Calling method '>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:55:28.457612 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-5d879dc2-78d0-46e3-80ac-d3b0845edbbe tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] [instance: 4c0c4bb6-269f-46bc-b460-7d0299277753] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:55:28.464778 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-5d879dc2-78d0-46e3-80ac-d3b0845edbbe tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:55:28.465266 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-5d879dc2-78d0-46e3-80ac-d3b0845edbbe tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:55:28.466599 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-5d879dc2-78d0-46e3-80ac-d3b0845edbbe tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:55:28.467425 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-5d879dc2-78d0-46e3-80ac-d3b0845edbbe tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:55:28.626948 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-5d879dc2-78d0-46e3-80ac-d3b0845edbbe tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c85251638bc64deca16008b696b11ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3edb8d53184b98b7055ffc145f186d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:55:28.635309 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-5d879dc2-78d0-46e3-80ac-d3b0845edbbe tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c85251638bc64deca16008b696b11ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3edb8d53184b98b7055ffc145f186d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:55:28.637259 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-5d879dc2-78d0-46e3-80ac-d3b0845edbbe tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c85251638bc64deca16008b696b11ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3edb8d53184b98b7055ffc145f186d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:55:28.639332 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-5d879dc2-78d0-46e3-80ac-d3b0845edbbe tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] 10.222.0.20 "GET /compute/v2.1/servers/4c0c4bb6-269f-46bc-b460-7d0299277753" status: 200 len: 1739 microversion: 2.20 time: 0.186655 Jul 06 13:55:28.639972 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 499/992] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 6 13:55:28 2022] GET /compute/v2.1/servers/4c0c4bb6-269f-46bc-b460-7d0299277753 => generated 1739 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 06 13:55:29.150159 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-e7d5730f-7f91-4781-be4b-fba21deb205d tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:55:29.150685 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-e7d5730f-7f91-4781-be4b-fba21deb205d tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] [instance: be6603c1-852c-4efc-8442-14b7228cf3d0] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:55:29.153518 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG dbcounter [-] [124367] Writing DB stats nova_api:SELECT=53,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=124367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:55:29.161882 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-e7d5730f-7f91-4781-be4b-fba21deb205d tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:55:29.162418 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-e7d5730f-7f91-4781-be4b-fba21deb205d tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:55:29.163288 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-e7d5730f-7f91-4781-be4b-fba21deb205d tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:55:29.163796 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-e7d5730f-7f91-4781-be4b-fba21deb205d tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:55:29.181490 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.wsgi [None req-e7d5730f-7f91-4781-be4b-fba21deb205d tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] HTTP exception thrown: Instance be6603c1-852c-4efc-8442-14b7228cf3d0 could not be found. Jul 06 13:55:29.183395 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-e7d5730f-7f91-4781-be4b-fba21deb205d tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Request method failure captured: Jul 06 13:55:29.183395 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: request: DELETE /compute/v2.1/servers/be6603c1-852c-4efc-8442-14b7228cf3d0 HTTP/1.1 Jul 06 13:55:29.183395 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: Accept: application/json Jul 06 13:55:29.183395 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: Accept-Encoding: identity Jul 06 13:55:29.183395 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: Connection: close Jul 06 13:55:29.183395 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: Content-Length: 0 Jul 06 13:55:29.183395 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: Content-Type: application/json Jul 06 13:55:29.183395 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: Host: 10.222.0.20 Jul 06 13:55:29.183395 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: Openstack-System-Scope: None Jul 06 13:55:29.183395 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: User-Agent: python-urllib3/1.26.9 Jul 06 13:55:29.183395 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: X-Auth-Token: gAAAAABixZH5S3knz4fvYX5rMVzIRaVsYzIKLfrrz8lDPVem74Mg_DTbdjOjiuIblg7Yv_5KYUCq8cU5CAPyveLkwoLjHq0KpmoFJl1HEbcs8GS4ExBwATXjRnPlECQAMq-F6w3rOAPGgVuvSxjNdgiF89mYcHWuNREzSrBRKyP00YlMZ9-oZ94 Jul 06 13:55:29.183395 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: X-Domain-Id: None Jul 06 13:55:29.183395 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: X-Domain-Name: None Jul 06 13:55:29.183395 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: X-Identity-Status: Confirmed Jul 06 13:55:29.183395 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: X-Is-Admin-Project: True Jul 06 13:55:29.183395 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: X-Project-Domain-Id: default Jul 06 13:55:29.183395 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: X-Project-Domain-Name: Default Jul 06 13:55:29.183395 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: X-Project-Id: 05df572327d54bd99595974b75898052 Jul 06 13:55:29.183395 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: X-Project-Name: tempest-AttachVolumeTestJSON-1571746075 Jul 06 13:55:29.183395 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: X-Role: reader,member Jul 06 13:55:29.183395 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: X-Roles: reader,member Jul 06 13:55:29.185525 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_05df572327d54bd99595974b75898052"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/05df572327d54bd99595974b75898052"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/05df572327d54bd99595974b75898052"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/05df572327d54bd99595974b75898052"}]}] Jul 06 13:55:29.185525 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: X-Tenant: tempest-AttachVolumeTestJSON-1571746075 Jul 06 13:55:29.185525 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: X-Tenant-Id: 05df572327d54bd99595974b75898052 Jul 06 13:55:29.185525 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1571746075 Jul 06 13:55:29.185525 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: X-User: tempest-AttachVolumeTestJSON-1571746075-project Jul 06 13:55:29.185525 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: X-User-Domain-Id: default Jul 06 13:55:29.185525 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: X-User-Domain-Name: Default Jul 06 13:55:29.185525 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: X-User-Id: 3d7cacb73c8342579d9f990b0193487c Jul 06 13:55:29.185525 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: X-User-Name: tempest-AttachVolumeTestJSON-1571746075-project Jul 06 13:55:29.185525 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: method: > Jul 06 13:55:29.185525 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: exception: Instance be6603c1-852c-4efc-8442-14b7228cf3d0 could not be found. Jul 06 13:55:29.185525 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: action_args: {'id': 'be6603c1-852c-4efc-8442-14b7228cf3d0'} Jul 06 13:55:29.186535 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 06 13:55:29.186535 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 06 13:55:29.186535 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 06 13:55:29.186535 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 06 13:55:29.186535 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 06 13:55:29.186535 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 06 13:55:29.186535 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 06 13:55:29.186535 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 06 13:55:29.186535 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 06 13:55:29.186535 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 06 13:55:29.186535 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance be6603c1-852c-4efc-8442-14b7228cf3d0 could not be found. Jul 06 13:55:29.186535 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi Jul 06 13:55:29.186535 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 06 13:55:29.186535 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi Jul 06 13:55:29.186535 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 06 13:55:29.186535 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 06 13:55:29.186535 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 06 13:55:29.186535 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 06 13:55:29.186535 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 06 13:55:29.186535 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 06 13:55:29.187962 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 06 13:55:29.187962 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 06 13:55:29.187962 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 06 13:55:29.187962 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 06 13:55:29.187962 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 06 13:55:29.187962 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 06 13:55:29.187962 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 06 13:55:29.187962 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 06 13:55:29.187962 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 06 13:55:29.187962 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance be6603c1-852c-4efc-8442-14b7228cf3d0 could not be found. Jul 06 13:55:29.187962 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi Jul 06 13:55:29.187962 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 06 13:55:29.187962 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi Jul 06 13:55:29.187962 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 06 13:55:29.187962 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 06 13:55:29.187962 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 06 13:55:29.187962 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 06 13:55:29.187962 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 06 13:55:29.187962 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance be6603c1-852c-4efc-8442-14b7228cf3d0 could not be found. Jul 06 13:55:29.187962 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi Jul 06 13:55:29.189426 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-e7d5730f-7f91-4781-be4b-fba21deb205d tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Returning 404 to user: Instance be6603c1-852c-4efc-8442-14b7228cf3d0 could not be found. {{(pid=124367) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 06 13:55:29.189426 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-e7d5730f-7f91-4781-be4b-fba21deb205d tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] 10.222.0.20 "DELETE /compute/v2.1/servers/be6603c1-852c-4efc-8442-14b7228cf3d0" status: 404 len: 111 microversion: 2.1 time: 0.041609 Jul 06 13:55:29.190080 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 494/993] 10.222.0.20 () {58 vars in 1238 bytes} [Wed Jul 6 13:55:29 2022] DELETE /compute/v2.1/servers/be6603c1-852c-4efc-8442-14b7228cf3d0 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 06 13:55:29.201981 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-f8a1b477-21d8-403a-8d01-699221ff590d tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Calling method '>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:55:29.202633 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-f8a1b477-21d8-403a-8d01-699221ff590d tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] [instance: be6603c1-852c-4efc-8442-14b7228cf3d0] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:55:29.209373 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-f8a1b477-21d8-403a-8d01-699221ff590d tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:55:29.209847 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-f8a1b477-21d8-403a-8d01-699221ff590d tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:55:29.210791 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-f8a1b477-21d8-403a-8d01-699221ff590d tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:55:29.211386 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-f8a1b477-21d8-403a-8d01-699221ff590d tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:55:29.229523 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.wsgi [None req-f8a1b477-21d8-403a-8d01-699221ff590d tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] HTTP exception thrown: Instance be6603c1-852c-4efc-8442-14b7228cf3d0 could not be found. Jul 06 13:55:29.231082 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-f8a1b477-21d8-403a-8d01-699221ff590d tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Request method failure captured: Jul 06 13:55:29.231082 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: request: GET /compute/v2.1/servers/be6603c1-852c-4efc-8442-14b7228cf3d0 HTTP/1.1 Jul 06 13:55:29.231082 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: Accept: application/json Jul 06 13:55:29.231082 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: Accept-Encoding: identity Jul 06 13:55:29.231082 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: Connection: close Jul 06 13:55:29.231082 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: Content-Length: 0 Jul 06 13:55:29.231082 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: Content-Type: application/json Jul 06 13:55:29.231082 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: Host: 10.222.0.20 Jul 06 13:55:29.231082 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: Openstack-System-Scope: None Jul 06 13:55:29.231082 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: User-Agent: python-urllib3/1.26.9 Jul 06 13:55:29.231082 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Auth-Token: gAAAAABixZH5S3knz4fvYX5rMVzIRaVsYzIKLfrrz8lDPVem74Mg_DTbdjOjiuIblg7Yv_5KYUCq8cU5CAPyveLkwoLjHq0KpmoFJl1HEbcs8GS4ExBwATXjRnPlECQAMq-F6w3rOAPGgVuvSxjNdgiF89mYcHWuNREzSrBRKyP00YlMZ9-oZ94 Jul 06 13:55:29.231082 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Domain-Id: None Jul 06 13:55:29.231082 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Domain-Name: None Jul 06 13:55:29.231082 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Identity-Status: Confirmed Jul 06 13:55:29.231082 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Is-Admin-Project: True Jul 06 13:55:29.231082 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Project-Domain-Id: default Jul 06 13:55:29.231082 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Project-Domain-Name: Default Jul 06 13:55:29.231082 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Project-Id: 05df572327d54bd99595974b75898052 Jul 06 13:55:29.231082 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Project-Name: tempest-AttachVolumeTestJSON-1571746075 Jul 06 13:55:29.231082 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Role: reader,member Jul 06 13:55:29.231082 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Roles: reader,member Jul 06 13:55:29.232738 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_05df572327d54bd99595974b75898052"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/05df572327d54bd99595974b75898052"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/05df572327d54bd99595974b75898052"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/05df572327d54bd99595974b75898052"}]}] Jul 06 13:55:29.232738 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Tenant: tempest-AttachVolumeTestJSON-1571746075 Jul 06 13:55:29.232738 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Tenant-Id: 05df572327d54bd99595974b75898052 Jul 06 13:55:29.232738 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1571746075 Jul 06 13:55:29.232738 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-User: tempest-AttachVolumeTestJSON-1571746075-project Jul 06 13:55:29.232738 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-User-Domain-Id: default Jul 06 13:55:29.232738 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-User-Domain-Name: Default Jul 06 13:55:29.232738 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-User-Id: 3d7cacb73c8342579d9f990b0193487c Jul 06 13:55:29.232738 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-User-Name: tempest-AttachVolumeTestJSON-1571746075-project Jul 06 13:55:29.232738 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: method: > Jul 06 13:55:29.232738 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: exception: Instance be6603c1-852c-4efc-8442-14b7228cf3d0 could not be found. Jul 06 13:55:29.232738 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: action_args: {'id': 'be6603c1-852c-4efc-8442-14b7228cf3d0'} Jul 06 13:55:29.233647 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 06 13:55:29.233647 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 06 13:55:29.233647 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 06 13:55:29.233647 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 06 13:55:29.233647 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 06 13:55:29.233647 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 06 13:55:29.233647 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 06 13:55:29.233647 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 06 13:55:29.233647 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 06 13:55:29.233647 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 06 13:55:29.233647 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance be6603c1-852c-4efc-8442-14b7228cf3d0 could not be found. Jul 06 13:55:29.233647 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi Jul 06 13:55:29.233647 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 06 13:55:29.233647 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi Jul 06 13:55:29.233647 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 06 13:55:29.233647 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 06 13:55:29.233647 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 06 13:55:29.233647 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 06 13:55:29.233647 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 06 13:55:29.233647 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 06 13:55:29.238046 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 06 13:55:29.238046 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 06 13:55:29.238046 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 06 13:55:29.238046 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 06 13:55:29.238046 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 06 13:55:29.238046 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 06 13:55:29.238046 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 06 13:55:29.238046 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance be6603c1-852c-4efc-8442-14b7228cf3d0 could not be found. Jul 06 13:55:29.238046 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi Jul 06 13:55:29.238046 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 06 13:55:29.238046 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi Jul 06 13:55:29.238046 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 06 13:55:29.238046 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 06 13:55:29.238046 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 06 13:55:29.238046 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 06 13:55:29.238046 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 06 13:55:29.238046 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance be6603c1-852c-4efc-8442-14b7228cf3d0 could not be found. Jul 06 13:55:29.238046 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi Jul 06 13:55:29.239361 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-f8a1b477-21d8-403a-8d01-699221ff590d tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Returning 404 to user: Instance be6603c1-852c-4efc-8442-14b7228cf3d0 could not be found. {{(pid=124368) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 06 13:55:29.239361 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-f8a1b477-21d8-403a-8d01-699221ff590d tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] 10.222.0.20 "GET /compute/v2.1/servers/be6603c1-852c-4efc-8442-14b7228cf3d0" status: 404 len: 111 microversion: 2.1 time: 0.039614 Jul 06 13:55:29.239361 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 500/994] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:55:29 2022] GET /compute/v2.1/servers/be6603c1-852c-4efc-8442-14b7228cf3d0 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 06 13:55:29.664672 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-9d97a0d0-07b2-4dac-8e8c-62e9a25122b6 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:55:29.665407 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-9d97a0d0-07b2-4dac-8e8c-62e9a25122b6 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] [instance: 4c0c4bb6-269f-46bc-b460-7d0299277753] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:55:29.672592 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-9d97a0d0-07b2-4dac-8e8c-62e9a25122b6 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:55:29.673273 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-9d97a0d0-07b2-4dac-8e8c-62e9a25122b6 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:55:29.674109 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-9d97a0d0-07b2-4dac-8e8c-62e9a25122b6 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:55:29.674866 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-9d97a0d0-07b2-4dac-8e8c-62e9a25122b6 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:55:29.827624 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-9d97a0d0-07b2-4dac-8e8c-62e9a25122b6 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c85251638bc64deca16008b696b11ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3edb8d53184b98b7055ffc145f186d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:55:29.836397 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-9d97a0d0-07b2-4dac-8e8c-62e9a25122b6 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c85251638bc64deca16008b696b11ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3edb8d53184b98b7055ffc145f186d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:55:29.838087 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-9d97a0d0-07b2-4dac-8e8c-62e9a25122b6 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c85251638bc64deca16008b696b11ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3edb8d53184b98b7055ffc145f186d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:55:29.839659 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-9d97a0d0-07b2-4dac-8e8c-62e9a25122b6 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] 10.222.0.20 "GET /compute/v2.1/servers/4c0c4bb6-269f-46bc-b460-7d0299277753" status: 200 len: 1739 microversion: 2.20 time: 0.185171 Jul 06 13:55:29.857785 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 495/995] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 6 13:55:29 2022] GET /compute/v2.1/servers/4c0c4bb6-269f-46bc-b460-7d0299277753 => generated 1739 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 06 13:55:30.388634 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-75b15070-c97c-4fa9-ae7d-c8e2a8c78dfa tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Calling method '>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:55:30.389232 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-75b15070-c97c-4fa9-ae7d-c8e2a8c78dfa tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] [instance: 546a77fd-66e1-4d89-afa3-58d632b09186] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:55:30.391913 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG dbcounter [-] [124368] Writing DB stats nova_api:SELECT=53 {{(pid=124368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:55:30.399563 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-75b15070-c97c-4fa9-ae7d-c8e2a8c78dfa tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:55:30.400281 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-75b15070-c97c-4fa9-ae7d-c8e2a8c78dfa tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:55:30.401189 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-75b15070-c97c-4fa9-ae7d-c8e2a8c78dfa tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:55:30.401683 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-75b15070-c97c-4fa9-ae7d-c8e2a8c78dfa tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:55:30.419042 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.wsgi [None req-75b15070-c97c-4fa9-ae7d-c8e2a8c78dfa tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] HTTP exception thrown: Instance 546a77fd-66e1-4d89-afa3-58d632b09186 could not be found. Jul 06 13:55:30.425391 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-75b15070-c97c-4fa9-ae7d-c8e2a8c78dfa tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Request method failure captured: Jul 06 13:55:30.425391 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: request: DELETE /compute/v2.1/servers/546a77fd-66e1-4d89-afa3-58d632b09186 HTTP/1.1 Jul 06 13:55:30.425391 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: Accept: application/json Jul 06 13:55:30.425391 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: Accept-Encoding: identity Jul 06 13:55:30.425391 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: Connection: close Jul 06 13:55:30.425391 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: Content-Length: 0 Jul 06 13:55:30.425391 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: Content-Type: application/json Jul 06 13:55:30.425391 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: Host: 10.222.0.20 Jul 06 13:55:30.425391 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: Openstack-System-Scope: None Jul 06 13:55:30.425391 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: User-Agent: python-urllib3/1.26.9 Jul 06 13:55:30.425391 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Auth-Token: gAAAAABixZH5S3knz4fvYX5rMVzIRaVsYzIKLfrrz8lDPVem74Mg_DTbdjOjiuIblg7Yv_5KYUCq8cU5CAPyveLkwoLjHq0KpmoFJl1HEbcs8GS4ExBwATXjRnPlECQAMq-F6w3rOAPGgVuvSxjNdgiF89mYcHWuNREzSrBRKyP00YlMZ9-oZ94 Jul 06 13:55:30.425391 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Domain-Id: None Jul 06 13:55:30.425391 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Domain-Name: None Jul 06 13:55:30.425391 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Identity-Status: Confirmed Jul 06 13:55:30.425391 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Is-Admin-Project: True Jul 06 13:55:30.425391 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Project-Domain-Id: default Jul 06 13:55:30.425391 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Project-Domain-Name: Default Jul 06 13:55:30.425391 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Project-Id: 05df572327d54bd99595974b75898052 Jul 06 13:55:30.425391 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Project-Name: tempest-AttachVolumeTestJSON-1571746075 Jul 06 13:55:30.425391 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Role: reader,member Jul 06 13:55:30.425391 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Roles: reader,member Jul 06 13:55:30.426757 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_05df572327d54bd99595974b75898052"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/05df572327d54bd99595974b75898052"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/05df572327d54bd99595974b75898052"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/05df572327d54bd99595974b75898052"}]}] Jul 06 13:55:30.426757 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Tenant: tempest-AttachVolumeTestJSON-1571746075 Jul 06 13:55:30.426757 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Tenant-Id: 05df572327d54bd99595974b75898052 Jul 06 13:55:30.426757 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1571746075 Jul 06 13:55:30.426757 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-User: tempest-AttachVolumeTestJSON-1571746075-project Jul 06 13:55:30.426757 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-User-Domain-Id: default Jul 06 13:55:30.426757 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-User-Domain-Name: Default Jul 06 13:55:30.426757 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-User-Id: 3d7cacb73c8342579d9f990b0193487c Jul 06 13:55:30.426757 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-User-Name: tempest-AttachVolumeTestJSON-1571746075-project Jul 06 13:55:30.426757 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: method: > Jul 06 13:55:30.426757 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: exception: Instance 546a77fd-66e1-4d89-afa3-58d632b09186 could not be found. Jul 06 13:55:30.426757 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: action_args: {'id': '546a77fd-66e1-4d89-afa3-58d632b09186'} Jul 06 13:55:30.427496 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 06 13:55:30.427496 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 06 13:55:30.427496 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 06 13:55:30.427496 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 06 13:55:30.427496 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 06 13:55:30.427496 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 06 13:55:30.427496 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 06 13:55:30.427496 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 06 13:55:30.427496 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 06 13:55:30.427496 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 06 13:55:30.427496 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 546a77fd-66e1-4d89-afa3-58d632b09186 could not be found. Jul 06 13:55:30.427496 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi Jul 06 13:55:30.427496 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 06 13:55:30.427496 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi Jul 06 13:55:30.427496 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 06 13:55:30.427496 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 06 13:55:30.427496 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 06 13:55:30.427496 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 06 13:55:30.427496 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 06 13:55:30.427496 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 06 13:55:30.428678 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 06 13:55:30.428678 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 06 13:55:30.428678 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 06 13:55:30.428678 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 06 13:55:30.428678 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 06 13:55:30.428678 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 06 13:55:30.428678 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 06 13:55:30.428678 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 06 13:55:30.428678 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 06 13:55:30.428678 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 546a77fd-66e1-4d89-afa3-58d632b09186 could not be found. Jul 06 13:55:30.428678 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi Jul 06 13:55:30.428678 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 06 13:55:30.428678 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi Jul 06 13:55:30.428678 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 06 13:55:30.428678 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 06 13:55:30.428678 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 06 13:55:30.428678 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 06 13:55:30.428678 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 06 13:55:30.428678 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 546a77fd-66e1-4d89-afa3-58d632b09186 could not be found. Jul 06 13:55:30.428678 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi Jul 06 13:55:30.432230 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-75b15070-c97c-4fa9-ae7d-c8e2a8c78dfa tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Returning 404 to user: Instance 546a77fd-66e1-4d89-afa3-58d632b09186 could not be found. {{(pid=124368) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 06 13:55:30.432447 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-75b15070-c97c-4fa9-ae7d-c8e2a8c78dfa tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] 10.222.0.20 "DELETE /compute/v2.1/servers/546a77fd-66e1-4d89-afa3-58d632b09186" status: 404 len: 111 microversion: 2.1 time: 0.048023 Jul 06 13:55:30.433284 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 501/996] 10.222.0.20 () {58 vars in 1238 bytes} [Wed Jul 6 13:55:30 2022] DELETE /compute/v2.1/servers/546a77fd-66e1-4d89-afa3-58d632b09186 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 06 13:55:30.442378 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-0dabb065-778c-4504-ab51-8ec72a4883c2 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:55:30.443944 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-0dabb065-778c-4504-ab51-8ec72a4883c2 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] [instance: 546a77fd-66e1-4d89-afa3-58d632b09186] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:55:30.452308 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-0dabb065-778c-4504-ab51-8ec72a4883c2 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:55:30.452884 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-0dabb065-778c-4504-ab51-8ec72a4883c2 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:55:30.453882 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-0dabb065-778c-4504-ab51-8ec72a4883c2 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:55:30.454453 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-0dabb065-778c-4504-ab51-8ec72a4883c2 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:55:30.478732 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.wsgi [None req-0dabb065-778c-4504-ab51-8ec72a4883c2 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] HTTP exception thrown: Instance 546a77fd-66e1-4d89-afa3-58d632b09186 could not be found. Jul 06 13:55:30.480353 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-0dabb065-778c-4504-ab51-8ec72a4883c2 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Request method failure captured: Jul 06 13:55:30.480353 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: request: GET /compute/v2.1/servers/546a77fd-66e1-4d89-afa3-58d632b09186 HTTP/1.1 Jul 06 13:55:30.480353 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: Accept: application/json Jul 06 13:55:30.480353 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: Accept-Encoding: identity Jul 06 13:55:30.480353 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: Connection: close Jul 06 13:55:30.480353 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: Content-Length: 0 Jul 06 13:55:30.480353 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: Content-Type: application/json Jul 06 13:55:30.480353 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: Host: 10.222.0.20 Jul 06 13:55:30.480353 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: Openstack-System-Scope: None Jul 06 13:55:30.480353 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: User-Agent: python-urllib3/1.26.9 Jul 06 13:55:30.480353 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: X-Auth-Token: gAAAAABixZH5S3knz4fvYX5rMVzIRaVsYzIKLfrrz8lDPVem74Mg_DTbdjOjiuIblg7Yv_5KYUCq8cU5CAPyveLkwoLjHq0KpmoFJl1HEbcs8GS4ExBwATXjRnPlECQAMq-F6w3rOAPGgVuvSxjNdgiF89mYcHWuNREzSrBRKyP00YlMZ9-oZ94 Jul 06 13:55:30.480353 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: X-Domain-Id: None Jul 06 13:55:30.480353 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: X-Domain-Name: None Jul 06 13:55:30.480353 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: X-Identity-Status: Confirmed Jul 06 13:55:30.480353 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: X-Is-Admin-Project: True Jul 06 13:55:30.480353 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: X-Project-Domain-Id: default Jul 06 13:55:30.480353 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: X-Project-Domain-Name: Default Jul 06 13:55:30.480353 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: X-Project-Id: 05df572327d54bd99595974b75898052 Jul 06 13:55:30.480353 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: X-Project-Name: tempest-AttachVolumeTestJSON-1571746075 Jul 06 13:55:30.480353 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: X-Role: reader,member Jul 06 13:55:30.480353 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: X-Roles: reader,member Jul 06 13:55:30.482484 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_05df572327d54bd99595974b75898052"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/05df572327d54bd99595974b75898052"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/05df572327d54bd99595974b75898052"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/05df572327d54bd99595974b75898052"}]}] Jul 06 13:55:30.482484 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: X-Tenant: tempest-AttachVolumeTestJSON-1571746075 Jul 06 13:55:30.482484 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: X-Tenant-Id: 05df572327d54bd99595974b75898052 Jul 06 13:55:30.482484 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1571746075 Jul 06 13:55:30.482484 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: X-User: tempest-AttachVolumeTestJSON-1571746075-project Jul 06 13:55:30.482484 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: X-User-Domain-Id: default Jul 06 13:55:30.482484 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: X-User-Domain-Name: Default Jul 06 13:55:30.482484 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: X-User-Id: 3d7cacb73c8342579d9f990b0193487c Jul 06 13:55:30.482484 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: X-User-Name: tempest-AttachVolumeTestJSON-1571746075-project Jul 06 13:55:30.482484 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: method: > Jul 06 13:55:30.482484 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: exception: Instance 546a77fd-66e1-4d89-afa3-58d632b09186 could not be found. Jul 06 13:55:30.482484 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: action_args: {'id': '546a77fd-66e1-4d89-afa3-58d632b09186'} Jul 06 13:55:30.483280 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 06 13:55:30.483280 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 06 13:55:30.483280 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 06 13:55:30.483280 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 06 13:55:30.483280 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 06 13:55:30.483280 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 06 13:55:30.483280 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 06 13:55:30.483280 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 06 13:55:30.483280 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 06 13:55:30.483280 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 06 13:55:30.483280 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 546a77fd-66e1-4d89-afa3-58d632b09186 could not be found. Jul 06 13:55:30.483280 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi Jul 06 13:55:30.483280 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 06 13:55:30.483280 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi Jul 06 13:55:30.483280 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 06 13:55:30.483280 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 06 13:55:30.483280 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 06 13:55:30.483280 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 06 13:55:30.483280 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 06 13:55:30.483280 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 06 13:55:30.485453 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 06 13:55:30.485453 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 06 13:55:30.485453 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 06 13:55:30.485453 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 06 13:55:30.485453 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 06 13:55:30.485453 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 06 13:55:30.485453 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 06 13:55:30.485453 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 546a77fd-66e1-4d89-afa3-58d632b09186 could not be found. Jul 06 13:55:30.485453 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi Jul 06 13:55:30.485453 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 06 13:55:30.485453 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi Jul 06 13:55:30.485453 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 06 13:55:30.485453 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 06 13:55:30.485453 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 06 13:55:30.485453 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 06 13:55:30.485453 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 06 13:55:30.485453 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 546a77fd-66e1-4d89-afa3-58d632b09186 could not be found. Jul 06 13:55:30.485453 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi Jul 06 13:55:30.494369 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-0dabb065-778c-4504-ab51-8ec72a4883c2 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] Returning 404 to user: Instance 546a77fd-66e1-4d89-afa3-58d632b09186 could not be found. {{(pid=124367) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 06 13:55:30.494369 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-0dabb065-778c-4504-ab51-8ec72a4883c2 tempest-AttachVolumeTestJSON-1571746075 tempest-AttachVolumeTestJSON-1571746075-project] 10.222.0.20 "GET /compute/v2.1/servers/546a77fd-66e1-4d89-afa3-58d632b09186" status: 404 len: 111 microversion: 2.1 time: 0.045495 Jul 06 13:55:30.494369 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 496/997] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:55:30 2022] GET /compute/v2.1/servers/546a77fd-66e1-4d89-afa3-58d632b09186 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 06 13:55:30.864039 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-55da5bae-7d11-48d4-9654-0d93cdbf5b00 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Calling method '>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:55:30.864710 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-55da5bae-7d11-48d4-9654-0d93cdbf5b00 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] [instance: 4c0c4bb6-269f-46bc-b460-7d0299277753] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:55:30.882957 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-55da5bae-7d11-48d4-9654-0d93cdbf5b00 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:55:30.883571 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-55da5bae-7d11-48d4-9654-0d93cdbf5b00 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:55:30.884636 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-55da5bae-7d11-48d4-9654-0d93cdbf5b00 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:55:30.885221 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-55da5bae-7d11-48d4-9654-0d93cdbf5b00 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:55:31.065317 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-55da5bae-7d11-48d4-9654-0d93cdbf5b00 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c85251638bc64deca16008b696b11ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3edb8d53184b98b7055ffc145f186d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:55:31.075489 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-55da5bae-7d11-48d4-9654-0d93cdbf5b00 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c85251638bc64deca16008b696b11ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3edb8d53184b98b7055ffc145f186d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:55:31.078513 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-55da5bae-7d11-48d4-9654-0d93cdbf5b00 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c85251638bc64deca16008b696b11ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3edb8d53184b98b7055ffc145f186d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:55:31.079896 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-55da5bae-7d11-48d4-9654-0d93cdbf5b00 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] 10.222.0.20 "GET /compute/v2.1/servers/4c0c4bb6-269f-46bc-b460-7d0299277753" status: 200 len: 1739 microversion: 2.20 time: 0.219983 Jul 06 13:55:31.080956 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 502/998] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 6 13:55:30 2022] GET /compute/v2.1/servers/4c0c4bb6-269f-46bc-b460-7d0299277753 => generated 1739 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 06 13:55:31.408800 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-fc1ee523-1a87-4af7-9ff1-1ae451933faf tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:55:31.409412 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-fc1ee523-1a87-4af7-9ff1-1ae451933faf tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] [instance: 5fa482da-0cca-4e1c-9724-e4d5ee9d73fa] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:55:31.420130 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-fc1ee523-1a87-4af7-9ff1-1ae451933faf tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:55:31.420904 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-fc1ee523-1a87-4af7-9ff1-1ae451933faf tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:55:31.421865 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-fc1ee523-1a87-4af7-9ff1-1ae451933faf tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:55:31.422454 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-fc1ee523-1a87-4af7-9ff1-1ae451933faf tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:55:31.523810 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.objects.instance [None req-fc1ee523-1a87-4af7-9ff1-1ae451933faf tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lazy-loading 'services' on Instance uuid 5fa482da-0cca-4e1c-9724-e4d5ee9d73fa {{(pid=124367) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 06 13:55:31.635319 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-fc1ee523-1a87-4af7-9ff1-1ae451933faf tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] 10.222.0.20 "DELETE /compute/v2.1/servers/5fa482da-0cca-4e1c-9724-e4d5ee9d73fa/os-volume_attachments/3f3dbdf8-ac2a-44ed-97fd-711ccab89b65" status: 202 len: 0 microversion: 2.1 time: 0.230186 Jul 06 13:55:31.636221 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 497/999] 10.222.0.20 () {58 vars in 1415 bytes} [Wed Jul 6 13:55:31 2022] DELETE /compute/v2.1/servers/5fa482da-0cca-4e1c-9724-e4d5ee9d73fa/os-volume_attachments/3f3dbdf8-ac2a-44ed-97fd-711ccab89b65 => generated 0 bytes in 232 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 06 13:55:31.646414 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-a1880245-96ea-4055-b5a1-36c028a34895 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Calling method '>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:55:31.649209 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-a1880245-96ea-4055-b5a1-36c028a34895 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] [instance: 5fa482da-0cca-4e1c-9724-e4d5ee9d73fa] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:55:31.659142 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-a1880245-96ea-4055-b5a1-36c028a34895 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:55:31.659969 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-a1880245-96ea-4055-b5a1-36c028a34895 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:55:31.661340 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-a1880245-96ea-4055-b5a1-36c028a34895 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:55:31.661992 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-a1880245-96ea-4055-b5a1-36c028a34895 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:55:31.707668 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-a1880245-96ea-4055-b5a1-36c028a34895 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] 10.222.0.20 "GET /compute/v2.1/servers/5fa482da-0cca-4e1c-9724-e4d5ee9d73fa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059941 Jul 06 13:55:31.711893 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 503/1000] 10.222.0.20 () {58 vars in 1301 bytes} [Wed Jul 6 13:55:31 2022] GET /compute/v2.1/servers/5fa482da-0cca-4e1c-9724-e4d5ee9d73fa/os-volume_attachments => generated 197 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 06 13:55:32.101936 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-aecd6ad4-a824-410e-81bd-f5ca566320b1 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:55:32.103036 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-aecd6ad4-a824-410e-81bd-f5ca566320b1 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] [instance: 4c0c4bb6-269f-46bc-b460-7d0299277753] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:55:32.110631 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-aecd6ad4-a824-410e-81bd-f5ca566320b1 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:55:32.111989 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-aecd6ad4-a824-410e-81bd-f5ca566320b1 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:55:32.113404 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-aecd6ad4-a824-410e-81bd-f5ca566320b1 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:55:32.114323 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-aecd6ad4-a824-410e-81bd-f5ca566320b1 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:55:32.369612 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-aecd6ad4-a824-410e-81bd-f5ca566320b1 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c85251638bc64deca16008b696b11ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3edb8d53184b98b7055ffc145f186d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:55:32.379124 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-aecd6ad4-a824-410e-81bd-f5ca566320b1 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c85251638bc64deca16008b696b11ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3edb8d53184b98b7055ffc145f186d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:55:32.380798 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-aecd6ad4-a824-410e-81bd-f5ca566320b1 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c85251638bc64deca16008b696b11ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3edb8d53184b98b7055ffc145f186d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:55:32.382240 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-aecd6ad4-a824-410e-81bd-f5ca566320b1 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] 10.222.0.20 "GET /compute/v2.1/servers/4c0c4bb6-269f-46bc-b460-7d0299277753" status: 200 len: 1739 microversion: 2.20 time: 0.285190 Jul 06 13:55:32.382955 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 498/1001] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 6 13:55:32 2022] GET /compute/v2.1/servers/4c0c4bb6-269f-46bc-b460-7d0299277753 => generated 1739 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 06 13:55:32.719987 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-2a9cc182-bc69-40db-add1-cefe7651e662 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Calling method '>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:55:32.743881 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-2a9cc182-bc69-40db-add1-cefe7651e662 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] [instance: 5fa482da-0cca-4e1c-9724-e4d5ee9d73fa] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:55:32.757698 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-2a9cc182-bc69-40db-add1-cefe7651e662 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:55:32.758197 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-2a9cc182-bc69-40db-add1-cefe7651e662 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:55:32.759038 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-2a9cc182-bc69-40db-add1-cefe7651e662 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:55:32.759485 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-2a9cc182-bc69-40db-add1-cefe7651e662 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:55:32.798659 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-2a9cc182-bc69-40db-add1-cefe7651e662 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] 10.222.0.20 "GET /compute/v2.1/servers/5fa482da-0cca-4e1c-9724-e4d5ee9d73fa/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.082630 Jul 06 13:55:32.804608 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 504/1002] 10.222.0.20 () {58 vars in 1301 bytes} [Wed Jul 6 13:55:32 2022] GET /compute/v2.1/servers/5fa482da-0cca-4e1c-9724-e4d5ee9d73fa/os-volume_attachments => generated 25 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 06 13:55:32.899450 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-f943a8ee-6781-476b-a19b-231471840d86 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:55:32.900617 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-f943a8ee-6781-476b-a19b-231471840d86 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] [instance: 5fa482da-0cca-4e1c-9724-e4d5ee9d73fa] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:55:32.908378 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-f943a8ee-6781-476b-a19b-231471840d86 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:55:32.909156 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-f943a8ee-6781-476b-a19b-231471840d86 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:55:32.910132 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-f943a8ee-6781-476b-a19b-231471840d86 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:55:32.910775 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-f943a8ee-6781-476b-a19b-231471840d86 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:55:32.939433 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-f943a8ee-6781-476b-a19b-231471840d86 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] [instance: 5fa482da-0cca-4e1c-9724-e4d5ee9d73fa] Going to try to terminate instance {{(pid=124367) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 06 13:55:33.046025 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-f943a8ee-6781-476b-a19b-231471840d86 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] 10.222.0.20 "DELETE /compute/v2.1/servers/5fa482da-0cca-4e1c-9724-e4d5ee9d73fa" status: 204 len: 0 microversion: 2.1 time: 0.149298 Jul 06 13:55:33.051543 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 499/1003] 10.222.0.20 () {58 vars in 1238 bytes} [Wed Jul 6 13:55:32 2022] DELETE /compute/v2.1/servers/5fa482da-0cca-4e1c-9724-e4d5ee9d73fa => generated 0 bytes in 153 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 06 13:55:33.057634 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-e0ad94e4-ee55-4fe8-87cd-b159ac51149b tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Calling method '>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:55:33.058659 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-e0ad94e4-ee55-4fe8-87cd-b159ac51149b tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] [instance: 5fa482da-0cca-4e1c-9724-e4d5ee9d73fa] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:55:33.065241 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-e0ad94e4-ee55-4fe8-87cd-b159ac51149b tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:55:33.065934 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-e0ad94e4-ee55-4fe8-87cd-b159ac51149b tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:55:33.066867 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-e0ad94e4-ee55-4fe8-87cd-b159ac51149b tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:55:33.067461 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-e0ad94e4-ee55-4fe8-87cd-b159ac51149b tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:55:33.236599 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-e0ad94e4-ee55-4fe8-87cd-b159ac51149b tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b572a8f465048558fc969b85b2aec5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd85f2a57a0847debf5aaf81aab7a638', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:55:33.240413 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG dbcounter [-] [124368] Writing DB stats nova_cell1:SELECT=100 {{(pid=124368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:55:33.249760 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-e0ad94e4-ee55-4fe8-87cd-b159ac51149b tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] 10.222.0.20 "GET /compute/v2.1/servers/5fa482da-0cca-4e1c-9724-e4d5ee9d73fa" status: 200 len: 1682 microversion: 2.1 time: 0.197086 Jul 06 13:55:33.251047 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 505/1004] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:55:33 2022] GET /compute/v2.1/servers/5fa482da-0cca-4e1c-9724-e4d5ee9d73fa => generated 1682 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:55:33.401223 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-cc1c493f-5c92-4ced-964e-c8c8c2d3050d tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:55:33.402022 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-cc1c493f-5c92-4ced-964e-c8c8c2d3050d tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] [instance: 4c0c4bb6-269f-46bc-b460-7d0299277753] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:55:33.409897 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-cc1c493f-5c92-4ced-964e-c8c8c2d3050d tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:55:33.409897 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-cc1c493f-5c92-4ced-964e-c8c8c2d3050d tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:55:33.410884 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-cc1c493f-5c92-4ced-964e-c8c8c2d3050d tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:55:33.411012 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-cc1c493f-5c92-4ced-964e-c8c8c2d3050d tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:55:33.699822 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-cc1c493f-5c92-4ced-964e-c8c8c2d3050d tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c85251638bc64deca16008b696b11ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3edb8d53184b98b7055ffc145f186d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:55:33.708929 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-cc1c493f-5c92-4ced-964e-c8c8c2d3050d tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c85251638bc64deca16008b696b11ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3edb8d53184b98b7055ffc145f186d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:55:33.710743 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-cc1c493f-5c92-4ced-964e-c8c8c2d3050d tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c85251638bc64deca16008b696b11ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3edb8d53184b98b7055ffc145f186d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:55:33.712049 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-cc1c493f-5c92-4ced-964e-c8c8c2d3050d tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] 10.222.0.20 "GET /compute/v2.1/servers/4c0c4bb6-269f-46bc-b460-7d0299277753" status: 200 len: 1739 microversion: 2.20 time: 0.315119 Jul 06 13:55:33.717099 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 500/1005] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 6 13:55:33 2022] GET /compute/v2.1/servers/4c0c4bb6-269f-46bc-b460-7d0299277753 => generated 1739 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 06 13:55:34.268325 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-bfd458e4-28c4-417d-a2bd-9b73c17fcfc6 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Calling method '>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:55:34.268939 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-bfd458e4-28c4-417d-a2bd-9b73c17fcfc6 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] [instance: 5fa482da-0cca-4e1c-9724-e4d5ee9d73fa] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:55:34.276715 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-bfd458e4-28c4-417d-a2bd-9b73c17fcfc6 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:55:34.277276 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-bfd458e4-28c4-417d-a2bd-9b73c17fcfc6 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:55:34.278288 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-bfd458e4-28c4-417d-a2bd-9b73c17fcfc6 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:55:34.279131 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-bfd458e4-28c4-417d-a2bd-9b73c17fcfc6 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:55:34.552027 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-bfd458e4-28c4-417d-a2bd-9b73c17fcfc6 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b572a8f465048558fc969b85b2aec5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd85f2a57a0847debf5aaf81aab7a638', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:55:34.560747 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-bfd458e4-28c4-417d-a2bd-9b73c17fcfc6 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] 10.222.0.20 "GET /compute/v2.1/servers/5fa482da-0cca-4e1c-9724-e4d5ee9d73fa" status: 200 len: 1682 microversion: 2.1 time: 0.296197 Jul 06 13:55:34.570645 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 506/1006] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:55:34 2022] GET /compute/v2.1/servers/5fa482da-0cca-4e1c-9724-e4d5ee9d73fa => generated 1682 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:55:34.742826 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-34b147b7-4470-4b4e-85f2-c5602ecce36c tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:55:34.743436 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-34b147b7-4470-4b4e-85f2-c5602ecce36c tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] [instance: 4c0c4bb6-269f-46bc-b460-7d0299277753] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:55:34.750059 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-34b147b7-4470-4b4e-85f2-c5602ecce36c tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:55:34.750399 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-34b147b7-4470-4b4e-85f2-c5602ecce36c tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:55:34.751131 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-34b147b7-4470-4b4e-85f2-c5602ecce36c tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:55:34.751563 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-34b147b7-4470-4b4e-85f2-c5602ecce36c tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:55:34.928015 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-34b147b7-4470-4b4e-85f2-c5602ecce36c tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c85251638bc64deca16008b696b11ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3edb8d53184b98b7055ffc145f186d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:55:34.937703 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-34b147b7-4470-4b4e-85f2-c5602ecce36c tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c85251638bc64deca16008b696b11ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3edb8d53184b98b7055ffc145f186d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:55:34.939233 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-34b147b7-4470-4b4e-85f2-c5602ecce36c tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c85251638bc64deca16008b696b11ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3edb8d53184b98b7055ffc145f186d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:55:34.940479 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-34b147b7-4470-4b4e-85f2-c5602ecce36c tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] 10.222.0.20 "GET /compute/v2.1/servers/4c0c4bb6-269f-46bc-b460-7d0299277753" status: 200 len: 1739 microversion: 2.20 time: 0.201482 Jul 06 13:55:34.941065 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 501/1007] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 6 13:55:34 2022] GET /compute/v2.1/servers/4c0c4bb6-269f-46bc-b460-7d0299277753 => generated 1739 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 06 13:55:35.580309 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-e52e89f8-0d94-433f-b4ea-14f28e83a9d7 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Calling method '>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:55:35.581121 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-e52e89f8-0d94-433f-b4ea-14f28e83a9d7 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] [instance: 5fa482da-0cca-4e1c-9724-e4d5ee9d73fa] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:55:35.587780 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-e52e89f8-0d94-433f-b4ea-14f28e83a9d7 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:55:35.588344 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-e52e89f8-0d94-433f-b4ea-14f28e83a9d7 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:55:35.589275 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-e52e89f8-0d94-433f-b4ea-14f28e83a9d7 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:55:35.589809 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-e52e89f8-0d94-433f-b4ea-14f28e83a9d7 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:55:35.736553 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-e52e89f8-0d94-433f-b4ea-14f28e83a9d7 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b572a8f465048558fc969b85b2aec5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd85f2a57a0847debf5aaf81aab7a638', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:55:35.744811 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-e52e89f8-0d94-433f-b4ea-14f28e83a9d7 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] 10.222.0.20 "GET /compute/v2.1/servers/5fa482da-0cca-4e1c-9724-e4d5ee9d73fa" status: 200 len: 1682 microversion: 2.1 time: 0.170555 Jul 06 13:55:35.745498 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 507/1008] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:55:35 2022] GET /compute/v2.1/servers/5fa482da-0cca-4e1c-9724-e4d5ee9d73fa => generated 1682 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:55:35.959121 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-04cfe1a2-5ebe-4c6a-b017-f8c526595d43 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:55:35.960760 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-04cfe1a2-5ebe-4c6a-b017-f8c526595d43 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] [instance: 4c0c4bb6-269f-46bc-b460-7d0299277753] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:55:35.968713 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-04cfe1a2-5ebe-4c6a-b017-f8c526595d43 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:55:35.969355 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-04cfe1a2-5ebe-4c6a-b017-f8c526595d43 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:55:35.970470 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-04cfe1a2-5ebe-4c6a-b017-f8c526595d43 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:55:35.971242 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-04cfe1a2-5ebe-4c6a-b017-f8c526595d43 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:55:35.992558 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG dbcounter [-] [124367] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=4,nova_cell1:UPDATE=3 {{(pid=124367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:55:36.560161 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-04cfe1a2-5ebe-4c6a-b017-f8c526595d43 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c85251638bc64deca16008b696b11ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3edb8d53184b98b7055ffc145f186d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:55:36.569375 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-04cfe1a2-5ebe-4c6a-b017-f8c526595d43 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c85251638bc64deca16008b696b11ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3edb8d53184b98b7055ffc145f186d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:55:36.571322 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-04cfe1a2-5ebe-4c6a-b017-f8c526595d43 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c85251638bc64deca16008b696b11ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3edb8d53184b98b7055ffc145f186d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:55:36.572919 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-04cfe1a2-5ebe-4c6a-b017-f8c526595d43 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] 10.222.0.20 "GET /compute/v2.1/servers/4c0c4bb6-269f-46bc-b460-7d0299277753" status: 200 len: 1721 microversion: 2.20 time: 0.618093 Jul 06 13:55:36.573928 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 502/1009] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 6 13:55:35 2022] GET /compute/v2.1/servers/4c0c4bb6-269f-46bc-b460-7d0299277753 => generated 1721 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 06 13:55:36.761830 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-648e42a6-c48c-43c4-b56a-ec8c193bdf0e tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Calling method '>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:55:36.762446 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-648e42a6-c48c-43c4-b56a-ec8c193bdf0e tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] [instance: 5fa482da-0cca-4e1c-9724-e4d5ee9d73fa] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:55:36.769574 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-648e42a6-c48c-43c4-b56a-ec8c193bdf0e tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:55:36.770030 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-648e42a6-c48c-43c4-b56a-ec8c193bdf0e tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:55:36.770799 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-648e42a6-c48c-43c4-b56a-ec8c193bdf0e tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:55:36.772401 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-648e42a6-c48c-43c4-b56a-ec8c193bdf0e tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:55:36.844249 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-648e42a6-c48c-43c4-b56a-ec8c193bdf0e tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b572a8f465048558fc969b85b2aec5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd85f2a57a0847debf5aaf81aab7a638', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:55:36.852413 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-648e42a6-c48c-43c4-b56a-ec8c193bdf0e tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] 10.222.0.20 "GET /compute/v2.1/servers/5fa482da-0cca-4e1c-9724-e4d5ee9d73fa" status: 200 len: 1615 microversion: 2.1 time: 0.094305 Jul 06 13:55:36.853019 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 508/1010] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:55:36 2022] GET /compute/v2.1/servers/5fa482da-0cca-4e1c-9724-e4d5ee9d73fa => generated 1615 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:55:36.949128 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [req-164ecf12-4594-4784-b611-009b87c9246c req-7ad93a5c-0983-438f-9546-dd76d1a98013 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5fa482da-0cca-4e1c-9724-e4d5ee9d73fa", "name": "network-vif-deleted", "tag": "ff54c39f-c144-43d9-b98e-674c20269a43"}]} {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 06 13:55:36.958870 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [req-164ecf12-4594-4784-b611-009b87c9246c req-7ad93a5c-0983-438f-9546-dd76d1a98013 service nova] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:55:36.959229 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [req-164ecf12-4594-4784-b611-009b87c9246c req-7ad93a5c-0983-438f-9546-dd76d1a98013 service nova] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:55:36.972885 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.compute.server_external_events [req-164ecf12-4594-4784-b611-009b87c9246c req-7ad93a5c-0983-438f-9546-dd76d1a98013 service nova] Creating event network-vif-deleted:ff54c39f-c144-43d9-b98e-674c20269a43 for instance 5fa482da-0cca-4e1c-9724-e4d5ee9d73fa on hv-cinder-81914 Jul 06 13:55:36.977938 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [req-164ecf12-4594-4784-b611-009b87c9246c req-7ad93a5c-0983-438f-9546-dd76d1a98013 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033476 Jul 06 13:55:36.982292 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 503/1011] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 6 13:55:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 06 13:55:37.594637 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-59cd7f21-4b78-4a48-9bc0-a291b095ebf3 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Calling method '>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:55:37.595265 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-59cd7f21-4b78-4a48-9bc0-a291b095ebf3 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] [instance: 4c0c4bb6-269f-46bc-b460-7d0299277753] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:55:37.602147 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-59cd7f21-4b78-4a48-9bc0-a291b095ebf3 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:55:37.602561 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-59cd7f21-4b78-4a48-9bc0-a291b095ebf3 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:55:37.603402 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-59cd7f21-4b78-4a48-9bc0-a291b095ebf3 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:55:37.603771 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-59cd7f21-4b78-4a48-9bc0-a291b095ebf3 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:55:37.761527 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-59cd7f21-4b78-4a48-9bc0-a291b095ebf3 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c85251638bc64deca16008b696b11ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3edb8d53184b98b7055ffc145f186d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:55:37.770382 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-59cd7f21-4b78-4a48-9bc0-a291b095ebf3 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c85251638bc64deca16008b696b11ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3edb8d53184b98b7055ffc145f186d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:55:37.771959 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-59cd7f21-4b78-4a48-9bc0-a291b095ebf3 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c85251638bc64deca16008b696b11ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3edb8d53184b98b7055ffc145f186d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:55:37.774858 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-59cd7f21-4b78-4a48-9bc0-a291b095ebf3 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] 10.222.0.20 "GET /compute/v2.1/servers/4c0c4bb6-269f-46bc-b460-7d0299277753" status: 200 len: 1721 microversion: 2.20 time: 0.184166 Jul 06 13:55:37.775693 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 509/1012] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 6 13:55:37 2022] GET /compute/v2.1/servers/4c0c4bb6-269f-46bc-b460-7d0299277753 => generated 1721 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 06 13:55:37.875583 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-1431f57b-1fdd-4d5f-890d-990fdc47c1ee tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:55:37.876645 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-1431f57b-1fdd-4d5f-890d-990fdc47c1ee tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] [instance: 5fa482da-0cca-4e1c-9724-e4d5ee9d73fa] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:55:37.883572 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-1431f57b-1fdd-4d5f-890d-990fdc47c1ee tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:55:37.884554 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-1431f57b-1fdd-4d5f-890d-990fdc47c1ee tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:55:37.885380 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-1431f57b-1fdd-4d5f-890d-990fdc47c1ee tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:55:37.885815 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-1431f57b-1fdd-4d5f-890d-990fdc47c1ee tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:55:37.975986 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-1431f57b-1fdd-4d5f-890d-990fdc47c1ee tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b572a8f465048558fc969b85b2aec5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd85f2a57a0847debf5aaf81aab7a638', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:55:37.990566 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-1431f57b-1fdd-4d5f-890d-990fdc47c1ee tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] 10.222.0.20 "GET /compute/v2.1/servers/5fa482da-0cca-4e1c-9724-e4d5ee9d73fa" status: 200 len: 1615 microversion: 2.1 time: 0.122775 Jul 06 13:55:37.991168 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 504/1013] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:55:37 2022] GET /compute/v2.1/servers/5fa482da-0cca-4e1c-9724-e4d5ee9d73fa => generated 1615 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:55:38.795063 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-b52ced0c-fa80-42ed-a0f4-24a396f38a70 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Calling method '>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:55:38.795786 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-b52ced0c-fa80-42ed-a0f4-24a396f38a70 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] [instance: 4c0c4bb6-269f-46bc-b460-7d0299277753] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:55:38.803126 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-b52ced0c-fa80-42ed-a0f4-24a396f38a70 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:55:38.803512 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-b52ced0c-fa80-42ed-a0f4-24a396f38a70 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:55:38.805446 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-b52ced0c-fa80-42ed-a0f4-24a396f38a70 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:55:38.806255 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-b52ced0c-fa80-42ed-a0f4-24a396f38a70 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:55:38.966709 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-b52ced0c-fa80-42ed-a0f4-24a396f38a70 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c85251638bc64deca16008b696b11ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3edb8d53184b98b7055ffc145f186d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:55:38.974931 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-b52ced0c-fa80-42ed-a0f4-24a396f38a70 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c85251638bc64deca16008b696b11ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3edb8d53184b98b7055ffc145f186d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:55:38.976527 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-b52ced0c-fa80-42ed-a0f4-24a396f38a70 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c85251638bc64deca16008b696b11ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3edb8d53184b98b7055ffc145f186d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:55:38.977729 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-b52ced0c-fa80-42ed-a0f4-24a396f38a70 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] 10.222.0.20 "GET /compute/v2.1/servers/4c0c4bb6-269f-46bc-b460-7d0299277753" status: 200 len: 1724 microversion: 2.20 time: 0.187322 Jul 06 13:55:38.978322 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 510/1014] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 6 13:55:38 2022] GET /compute/v2.1/servers/4c0c4bb6-269f-46bc-b460-7d0299277753 => generated 1724 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 06 13:55:38.996806 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-2dd18ece-b022-4cfb-b7bf-6b8fc1547599 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c9da8df1-73a6-4b95-9f0d-980f961c7ec9"}} {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 06 13:55:38.998856 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-2dd18ece-b022-4cfb-b7bf-6b8fc1547599 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] [instance: 4c0c4bb6-269f-46bc-b460-7d0299277753] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:55:39.005925 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-2dd18ece-b022-4cfb-b7bf-6b8fc1547599 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:55:39.006530 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-2dd18ece-b022-4cfb-b7bf-6b8fc1547599 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:55:39.007384 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-2dd18ece-b022-4cfb-b7bf-6b8fc1547599 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:55:39.008038 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-2dd18ece-b022-4cfb-b7bf-6b8fc1547599 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:55:39.009192 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-cc94085d-b935-4333-b068-7d78022ce846 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Calling method '>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:55:39.009818 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-cc94085d-b935-4333-b068-7d78022ce846 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] [instance: 5fa482da-0cca-4e1c-9724-e4d5ee9d73fa] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:55:39.019650 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-cc94085d-b935-4333-b068-7d78022ce846 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:55:39.020122 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-cc94085d-b935-4333-b068-7d78022ce846 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:55:39.020895 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-cc94085d-b935-4333-b068-7d78022ce846 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:55:39.021356 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-cc94085d-b935-4333-b068-7d78022ce846 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:55:39.038935 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.wsgi [None req-cc94085d-b935-4333-b068-7d78022ce846 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] HTTP exception thrown: Instance 5fa482da-0cca-4e1c-9724-e4d5ee9d73fa could not be found. Jul 06 13:55:39.040408 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-cc94085d-b935-4333-b068-7d78022ce846 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Request method failure captured: Jul 06 13:55:39.040408 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: request: GET /compute/v2.1/servers/5fa482da-0cca-4e1c-9724-e4d5ee9d73fa HTTP/1.1 Jul 06 13:55:39.040408 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: Accept: application/json Jul 06 13:55:39.040408 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: Accept-Encoding: identity Jul 06 13:55:39.040408 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: Connection: close Jul 06 13:55:39.040408 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: Content-Length: 0 Jul 06 13:55:39.040408 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: Content-Type: application/json Jul 06 13:55:39.040408 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: Host: 10.222.0.20 Jul 06 13:55:39.040408 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: Openstack-System-Scope: None Jul 06 13:55:39.040408 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: User-Agent: python-urllib3/1.26.9 Jul 06 13:55:39.040408 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Auth-Token: gAAAAABixZH4I4dgmb0Q3wbjrFWrBMh6OmJtrlg6lZ88SjHzAtW3fxMyo3s0_pJVvHdnPyxERhBQTWBNewTHA0QeJRzzLbnn4Csb1lAz3C9NjKcuSHUaArYBZ7P3u01dtbqramyieBExBREkl13A9tBRRuVoPmOumXVJ74UVBAMWWamo1ttSwGg Jul 06 13:55:39.040408 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Domain-Id: None Jul 06 13:55:39.040408 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Domain-Name: None Jul 06 13:55:39.040408 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Identity-Status: Confirmed Jul 06 13:55:39.040408 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Is-Admin-Project: True Jul 06 13:55:39.040408 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Project-Domain-Id: default Jul 06 13:55:39.040408 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Project-Domain-Name: Default Jul 06 13:55:39.040408 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Project-Id: bd85f2a57a0847debf5aaf81aab7a638 Jul 06 13:55:39.040408 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Project-Name: tempest-AttachVolumeNegativeTest-1016924223 Jul 06 13:55:39.040408 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Role: reader,member Jul 06 13:55:39.040408 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Roles: reader,member Jul 06 13:55:39.041918 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_bd85f2a57a0847debf5aaf81aab7a638"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/bd85f2a57a0847debf5aaf81aab7a638"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/bd85f2a57a0847debf5aaf81aab7a638"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/bd85f2a57a0847debf5aaf81aab7a638"}]}] Jul 06 13:55:39.041918 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Tenant: tempest-AttachVolumeNegativeTest-1016924223 Jul 06 13:55:39.041918 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Tenant-Id: bd85f2a57a0847debf5aaf81aab7a638 Jul 06 13:55:39.041918 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1016924223 Jul 06 13:55:39.041918 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-User: tempest-AttachVolumeNegativeTest-1016924223-project Jul 06 13:55:39.041918 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-User-Domain-Id: default Jul 06 13:55:39.041918 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-User-Domain-Name: Default Jul 06 13:55:39.041918 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-User-Id: 7b572a8f465048558fc969b85b2aec5b Jul 06 13:55:39.041918 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-User-Name: tempest-AttachVolumeNegativeTest-1016924223-project Jul 06 13:55:39.041918 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: method: > Jul 06 13:55:39.041918 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: exception: Instance 5fa482da-0cca-4e1c-9724-e4d5ee9d73fa could not be found. Jul 06 13:55:39.041918 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: action_args: {'id': '5fa482da-0cca-4e1c-9724-e4d5ee9d73fa'} Jul 06 13:55:39.047641 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 06 13:55:39.047641 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 06 13:55:39.047641 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 06 13:55:39.047641 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 06 13:55:39.047641 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 06 13:55:39.047641 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 06 13:55:39.047641 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 06 13:55:39.047641 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 06 13:55:39.047641 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 06 13:55:39.047641 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 06 13:55:39.047641 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5fa482da-0cca-4e1c-9724-e4d5ee9d73fa could not be found. Jul 06 13:55:39.047641 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi Jul 06 13:55:39.047641 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 06 13:55:39.047641 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi Jul 06 13:55:39.047641 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 06 13:55:39.047641 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 06 13:55:39.047641 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 06 13:55:39.047641 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 06 13:55:39.047641 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 06 13:55:39.047641 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 06 13:55:39.049316 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 06 13:55:39.049316 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 06 13:55:39.049316 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 06 13:55:39.049316 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 06 13:55:39.049316 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 06 13:55:39.049316 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 06 13:55:39.049316 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 06 13:55:39.049316 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5fa482da-0cca-4e1c-9724-e4d5ee9d73fa could not be found. Jul 06 13:55:39.049316 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi Jul 06 13:55:39.049316 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 06 13:55:39.049316 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi Jul 06 13:55:39.049316 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 06 13:55:39.049316 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 06 13:55:39.049316 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 06 13:55:39.049316 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 06 13:55:39.049316 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 06 13:55:39.049316 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5fa482da-0cca-4e1c-9724-e4d5ee9d73fa could not be found. Jul 06 13:55:39.049316 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi Jul 06 13:55:39.052197 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-cc94085d-b935-4333-b068-7d78022ce846 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Returning 404 to user: Instance 5fa482da-0cca-4e1c-9724-e4d5ee9d73fa could not be found. {{(pid=124368) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 06 13:55:39.052197 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-cc94085d-b935-4333-b068-7d78022ce846 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] 10.222.0.20 "GET /compute/v2.1/servers/5fa482da-0cca-4e1c-9724-e4d5ee9d73fa" status: 404 len: 111 microversion: 2.1 time: 0.036871 Jul 06 13:55:39.052197 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 511/1015] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:55:39 2022] GET /compute/v2.1/servers/5fa482da-0cca-4e1c-9724-e4d5ee9d73fa => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 06 13:55:39.052197 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-307f289c-b87a-40c6-b58f-d50fff184a9a tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Calling method '.version_select at 0x7ffbc41960d0>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:55:39.073927 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-307f289c-b87a-40c6-b58f-d50fff184a9a tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1778301655" status: 202 len: 0 microversion: 2.1 time: 0.026210 Jul 06 13:55:39.077060 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 512/1016] 10.222.0.20 () {58 vars in 1220 bytes} [Wed Jul 6 13:55:39 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1778301655 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 06 13:55:39.327590 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [req-d6f5f456-c4cb-4451-be4c-68514cfcdc50 req-d1a9e675-c2d5-4b3c-87ee-4a0ffd1e84f6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4c0c4bb6-269f-46bc-b460-7d0299277753", "name": "network-vif-unplugged", "status": "completed", "tag": "92164628-0711-4bbe-835d-289c030d699a"}]} {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 06 13:55:39.346457 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [req-d6f5f456-c4cb-4451-be4c-68514cfcdc50 req-d1a9e675-c2d5-4b3c-87ee-4a0ffd1e84f6 service nova] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:55:39.347037 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [req-d6f5f456-c4cb-4451-be4c-68514cfcdc50 req-d1a9e675-c2d5-4b3c-87ee-4a0ffd1e84f6 service nova] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:55:39.360765 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.compute.server_external_events [req-d6f5f456-c4cb-4451-be4c-68514cfcdc50 req-d1a9e675-c2d5-4b3c-87ee-4a0ffd1e84f6 service nova] Unable to find a host for instance 4c0c4bb6-269f-46bc-b460-7d0299277753. Dropping event network-vif-unplugged {{(pid=124368) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jul 06 13:55:39.363019 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [req-d6f5f456-c4cb-4451-be4c-68514cfcdc50 req-d1a9e675-c2d5-4b3c-87ee-4a0ffd1e84f6 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.041495 Jul 06 13:55:39.364218 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 513/1017] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 6 13:55:39 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 44 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Jul 06 13:55:39.427752 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-2dd18ece-b022-4cfb-b7bf-6b8fc1547599 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] 10.222.0.20 "POST /compute/v2.1/servers/4c0c4bb6-269f-46bc-b460-7d0299277753/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.434871 Jul 06 13:55:39.428463 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 505/1018] 10.222.0.20 () {62 vars in 1363 bytes} [Wed Jul 6 13:55:38 2022] POST /compute/v2.1/servers/4c0c4bb6-269f-46bc-b460-7d0299277753/os-volume_attachments => generated 188 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 06 13:55:39.565756 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-d7bde6c3-e206-4a8f-855f-901662e01911 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 06 13:55:39.566329 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-d7bde6c3-e206-4a8f-855f-901662e01911 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] [instance: 4c0c4bb6-269f-46bc-b460-7d0299277753] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:55:39.572327 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-d7bde6c3-e206-4a8f-855f-901662e01911 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:55:39.573329 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-d7bde6c3-e206-4a8f-855f-901662e01911 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:55:39.574137 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-d7bde6c3-e206-4a8f-855f-901662e01911 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:55:39.574578 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-d7bde6c3-e206-4a8f-855f-901662e01911 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:55:39.662303 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-d7bde6c3-e206-4a8f-855f-901662e01911 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] 10.222.0.20 "POST /compute/v2.1/servers/4c0c4bb6-269f-46bc-b460-7d0299277753/action" status: 202 len: 0 microversion: 2.20 time: 0.101162 Jul 06 13:55:39.663223 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 514/1019] 10.222.0.20 () {62 vars in 1318 bytes} [Wed Jul 6 13:55:39 2022] POST /compute/v2.1/servers/4c0c4bb6-269f-46bc-b460-7d0299277753/action => generated 0 bytes in 103 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 06 13:55:39.672135 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-25364f5d-d65f-49da-bd76-57f33ac3dcb7 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:55:39.673032 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-25364f5d-d65f-49da-bd76-57f33ac3dcb7 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] [instance: 4c0c4bb6-269f-46bc-b460-7d0299277753] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:55:39.681855 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-25364f5d-d65f-49da-bd76-57f33ac3dcb7 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:55:39.682587 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-25364f5d-d65f-49da-bd76-57f33ac3dcb7 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:55:39.683803 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-25364f5d-d65f-49da-bd76-57f33ac3dcb7 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:55:39.684327 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-25364f5d-d65f-49da-bd76-57f33ac3dcb7 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:55:39.875113 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-25364f5d-d65f-49da-bd76-57f33ac3dcb7 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c85251638bc64deca16008b696b11ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3edb8d53184b98b7055ffc145f186d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:55:39.886049 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-25364f5d-d65f-49da-bd76-57f33ac3dcb7 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c85251638bc64deca16008b696b11ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3edb8d53184b98b7055ffc145f186d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:55:39.888390 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-25364f5d-d65f-49da-bd76-57f33ac3dcb7 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c85251638bc64deca16008b696b11ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3edb8d53184b98b7055ffc145f186d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:55:39.889730 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-25364f5d-d65f-49da-bd76-57f33ac3dcb7 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] 10.222.0.20 "GET /compute/v2.1/servers/4c0c4bb6-269f-46bc-b460-7d0299277753" status: 200 len: 1750 microversion: 2.20 time: 0.222556 Jul 06 13:55:39.890371 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 506/1020] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 6 13:55:39 2022] GET /compute/v2.1/servers/4c0c4bb6-269f-46bc-b460-7d0299277753 => generated 1750 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 06 13:55:40.909460 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-b54e32e0-8aee-41de-9da4-378ac94d07c1 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Calling method '>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:55:40.910030 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-b54e32e0-8aee-41de-9da4-378ac94d07c1 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] [instance: 4c0c4bb6-269f-46bc-b460-7d0299277753] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:55:40.916820 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-b54e32e0-8aee-41de-9da4-378ac94d07c1 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:55:40.917307 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-b54e32e0-8aee-41de-9da4-378ac94d07c1 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:55:40.918110 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-b54e32e0-8aee-41de-9da4-378ac94d07c1 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:55:40.918552 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-b54e32e0-8aee-41de-9da4-378ac94d07c1 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:55:41.005354 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-1dc59b7a-bbf7-43c2-a3e3-e26822f317e4 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:55:41.005850 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-1dc59b7a-bbf7-43c2-a3e3-e26822f317e4 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] [instance: 5fa482da-0cca-4e1c-9724-e4d5ee9d73fa] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:55:41.013095 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-1dc59b7a-bbf7-43c2-a3e3-e26822f317e4 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:55:41.013932 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-1dc59b7a-bbf7-43c2-a3e3-e26822f317e4 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:55:41.014738 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-1dc59b7a-bbf7-43c2-a3e3-e26822f317e4 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:55:41.015172 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-1dc59b7a-bbf7-43c2-a3e3-e26822f317e4 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:55:41.029258 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.wsgi [None req-1dc59b7a-bbf7-43c2-a3e3-e26822f317e4 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] HTTP exception thrown: Instance 5fa482da-0cca-4e1c-9724-e4d5ee9d73fa could not be found. Jul 06 13:55:41.031092 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-1dc59b7a-bbf7-43c2-a3e3-e26822f317e4 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Request method failure captured: Jul 06 13:55:41.031092 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: request: DELETE /compute/v2.1/servers/5fa482da-0cca-4e1c-9724-e4d5ee9d73fa HTTP/1.1 Jul 06 13:55:41.031092 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: Accept: application/json Jul 06 13:55:41.031092 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: Accept-Encoding: identity Jul 06 13:55:41.031092 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: Connection: close Jul 06 13:55:41.031092 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: Content-Length: 0 Jul 06 13:55:41.031092 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: Content-Type: application/json Jul 06 13:55:41.031092 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: Host: 10.222.0.20 Jul 06 13:55:41.031092 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: Openstack-System-Scope: None Jul 06 13:55:41.031092 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: User-Agent: python-urllib3/1.26.9 Jul 06 13:55:41.031092 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: X-Auth-Token: gAAAAABixZH4I4dgmb0Q3wbjrFWrBMh6OmJtrlg6lZ88SjHzAtW3fxMyo3s0_pJVvHdnPyxERhBQTWBNewTHA0QeJRzzLbnn4Csb1lAz3C9NjKcuSHUaArYBZ7P3u01dtbqramyieBExBREkl13A9tBRRuVoPmOumXVJ74UVBAMWWamo1ttSwGg Jul 06 13:55:41.031092 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: X-Domain-Id: None Jul 06 13:55:41.031092 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: X-Domain-Name: None Jul 06 13:55:41.031092 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: X-Identity-Status: Confirmed Jul 06 13:55:41.031092 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: X-Is-Admin-Project: True Jul 06 13:55:41.031092 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: X-Project-Domain-Id: default Jul 06 13:55:41.031092 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: X-Project-Domain-Name: Default Jul 06 13:55:41.031092 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: X-Project-Id: bd85f2a57a0847debf5aaf81aab7a638 Jul 06 13:55:41.031092 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: X-Project-Name: tempest-AttachVolumeNegativeTest-1016924223 Jul 06 13:55:41.031092 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: X-Role: reader,member Jul 06 13:55:41.031092 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: X-Roles: reader,member Jul 06 13:55:41.033754 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_bd85f2a57a0847debf5aaf81aab7a638"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/bd85f2a57a0847debf5aaf81aab7a638"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/bd85f2a57a0847debf5aaf81aab7a638"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/bd85f2a57a0847debf5aaf81aab7a638"}]}] Jul 06 13:55:41.033754 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: X-Tenant: tempest-AttachVolumeNegativeTest-1016924223 Jul 06 13:55:41.033754 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: X-Tenant-Id: bd85f2a57a0847debf5aaf81aab7a638 Jul 06 13:55:41.033754 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1016924223 Jul 06 13:55:41.033754 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: X-User: tempest-AttachVolumeNegativeTest-1016924223-project Jul 06 13:55:41.033754 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: X-User-Domain-Id: default Jul 06 13:55:41.033754 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: X-User-Domain-Name: Default Jul 06 13:55:41.033754 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: X-User-Id: 7b572a8f465048558fc969b85b2aec5b Jul 06 13:55:41.033754 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: X-User-Name: tempest-AttachVolumeNegativeTest-1016924223-project Jul 06 13:55:41.033754 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: method: > Jul 06 13:55:41.033754 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: exception: Instance 5fa482da-0cca-4e1c-9724-e4d5ee9d73fa could not be found. Jul 06 13:55:41.033754 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: action_args: {'id': '5fa482da-0cca-4e1c-9724-e4d5ee9d73fa'} Jul 06 13:55:41.035065 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 06 13:55:41.035065 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 06 13:55:41.035065 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 06 13:55:41.035065 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 06 13:55:41.035065 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 06 13:55:41.035065 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 06 13:55:41.035065 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 06 13:55:41.035065 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 06 13:55:41.035065 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 06 13:55:41.035065 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 06 13:55:41.035065 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5fa482da-0cca-4e1c-9724-e4d5ee9d73fa could not be found. Jul 06 13:55:41.035065 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi Jul 06 13:55:41.035065 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 06 13:55:41.035065 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi Jul 06 13:55:41.035065 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 06 13:55:41.035065 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 06 13:55:41.035065 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 06 13:55:41.035065 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 06 13:55:41.035065 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 06 13:55:41.035065 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 06 13:55:41.037419 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 06 13:55:41.037419 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 06 13:55:41.037419 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 06 13:55:41.037419 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 06 13:55:41.037419 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 06 13:55:41.037419 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 06 13:55:41.037419 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 06 13:55:41.037419 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 06 13:55:41.037419 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 06 13:55:41.037419 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5fa482da-0cca-4e1c-9724-e4d5ee9d73fa could not be found. Jul 06 13:55:41.037419 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi Jul 06 13:55:41.037419 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 06 13:55:41.037419 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi Jul 06 13:55:41.037419 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 06 13:55:41.037419 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 06 13:55:41.037419 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 06 13:55:41.037419 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 06 13:55:41.037419 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 06 13:55:41.037419 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5fa482da-0cca-4e1c-9724-e4d5ee9d73fa could not be found. Jul 06 13:55:41.037419 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi Jul 06 13:55:41.039804 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-1dc59b7a-bbf7-43c2-a3e3-e26822f317e4 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Returning 404 to user: Instance 5fa482da-0cca-4e1c-9724-e4d5ee9d73fa could not be found. {{(pid=124367) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 06 13:55:41.039804 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-1dc59b7a-bbf7-43c2-a3e3-e26822f317e4 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] 10.222.0.20 "DELETE /compute/v2.1/servers/5fa482da-0cca-4e1c-9724-e4d5ee9d73fa" status: 404 len: 111 microversion: 2.1 time: 0.030920 Jul 06 13:55:41.039804 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 507/1021] 10.222.0.20 () {58 vars in 1238 bytes} [Wed Jul 6 13:55:41 2022] DELETE /compute/v2.1/servers/5fa482da-0cca-4e1c-9724-e4d5ee9d73fa => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 06 13:55:41.040508 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-d0ae9ac3-4b1f-4577-97af-d1ccd1e792da tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:55:41.040940 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-d0ae9ac3-4b1f-4577-97af-d1ccd1e792da tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] [instance: 5fa482da-0cca-4e1c-9724-e4d5ee9d73fa] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:55:41.047112 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-d0ae9ac3-4b1f-4577-97af-d1ccd1e792da tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:55:41.047562 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-d0ae9ac3-4b1f-4577-97af-d1ccd1e792da tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:55:41.048327 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-d0ae9ac3-4b1f-4577-97af-d1ccd1e792da tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:55:41.048759 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-d0ae9ac3-4b1f-4577-97af-d1ccd1e792da tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:55:41.054292 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-b54e32e0-8aee-41de-9da4-378ac94d07c1 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c85251638bc64deca16008b696b11ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3edb8d53184b98b7055ffc145f186d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:55:41.062541 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.wsgi [None req-d0ae9ac3-4b1f-4577-97af-d1ccd1e792da tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] HTTP exception thrown: Instance 5fa482da-0cca-4e1c-9724-e4d5ee9d73fa could not be found. Jul 06 13:55:41.062729 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-b54e32e0-8aee-41de-9da4-378ac94d07c1 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c85251638bc64deca16008b696b11ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3edb8d53184b98b7055ffc145f186d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:55:41.064043 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-d0ae9ac3-4b1f-4577-97af-d1ccd1e792da tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Request method failure captured: Jul 06 13:55:41.064043 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: request: GET /compute/v2.1/servers/5fa482da-0cca-4e1c-9724-e4d5ee9d73fa HTTP/1.1 Jul 06 13:55:41.064043 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: Accept: application/json Jul 06 13:55:41.064043 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: Accept-Encoding: identity Jul 06 13:55:41.064043 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: Connection: close Jul 06 13:55:41.064043 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: Content-Length: 0 Jul 06 13:55:41.064043 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: Content-Type: application/json Jul 06 13:55:41.064043 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: Host: 10.222.0.20 Jul 06 13:55:41.064043 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: Openstack-System-Scope: None Jul 06 13:55:41.064043 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: User-Agent: python-urllib3/1.26.9 Jul 06 13:55:41.064043 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: X-Auth-Token: gAAAAABixZH4I4dgmb0Q3wbjrFWrBMh6OmJtrlg6lZ88SjHzAtW3fxMyo3s0_pJVvHdnPyxERhBQTWBNewTHA0QeJRzzLbnn4Csb1lAz3C9NjKcuSHUaArYBZ7P3u01dtbqramyieBExBREkl13A9tBRRuVoPmOumXVJ74UVBAMWWamo1ttSwGg Jul 06 13:55:41.064043 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: X-Domain-Id: None Jul 06 13:55:41.064043 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: X-Domain-Name: None Jul 06 13:55:41.064043 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: X-Identity-Status: Confirmed Jul 06 13:55:41.064043 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: X-Is-Admin-Project: True Jul 06 13:55:41.064043 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: X-Project-Domain-Id: default Jul 06 13:55:41.064043 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: X-Project-Domain-Name: Default Jul 06 13:55:41.064043 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: X-Project-Id: bd85f2a57a0847debf5aaf81aab7a638 Jul 06 13:55:41.064043 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: X-Project-Name: tempest-AttachVolumeNegativeTest-1016924223 Jul 06 13:55:41.064043 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: X-Role: reader,member Jul 06 13:55:41.064043 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: X-Roles: reader,member Jul 06 13:55:41.065554 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_bd85f2a57a0847debf5aaf81aab7a638"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/bd85f2a57a0847debf5aaf81aab7a638"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/bd85f2a57a0847debf5aaf81aab7a638"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/bd85f2a57a0847debf5aaf81aab7a638"}]}] Jul 06 13:55:41.065554 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: X-Tenant: tempest-AttachVolumeNegativeTest-1016924223 Jul 06 13:55:41.065554 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: X-Tenant-Id: bd85f2a57a0847debf5aaf81aab7a638 Jul 06 13:55:41.065554 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1016924223 Jul 06 13:55:41.065554 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: X-User: tempest-AttachVolumeNegativeTest-1016924223-project Jul 06 13:55:41.065554 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: X-User-Domain-Id: default Jul 06 13:55:41.065554 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: X-User-Domain-Name: Default Jul 06 13:55:41.065554 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: X-User-Id: 7b572a8f465048558fc969b85b2aec5b Jul 06 13:55:41.065554 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: X-User-Name: tempest-AttachVolumeNegativeTest-1016924223-project Jul 06 13:55:41.065554 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: method: > Jul 06 13:55:41.065554 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: exception: Instance 5fa482da-0cca-4e1c-9724-e4d5ee9d73fa could not be found. Jul 06 13:55:41.065554 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: action_args: {'id': '5fa482da-0cca-4e1c-9724-e4d5ee9d73fa'} Jul 06 13:55:41.069235 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 06 13:55:41.069235 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 06 13:55:41.069235 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 06 13:55:41.069235 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 06 13:55:41.069235 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 06 13:55:41.069235 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 06 13:55:41.069235 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 06 13:55:41.069235 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 06 13:55:41.069235 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 06 13:55:41.069235 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 06 13:55:41.069235 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5fa482da-0cca-4e1c-9724-e4d5ee9d73fa could not be found. Jul 06 13:55:41.069235 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi Jul 06 13:55:41.069235 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 06 13:55:41.069235 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi Jul 06 13:55:41.069235 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 06 13:55:41.069235 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 06 13:55:41.069235 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 06 13:55:41.069235 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 06 13:55:41.069235 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 06 13:55:41.069235 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 06 13:55:41.070688 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 06 13:55:41.070688 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 06 13:55:41.070688 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 06 13:55:41.070688 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 06 13:55:41.070688 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 06 13:55:41.070688 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 06 13:55:41.070688 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 06 13:55:41.070688 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5fa482da-0cca-4e1c-9724-e4d5ee9d73fa could not be found. Jul 06 13:55:41.070688 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi Jul 06 13:55:41.070688 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 06 13:55:41.070688 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi Jul 06 13:55:41.070688 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 06 13:55:41.070688 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 06 13:55:41.070688 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 06 13:55:41.070688 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 06 13:55:41.070688 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 06 13:55:41.070688 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5fa482da-0cca-4e1c-9724-e4d5ee9d73fa could not be found. Jul 06 13:55:41.070688 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi Jul 06 13:55:41.071977 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-b54e32e0-8aee-41de-9da4-378ac94d07c1 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c85251638bc64deca16008b696b11ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3edb8d53184b98b7055ffc145f186d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:55:41.072090 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-d0ae9ac3-4b1f-4577-97af-d1ccd1e792da tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Returning 404 to user: Instance 5fa482da-0cca-4e1c-9724-e4d5ee9d73fa could not be found. {{(pid=124367) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 06 13:55:41.072190 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-b54e32e0-8aee-41de-9da4-378ac94d07c1 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] 10.222.0.20 "GET /compute/v2.1/servers/4c0c4bb6-269f-46bc-b460-7d0299277753" status: 200 len: 1752 microversion: 2.20 time: 0.159985 Jul 06 13:55:41.072281 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-d0ae9ac3-4b1f-4577-97af-d1ccd1e792da tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] 10.222.0.20 "GET /compute/v2.1/servers/5fa482da-0cca-4e1c-9724-e4d5ee9d73fa" status: 404 len: 111 microversion: 2.1 time: 0.028536 Jul 06 13:55:41.072281 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 508/1023] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:55:41 2022] GET /compute/v2.1/servers/5fa482da-0cca-4e1c-9724-e4d5ee9d73fa => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 06 13:55:41.072451 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 515/1023] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 6 13:55:40 2022] GET /compute/v2.1/servers/4c0c4bb6-269f-46bc-b460-7d0299277753 => generated 1752 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 06 13:55:42.084902 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-faf34c3d-6674-49e2-9066-90e4d6bbedc8 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:55:42.085634 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-faf34c3d-6674-49e2-9066-90e4d6bbedc8 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] [instance: 4c0c4bb6-269f-46bc-b460-7d0299277753] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:55:42.093844 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-faf34c3d-6674-49e2-9066-90e4d6bbedc8 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:55:42.094309 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-faf34c3d-6674-49e2-9066-90e4d6bbedc8 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:55:42.095176 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-faf34c3d-6674-49e2-9066-90e4d6bbedc8 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:55:42.095597 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-faf34c3d-6674-49e2-9066-90e4d6bbedc8 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:55:42.226025 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-418d7377-8aaa-48f9-af53-b83f55989b16 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Calling method '>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:55:42.227079 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-418d7377-8aaa-48f9-af53-b83f55989b16 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] [instance: d82144a2-d572-4e58-852c-7553331127cc] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:55:42.235208 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-418d7377-8aaa-48f9-af53-b83f55989b16 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:55:42.235862 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-418d7377-8aaa-48f9-af53-b83f55989b16 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:55:42.236643 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-418d7377-8aaa-48f9-af53-b83f55989b16 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:55:42.237112 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-418d7377-8aaa-48f9-af53-b83f55989b16 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:55:42.248204 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-faf34c3d-6674-49e2-9066-90e4d6bbedc8 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c85251638bc64deca16008b696b11ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3edb8d53184b98b7055ffc145f186d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:55:42.251670 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.wsgi [None req-418d7377-8aaa-48f9-af53-b83f55989b16 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] HTTP exception thrown: Instance d82144a2-d572-4e58-852c-7553331127cc could not be found. Jul 06 13:55:42.253262 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-418d7377-8aaa-48f9-af53-b83f55989b16 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Request method failure captured: Jul 06 13:55:42.253262 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: request: DELETE /compute/v2.1/servers/d82144a2-d572-4e58-852c-7553331127cc HTTP/1.1 Jul 06 13:55:42.253262 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: Accept: application/json Jul 06 13:55:42.253262 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: Accept-Encoding: identity Jul 06 13:55:42.253262 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: Connection: close Jul 06 13:55:42.253262 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: Content-Length: 0 Jul 06 13:55:42.253262 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: Content-Type: application/json Jul 06 13:55:42.253262 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: Host: 10.222.0.20 Jul 06 13:55:42.253262 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: Openstack-System-Scope: None Jul 06 13:55:42.253262 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: User-Agent: python-urllib3/1.26.9 Jul 06 13:55:42.253262 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Auth-Token: gAAAAABixZH4I4dgmb0Q3wbjrFWrBMh6OmJtrlg6lZ88SjHzAtW3fxMyo3s0_pJVvHdnPyxERhBQTWBNewTHA0QeJRzzLbnn4Csb1lAz3C9NjKcuSHUaArYBZ7P3u01dtbqramyieBExBREkl13A9tBRRuVoPmOumXVJ74UVBAMWWamo1ttSwGg Jul 06 13:55:42.253262 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Domain-Id: None Jul 06 13:55:42.253262 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Domain-Name: None Jul 06 13:55:42.253262 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Identity-Status: Confirmed Jul 06 13:55:42.253262 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Is-Admin-Project: True Jul 06 13:55:42.253262 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Project-Domain-Id: default Jul 06 13:55:42.253262 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Project-Domain-Name: Default Jul 06 13:55:42.253262 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Project-Id: bd85f2a57a0847debf5aaf81aab7a638 Jul 06 13:55:42.253262 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Project-Name: tempest-AttachVolumeNegativeTest-1016924223 Jul 06 13:55:42.253262 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Role: reader,member Jul 06 13:55:42.253262 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Roles: reader,member Jul 06 13:55:42.254776 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_bd85f2a57a0847debf5aaf81aab7a638"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/bd85f2a57a0847debf5aaf81aab7a638"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/bd85f2a57a0847debf5aaf81aab7a638"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/bd85f2a57a0847debf5aaf81aab7a638"}]}] Jul 06 13:55:42.254776 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Tenant: tempest-AttachVolumeNegativeTest-1016924223 Jul 06 13:55:42.254776 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Tenant-Id: bd85f2a57a0847debf5aaf81aab7a638 Jul 06 13:55:42.254776 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1016924223 Jul 06 13:55:42.254776 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-User: tempest-AttachVolumeNegativeTest-1016924223-project Jul 06 13:55:42.254776 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-User-Domain-Id: default Jul 06 13:55:42.254776 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-User-Domain-Name: Default Jul 06 13:55:42.254776 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-User-Id: 7b572a8f465048558fc969b85b2aec5b Jul 06 13:55:42.254776 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-User-Name: tempest-AttachVolumeNegativeTest-1016924223-project Jul 06 13:55:42.254776 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: method: > Jul 06 13:55:42.254776 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: exception: Instance d82144a2-d572-4e58-852c-7553331127cc could not be found. Jul 06 13:55:42.254776 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: action_args: {'id': 'd82144a2-d572-4e58-852c-7553331127cc'} Jul 06 13:55:42.255697 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 06 13:55:42.255697 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 06 13:55:42.255697 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 06 13:55:42.255697 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 06 13:55:42.255697 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 06 13:55:42.255697 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 06 13:55:42.255697 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 06 13:55:42.255697 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 06 13:55:42.255697 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 06 13:55:42.255697 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 06 13:55:42.255697 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d82144a2-d572-4e58-852c-7553331127cc could not be found. Jul 06 13:55:42.255697 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi Jul 06 13:55:42.255697 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 06 13:55:42.255697 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi Jul 06 13:55:42.255697 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 06 13:55:42.255697 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 06 13:55:42.255697 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 06 13:55:42.255697 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 06 13:55:42.255697 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 06 13:55:42.255697 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 06 13:55:42.257258 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 06 13:55:42.257258 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 06 13:55:42.257258 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 06 13:55:42.257258 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 06 13:55:42.257258 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 06 13:55:42.257258 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 06 13:55:42.257258 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 06 13:55:42.257258 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 06 13:55:42.257258 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 06 13:55:42.257258 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d82144a2-d572-4e58-852c-7553331127cc could not be found. Jul 06 13:55:42.257258 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi Jul 06 13:55:42.257258 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 06 13:55:42.257258 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi Jul 06 13:55:42.257258 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 06 13:55:42.257258 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 06 13:55:42.257258 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 06 13:55:42.257258 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 06 13:55:42.257258 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 06 13:55:42.257258 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d82144a2-d572-4e58-852c-7553331127cc could not be found. Jul 06 13:55:42.257258 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi Jul 06 13:55:42.258858 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-418d7377-8aaa-48f9-af53-b83f55989b16 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Returning 404 to user: Instance d82144a2-d572-4e58-852c-7553331127cc could not be found. {{(pid=124368) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 06 13:55:42.258858 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-418d7377-8aaa-48f9-af53-b83f55989b16 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] 10.222.0.20 "DELETE /compute/v2.1/servers/d82144a2-d572-4e58-852c-7553331127cc" status: 404 len: 111 microversion: 2.1 time: 0.032802 Jul 06 13:55:42.259033 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-faf34c3d-6674-49e2-9066-90e4d6bbedc8 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c85251638bc64deca16008b696b11ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3edb8d53184b98b7055ffc145f186d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:55:42.259170 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 516/1024] 10.222.0.20 () {58 vars in 1238 bytes} [Wed Jul 6 13:55:42 2022] DELETE /compute/v2.1/servers/d82144a2-d572-4e58-852c-7553331127cc => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 06 13:55:42.259264 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-faf34c3d-6674-49e2-9066-90e4d6bbedc8 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c85251638bc64deca16008b696b11ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3edb8d53184b98b7055ffc145f186d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:55:42.259515 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-faf34c3d-6674-49e2-9066-90e4d6bbedc8 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] 10.222.0.20 "GET /compute/v2.1/servers/4c0c4bb6-269f-46bc-b460-7d0299277753" status: 200 len: 1752 microversion: 2.20 time: 0.178483 Jul 06 13:55:42.260234 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 509/1025] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 6 13:55:42 2022] GET /compute/v2.1/servers/4c0c4bb6-269f-46bc-b460-7d0299277753 => generated 1752 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 06 13:55:42.263341 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-d69bd73c-eb96-4adf-9fe5-8916547ff270 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Calling method '>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:55:42.264072 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-d69bd73c-eb96-4adf-9fe5-8916547ff270 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] [instance: d82144a2-d572-4e58-852c-7553331127cc] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:55:42.269989 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-d69bd73c-eb96-4adf-9fe5-8916547ff270 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:55:42.270442 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-d69bd73c-eb96-4adf-9fe5-8916547ff270 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:55:42.271230 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-d69bd73c-eb96-4adf-9fe5-8916547ff270 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:55:42.271665 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-d69bd73c-eb96-4adf-9fe5-8916547ff270 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:55:42.285513 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.wsgi [None req-d69bd73c-eb96-4adf-9fe5-8916547ff270 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] HTTP exception thrown: Instance d82144a2-d572-4e58-852c-7553331127cc could not be found. Jul 06 13:55:42.287020 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-d69bd73c-eb96-4adf-9fe5-8916547ff270 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Request method failure captured: Jul 06 13:55:42.287020 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: request: GET /compute/v2.1/servers/d82144a2-d572-4e58-852c-7553331127cc HTTP/1.1 Jul 06 13:55:42.287020 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: Accept: application/json Jul 06 13:55:42.287020 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: Accept-Encoding: identity Jul 06 13:55:42.287020 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: Connection: close Jul 06 13:55:42.287020 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: Content-Length: 0 Jul 06 13:55:42.287020 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: Content-Type: application/json Jul 06 13:55:42.287020 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: Host: 10.222.0.20 Jul 06 13:55:42.287020 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: Openstack-System-Scope: None Jul 06 13:55:42.287020 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: User-Agent: python-urllib3/1.26.9 Jul 06 13:55:42.287020 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Auth-Token: gAAAAABixZH4I4dgmb0Q3wbjrFWrBMh6OmJtrlg6lZ88SjHzAtW3fxMyo3s0_pJVvHdnPyxERhBQTWBNewTHA0QeJRzzLbnn4Csb1lAz3C9NjKcuSHUaArYBZ7P3u01dtbqramyieBExBREkl13A9tBRRuVoPmOumXVJ74UVBAMWWamo1ttSwGg Jul 06 13:55:42.287020 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Domain-Id: None Jul 06 13:55:42.287020 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Domain-Name: None Jul 06 13:55:42.287020 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Identity-Status: Confirmed Jul 06 13:55:42.287020 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Is-Admin-Project: True Jul 06 13:55:42.287020 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Project-Domain-Id: default Jul 06 13:55:42.287020 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Project-Domain-Name: Default Jul 06 13:55:42.287020 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Project-Id: bd85f2a57a0847debf5aaf81aab7a638 Jul 06 13:55:42.287020 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Project-Name: tempest-AttachVolumeNegativeTest-1016924223 Jul 06 13:55:42.287020 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Role: reader,member Jul 06 13:55:42.287020 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Roles: reader,member Jul 06 13:55:42.288551 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_bd85f2a57a0847debf5aaf81aab7a638"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/bd85f2a57a0847debf5aaf81aab7a638"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/bd85f2a57a0847debf5aaf81aab7a638"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/bd85f2a57a0847debf5aaf81aab7a638"}]}] Jul 06 13:55:42.288551 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Tenant: tempest-AttachVolumeNegativeTest-1016924223 Jul 06 13:55:42.288551 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Tenant-Id: bd85f2a57a0847debf5aaf81aab7a638 Jul 06 13:55:42.288551 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1016924223 Jul 06 13:55:42.288551 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-User: tempest-AttachVolumeNegativeTest-1016924223-project Jul 06 13:55:42.288551 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-User-Domain-Id: default Jul 06 13:55:42.288551 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-User-Domain-Name: Default Jul 06 13:55:42.288551 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-User-Id: 7b572a8f465048558fc969b85b2aec5b Jul 06 13:55:42.288551 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-User-Name: tempest-AttachVolumeNegativeTest-1016924223-project Jul 06 13:55:42.288551 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: method: > Jul 06 13:55:42.288551 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: exception: Instance d82144a2-d572-4e58-852c-7553331127cc could not be found. Jul 06 13:55:42.288551 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: action_args: {'id': 'd82144a2-d572-4e58-852c-7553331127cc'} Jul 06 13:55:42.289597 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 06 13:55:42.289597 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 06 13:55:42.289597 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 06 13:55:42.289597 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 06 13:55:42.289597 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 06 13:55:42.289597 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 06 13:55:42.289597 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 06 13:55:42.289597 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 06 13:55:42.289597 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 06 13:55:42.289597 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 06 13:55:42.289597 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d82144a2-d572-4e58-852c-7553331127cc could not be found. Jul 06 13:55:42.289597 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi Jul 06 13:55:42.289597 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 06 13:55:42.289597 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi Jul 06 13:55:42.289597 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 06 13:55:42.289597 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 06 13:55:42.289597 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 06 13:55:42.289597 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 06 13:55:42.289597 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 06 13:55:42.289597 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 06 13:55:42.290902 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 06 13:55:42.290902 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 06 13:55:42.290902 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 06 13:55:42.290902 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 06 13:55:42.290902 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 06 13:55:42.290902 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 06 13:55:42.290902 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 06 13:55:42.290902 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d82144a2-d572-4e58-852c-7553331127cc could not be found. Jul 06 13:55:42.290902 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi Jul 06 13:55:42.290902 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 06 13:55:42.290902 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi Jul 06 13:55:42.290902 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 06 13:55:42.290902 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 06 13:55:42.290902 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 06 13:55:42.290902 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 06 13:55:42.290902 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 06 13:55:42.290902 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d82144a2-d572-4e58-852c-7553331127cc could not be found. Jul 06 13:55:42.290902 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi Jul 06 13:55:42.292321 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-d69bd73c-eb96-4adf-9fe5-8916547ff270 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Returning 404 to user: Instance d82144a2-d572-4e58-852c-7553331127cc could not be found. {{(pid=124368) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 06 13:55:42.292321 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-d69bd73c-eb96-4adf-9fe5-8916547ff270 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] 10.222.0.20 "GET /compute/v2.1/servers/d82144a2-d572-4e58-852c-7553331127cc" status: 404 len: 111 microversion: 2.1 time: 0.029228 Jul 06 13:55:42.292321 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 517/1026] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:55:42 2022] GET /compute/v2.1/servers/d82144a2-d572-4e58-852c-7553331127cc => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 06 13:55:42.297206 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-0f22888c-83eb-47e7-a998-89b331de33b7 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:55:42.297703 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-0f22888c-83eb-47e7-a998-89b331de33b7 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] [instance: 85dc896f-7a07-400c-abc8-cc2d27bda2db] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:55:42.304000 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-0f22888c-83eb-47e7-a998-89b331de33b7 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:55:42.304446 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-0f22888c-83eb-47e7-a998-89b331de33b7 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:55:42.305236 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-0f22888c-83eb-47e7-a998-89b331de33b7 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:55:42.305665 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-0f22888c-83eb-47e7-a998-89b331de33b7 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:55:42.318635 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.wsgi [None req-0f22888c-83eb-47e7-a998-89b331de33b7 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] HTTP exception thrown: Instance 85dc896f-7a07-400c-abc8-cc2d27bda2db could not be found. Jul 06 13:55:42.320141 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-0f22888c-83eb-47e7-a998-89b331de33b7 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Request method failure captured: Jul 06 13:55:42.320141 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: request: DELETE /compute/v2.1/servers/85dc896f-7a07-400c-abc8-cc2d27bda2db HTTP/1.1 Jul 06 13:55:42.320141 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: Accept: application/json Jul 06 13:55:42.320141 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: Accept-Encoding: identity Jul 06 13:55:42.320141 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: Connection: close Jul 06 13:55:42.320141 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: Content-Length: 0 Jul 06 13:55:42.320141 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: Content-Type: application/json Jul 06 13:55:42.320141 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: Host: 10.222.0.20 Jul 06 13:55:42.320141 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: Openstack-System-Scope: None Jul 06 13:55:42.320141 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: User-Agent: python-urllib3/1.26.9 Jul 06 13:55:42.320141 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: X-Auth-Token: gAAAAABixZH4I4dgmb0Q3wbjrFWrBMh6OmJtrlg6lZ88SjHzAtW3fxMyo3s0_pJVvHdnPyxERhBQTWBNewTHA0QeJRzzLbnn4Csb1lAz3C9NjKcuSHUaArYBZ7P3u01dtbqramyieBExBREkl13A9tBRRuVoPmOumXVJ74UVBAMWWamo1ttSwGg Jul 06 13:55:42.320141 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: X-Domain-Id: None Jul 06 13:55:42.320141 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: X-Domain-Name: None Jul 06 13:55:42.320141 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: X-Identity-Status: Confirmed Jul 06 13:55:42.320141 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: X-Is-Admin-Project: True Jul 06 13:55:42.320141 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: X-Project-Domain-Id: default Jul 06 13:55:42.320141 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: X-Project-Domain-Name: Default Jul 06 13:55:42.320141 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: X-Project-Id: bd85f2a57a0847debf5aaf81aab7a638 Jul 06 13:55:42.320141 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: X-Project-Name: tempest-AttachVolumeNegativeTest-1016924223 Jul 06 13:55:42.320141 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: X-Role: reader,member Jul 06 13:55:42.320141 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: X-Roles: reader,member Jul 06 13:55:42.321669 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_bd85f2a57a0847debf5aaf81aab7a638"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/bd85f2a57a0847debf5aaf81aab7a638"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/bd85f2a57a0847debf5aaf81aab7a638"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/bd85f2a57a0847debf5aaf81aab7a638"}]}] Jul 06 13:55:42.321669 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: X-Tenant: tempest-AttachVolumeNegativeTest-1016924223 Jul 06 13:55:42.321669 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: X-Tenant-Id: bd85f2a57a0847debf5aaf81aab7a638 Jul 06 13:55:42.321669 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1016924223 Jul 06 13:55:42.321669 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: X-User: tempest-AttachVolumeNegativeTest-1016924223-project Jul 06 13:55:42.321669 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: X-User-Domain-Id: default Jul 06 13:55:42.321669 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: X-User-Domain-Name: Default Jul 06 13:55:42.321669 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: X-User-Id: 7b572a8f465048558fc969b85b2aec5b Jul 06 13:55:42.321669 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: X-User-Name: tempest-AttachVolumeNegativeTest-1016924223-project Jul 06 13:55:42.321669 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: method: > Jul 06 13:55:42.321669 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: exception: Instance 85dc896f-7a07-400c-abc8-cc2d27bda2db could not be found. Jul 06 13:55:42.321669 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: action_args: {'id': '85dc896f-7a07-400c-abc8-cc2d27bda2db'} Jul 06 13:55:42.322607 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 06 13:55:42.322607 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 06 13:55:42.322607 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 06 13:55:42.322607 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 06 13:55:42.322607 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 06 13:55:42.322607 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 06 13:55:42.322607 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 06 13:55:42.322607 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 06 13:55:42.322607 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 06 13:55:42.322607 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 06 13:55:42.322607 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 85dc896f-7a07-400c-abc8-cc2d27bda2db could not be found. Jul 06 13:55:42.322607 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi Jul 06 13:55:42.322607 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 06 13:55:42.322607 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi Jul 06 13:55:42.322607 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 06 13:55:42.322607 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 06 13:55:42.322607 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 06 13:55:42.322607 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 06 13:55:42.322607 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 06 13:55:42.322607 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 06 13:55:42.324162 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 06 13:55:42.324162 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 06 13:55:42.324162 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 06 13:55:42.324162 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 06 13:55:42.324162 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 06 13:55:42.324162 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 06 13:55:42.324162 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 06 13:55:42.324162 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 06 13:55:42.324162 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 06 13:55:42.324162 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 85dc896f-7a07-400c-abc8-cc2d27bda2db could not be found. Jul 06 13:55:42.324162 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi Jul 06 13:55:42.324162 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 06 13:55:42.324162 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi Jul 06 13:55:42.324162 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 06 13:55:42.324162 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 06 13:55:42.324162 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 06 13:55:42.324162 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 06 13:55:42.324162 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 06 13:55:42.324162 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 85dc896f-7a07-400c-abc8-cc2d27bda2db could not be found. Jul 06 13:55:42.324162 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi Jul 06 13:55:42.326304 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-0f22888c-83eb-47e7-a998-89b331de33b7 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Returning 404 to user: Instance 85dc896f-7a07-400c-abc8-cc2d27bda2db could not be found. {{(pid=124367) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 06 13:55:42.326304 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-0f22888c-83eb-47e7-a998-89b331de33b7 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] 10.222.0.20 "DELETE /compute/v2.1/servers/85dc896f-7a07-400c-abc8-cc2d27bda2db" status: 404 len: 111 microversion: 2.1 time: 0.028672 Jul 06 13:55:42.326304 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 510/1027] 10.222.0.20 () {58 vars in 1238 bytes} [Wed Jul 6 13:55:42 2022] DELETE /compute/v2.1/servers/85dc896f-7a07-400c-abc8-cc2d27bda2db => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 06 13:55:42.330358 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-93036e37-5ab7-4b86-abbe-9bf367a10d87 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Calling method '>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:55:42.331013 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-93036e37-5ab7-4b86-abbe-9bf367a10d87 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] [instance: 85dc896f-7a07-400c-abc8-cc2d27bda2db] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:55:42.337148 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-93036e37-5ab7-4b86-abbe-9bf367a10d87 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:55:42.337603 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-93036e37-5ab7-4b86-abbe-9bf367a10d87 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:55:42.338371 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-93036e37-5ab7-4b86-abbe-9bf367a10d87 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:55:42.338813 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-93036e37-5ab7-4b86-abbe-9bf367a10d87 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:55:42.352645 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.wsgi [None req-93036e37-5ab7-4b86-abbe-9bf367a10d87 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] HTTP exception thrown: Instance 85dc896f-7a07-400c-abc8-cc2d27bda2db could not be found. Jul 06 13:55:42.354215 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-93036e37-5ab7-4b86-abbe-9bf367a10d87 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Request method failure captured: Jul 06 13:55:42.354215 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: request: GET /compute/v2.1/servers/85dc896f-7a07-400c-abc8-cc2d27bda2db HTTP/1.1 Jul 06 13:55:42.354215 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: Accept: application/json Jul 06 13:55:42.354215 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: Accept-Encoding: identity Jul 06 13:55:42.354215 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: Connection: close Jul 06 13:55:42.354215 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: Content-Length: 0 Jul 06 13:55:42.354215 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: Content-Type: application/json Jul 06 13:55:42.354215 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: Host: 10.222.0.20 Jul 06 13:55:42.354215 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: Openstack-System-Scope: None Jul 06 13:55:42.354215 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: User-Agent: python-urllib3/1.26.9 Jul 06 13:55:42.354215 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Auth-Token: gAAAAABixZH4I4dgmb0Q3wbjrFWrBMh6OmJtrlg6lZ88SjHzAtW3fxMyo3s0_pJVvHdnPyxERhBQTWBNewTHA0QeJRzzLbnn4Csb1lAz3C9NjKcuSHUaArYBZ7P3u01dtbqramyieBExBREkl13A9tBRRuVoPmOumXVJ74UVBAMWWamo1ttSwGg Jul 06 13:55:42.354215 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Domain-Id: None Jul 06 13:55:42.354215 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Domain-Name: None Jul 06 13:55:42.354215 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Identity-Status: Confirmed Jul 06 13:55:42.354215 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Is-Admin-Project: True Jul 06 13:55:42.354215 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Project-Domain-Id: default Jul 06 13:55:42.354215 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Project-Domain-Name: Default Jul 06 13:55:42.354215 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Project-Id: bd85f2a57a0847debf5aaf81aab7a638 Jul 06 13:55:42.354215 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Project-Name: tempest-AttachVolumeNegativeTest-1016924223 Jul 06 13:55:42.354215 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Role: reader,member Jul 06 13:55:42.354215 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Roles: reader,member Jul 06 13:55:42.355757 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_bd85f2a57a0847debf5aaf81aab7a638"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/bd85f2a57a0847debf5aaf81aab7a638"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/bd85f2a57a0847debf5aaf81aab7a638"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/bd85f2a57a0847debf5aaf81aab7a638"}]}] Jul 06 13:55:42.355757 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Tenant: tempest-AttachVolumeNegativeTest-1016924223 Jul 06 13:55:42.355757 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Tenant-Id: bd85f2a57a0847debf5aaf81aab7a638 Jul 06 13:55:42.355757 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1016924223 Jul 06 13:55:42.355757 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-User: tempest-AttachVolumeNegativeTest-1016924223-project Jul 06 13:55:42.355757 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-User-Domain-Id: default Jul 06 13:55:42.355757 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-User-Domain-Name: Default Jul 06 13:55:42.355757 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-User-Id: 7b572a8f465048558fc969b85b2aec5b Jul 06 13:55:42.355757 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-User-Name: tempest-AttachVolumeNegativeTest-1016924223-project Jul 06 13:55:42.355757 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: method: > Jul 06 13:55:42.355757 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: exception: Instance 85dc896f-7a07-400c-abc8-cc2d27bda2db could not be found. Jul 06 13:55:42.355757 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: action_args: {'id': '85dc896f-7a07-400c-abc8-cc2d27bda2db'} Jul 06 13:55:42.356884 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 06 13:55:42.356884 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 06 13:55:42.356884 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 06 13:55:42.356884 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 06 13:55:42.356884 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 06 13:55:42.356884 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 06 13:55:42.356884 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 06 13:55:42.356884 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 06 13:55:42.356884 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 06 13:55:42.356884 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 06 13:55:42.356884 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 85dc896f-7a07-400c-abc8-cc2d27bda2db could not be found. Jul 06 13:55:42.356884 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi Jul 06 13:55:42.356884 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 06 13:55:42.356884 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi Jul 06 13:55:42.356884 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 06 13:55:42.356884 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 06 13:55:42.356884 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 06 13:55:42.356884 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 06 13:55:42.356884 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 06 13:55:42.356884 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 06 13:55:42.358372 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 06 13:55:42.358372 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 06 13:55:42.358372 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 06 13:55:42.358372 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 06 13:55:42.358372 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 06 13:55:42.358372 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 06 13:55:42.358372 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 06 13:55:42.358372 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 85dc896f-7a07-400c-abc8-cc2d27bda2db could not be found. Jul 06 13:55:42.358372 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi Jul 06 13:55:42.358372 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 06 13:55:42.358372 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi Jul 06 13:55:42.358372 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 06 13:55:42.358372 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 06 13:55:42.358372 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 06 13:55:42.358372 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 06 13:55:42.358372 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 06 13:55:42.358372 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 85dc896f-7a07-400c-abc8-cc2d27bda2db could not be found. Jul 06 13:55:42.358372 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi Jul 06 13:55:42.359970 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-93036e37-5ab7-4b86-abbe-9bf367a10d87 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Returning 404 to user: Instance 85dc896f-7a07-400c-abc8-cc2d27bda2db could not be found. {{(pid=124368) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 06 13:55:42.359970 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-93036e37-5ab7-4b86-abbe-9bf367a10d87 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] 10.222.0.20 "GET /compute/v2.1/servers/85dc896f-7a07-400c-abc8-cc2d27bda2db" status: 404 len: 111 microversion: 2.1 time: 0.029076 Jul 06 13:55:42.359970 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 518/1028] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:55:42 2022] GET /compute/v2.1/servers/85dc896f-7a07-400c-abc8-cc2d27bda2db => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 06 13:55:43.279884 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-5eb03e88-166b-4d07-a9f6-310be2172cbc tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:55:43.280531 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-5eb03e88-166b-4d07-a9f6-310be2172cbc tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] [instance: 4c0c4bb6-269f-46bc-b460-7d0299277753] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:55:43.287053 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-5eb03e88-166b-4d07-a9f6-310be2172cbc tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:55:43.287502 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-5eb03e88-166b-4d07-a9f6-310be2172cbc tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:55:43.288260 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-5eb03e88-166b-4d07-a9f6-310be2172cbc tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:55:43.288694 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-5eb03e88-166b-4d07-a9f6-310be2172cbc tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:55:43.418351 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-5eb03e88-166b-4d07-a9f6-310be2172cbc tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c85251638bc64deca16008b696b11ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3edb8d53184b98b7055ffc145f186d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:55:43.427190 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-5eb03e88-166b-4d07-a9f6-310be2172cbc tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c85251638bc64deca16008b696b11ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3edb8d53184b98b7055ffc145f186d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:55:43.428706 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-5eb03e88-166b-4d07-a9f6-310be2172cbc tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c85251638bc64deca16008b696b11ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3edb8d53184b98b7055ffc145f186d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:55:43.429913 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-5eb03e88-166b-4d07-a9f6-310be2172cbc tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] 10.222.0.20 "GET /compute/v2.1/servers/4c0c4bb6-269f-46bc-b460-7d0299277753" status: 200 len: 1808 microversion: 2.20 time: 0.154635 Jul 06 13:55:43.430463 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 511/1029] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 6 13:55:43 2022] GET /compute/v2.1/servers/4c0c4bb6-269f-46bc-b460-7d0299277753 => generated 1808 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 06 13:55:44.448738 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-9795b9d4-6206-4df3-8784-d77973ede009 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Calling method '>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:55:44.449380 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-9795b9d4-6206-4df3-8784-d77973ede009 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] [instance: 4c0c4bb6-269f-46bc-b460-7d0299277753] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:55:44.456721 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-9795b9d4-6206-4df3-8784-d77973ede009 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:55:44.457216 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-9795b9d4-6206-4df3-8784-d77973ede009 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:55:44.457996 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-9795b9d4-6206-4df3-8784-d77973ede009 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:55:44.458440 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-9795b9d4-6206-4df3-8784-d77973ede009 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:55:44.590604 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-9795b9d4-6206-4df3-8784-d77973ede009 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c85251638bc64deca16008b696b11ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3edb8d53184b98b7055ffc145f186d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:55:44.599438 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-9795b9d4-6206-4df3-8784-d77973ede009 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c85251638bc64deca16008b696b11ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3edb8d53184b98b7055ffc145f186d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:55:44.600952 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-9795b9d4-6206-4df3-8784-d77973ede009 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c85251638bc64deca16008b696b11ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3edb8d53184b98b7055ffc145f186d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:55:44.602510 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-9795b9d4-6206-4df3-8784-d77973ede009 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] 10.222.0.20 "GET /compute/v2.1/servers/4c0c4bb6-269f-46bc-b460-7d0299277753" status: 200 len: 1808 microversion: 2.20 time: 0.157563 Jul 06 13:55:44.603134 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 519/1030] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 6 13:55:44 2022] GET /compute/v2.1/servers/4c0c4bb6-269f-46bc-b460-7d0299277753 => generated 1808 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 06 13:55:45.621631 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-a09e35de-2387-42cf-b2ae-0b3fdecab52b tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:55:45.622638 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-a09e35de-2387-42cf-b2ae-0b3fdecab52b tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] [instance: 4c0c4bb6-269f-46bc-b460-7d0299277753] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:55:45.629116 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-a09e35de-2387-42cf-b2ae-0b3fdecab52b tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:55:45.629563 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-a09e35de-2387-42cf-b2ae-0b3fdecab52b tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:55:45.630327 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-a09e35de-2387-42cf-b2ae-0b3fdecab52b tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:55:45.630761 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-a09e35de-2387-42cf-b2ae-0b3fdecab52b tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:55:45.761454 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-a09e35de-2387-42cf-b2ae-0b3fdecab52b tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c85251638bc64deca16008b696b11ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3edb8d53184b98b7055ffc145f186d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:55:45.770690 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-a09e35de-2387-42cf-b2ae-0b3fdecab52b tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c85251638bc64deca16008b696b11ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3edb8d53184b98b7055ffc145f186d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:55:45.772192 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-a09e35de-2387-42cf-b2ae-0b3fdecab52b tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c85251638bc64deca16008b696b11ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3edb8d53184b98b7055ffc145f186d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:55:45.773376 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-a09e35de-2387-42cf-b2ae-0b3fdecab52b tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] 10.222.0.20 "GET /compute/v2.1/servers/4c0c4bb6-269f-46bc-b460-7d0299277753" status: 200 len: 1808 microversion: 2.20 time: 0.155670 Jul 06 13:55:45.773946 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 512/1031] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 6 13:55:45 2022] GET /compute/v2.1/servers/4c0c4bb6-269f-46bc-b460-7d0299277753 => generated 1808 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 06 13:55:46.632142 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-e3e24823-4eba-4c04-a36e-009ec21fb34d tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Calling method '>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:55:46.632930 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-e3e24823-4eba-4c04-a36e-009ec21fb34d tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] [instance: 5cf73c2b-28f6-49f1-a119-224c05679d2c] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:55:46.639564 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-e3e24823-4eba-4c04-a36e-009ec21fb34d tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:55:46.640025 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-e3e24823-4eba-4c04-a36e-009ec21fb34d tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:55:46.640809 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-e3e24823-4eba-4c04-a36e-009ec21fb34d tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:55:46.641283 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-e3e24823-4eba-4c04-a36e-009ec21fb34d tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:55:46.655098 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.wsgi [None req-e3e24823-4eba-4c04-a36e-009ec21fb34d tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] HTTP exception thrown: Instance 5cf73c2b-28f6-49f1-a119-224c05679d2c could not be found. Jul 06 13:55:46.656671 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-e3e24823-4eba-4c04-a36e-009ec21fb34d tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Request method failure captured: Jul 06 13:55:46.656671 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: request: DELETE /compute/v2.1/servers/5cf73c2b-28f6-49f1-a119-224c05679d2c HTTP/1.1 Jul 06 13:55:46.656671 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: Accept: application/json Jul 06 13:55:46.656671 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: Accept-Encoding: identity Jul 06 13:55:46.656671 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: Connection: close Jul 06 13:55:46.656671 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: Content-Length: 0 Jul 06 13:55:46.656671 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: Content-Type: application/json Jul 06 13:55:46.656671 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: Host: 10.222.0.20 Jul 06 13:55:46.656671 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: Openstack-System-Scope: None Jul 06 13:55:46.656671 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: User-Agent: python-urllib3/1.26.9 Jul 06 13:55:46.656671 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Auth-Token: gAAAAABixZH4I4dgmb0Q3wbjrFWrBMh6OmJtrlg6lZ88SjHzAtW3fxMyo3s0_pJVvHdnPyxERhBQTWBNewTHA0QeJRzzLbnn4Csb1lAz3C9NjKcuSHUaArYBZ7P3u01dtbqramyieBExBREkl13A9tBRRuVoPmOumXVJ74UVBAMWWamo1ttSwGg Jul 06 13:55:46.656671 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Domain-Id: None Jul 06 13:55:46.656671 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Domain-Name: None Jul 06 13:55:46.656671 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Identity-Status: Confirmed Jul 06 13:55:46.656671 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Is-Admin-Project: True Jul 06 13:55:46.656671 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Project-Domain-Id: default Jul 06 13:55:46.656671 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Project-Domain-Name: Default Jul 06 13:55:46.656671 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Project-Id: bd85f2a57a0847debf5aaf81aab7a638 Jul 06 13:55:46.656671 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Project-Name: tempest-AttachVolumeNegativeTest-1016924223 Jul 06 13:55:46.656671 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Role: reader,member Jul 06 13:55:46.656671 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Roles: reader,member Jul 06 13:55:46.658154 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_bd85f2a57a0847debf5aaf81aab7a638"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/bd85f2a57a0847debf5aaf81aab7a638"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/bd85f2a57a0847debf5aaf81aab7a638"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/bd85f2a57a0847debf5aaf81aab7a638"}]}] Jul 06 13:55:46.658154 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Tenant: tempest-AttachVolumeNegativeTest-1016924223 Jul 06 13:55:46.658154 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Tenant-Id: bd85f2a57a0847debf5aaf81aab7a638 Jul 06 13:55:46.658154 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1016924223 Jul 06 13:55:46.658154 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-User: tempest-AttachVolumeNegativeTest-1016924223-project Jul 06 13:55:46.658154 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-User-Domain-Id: default Jul 06 13:55:46.658154 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-User-Domain-Name: Default Jul 06 13:55:46.658154 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-User-Id: 7b572a8f465048558fc969b85b2aec5b Jul 06 13:55:46.658154 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-User-Name: tempest-AttachVolumeNegativeTest-1016924223-project Jul 06 13:55:46.658154 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: method: > Jul 06 13:55:46.658154 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: exception: Instance 5cf73c2b-28f6-49f1-a119-224c05679d2c could not be found. Jul 06 13:55:46.658154 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: action_args: {'id': '5cf73c2b-28f6-49f1-a119-224c05679d2c'} Jul 06 13:55:46.659020 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 06 13:55:46.659020 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 06 13:55:46.659020 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 06 13:55:46.659020 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 06 13:55:46.659020 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 06 13:55:46.659020 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 06 13:55:46.659020 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 06 13:55:46.659020 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 06 13:55:46.659020 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 06 13:55:46.659020 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 06 13:55:46.659020 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5cf73c2b-28f6-49f1-a119-224c05679d2c could not be found. Jul 06 13:55:46.659020 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi Jul 06 13:55:46.659020 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 06 13:55:46.659020 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi Jul 06 13:55:46.659020 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 06 13:55:46.659020 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 06 13:55:46.659020 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 06 13:55:46.659020 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 06 13:55:46.659020 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 06 13:55:46.659020 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 06 13:55:46.660321 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 06 13:55:46.660321 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 06 13:55:46.660321 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 06 13:55:46.660321 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 06 13:55:46.660321 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 06 13:55:46.660321 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 06 13:55:46.660321 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 06 13:55:46.660321 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 06 13:55:46.660321 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 06 13:55:46.660321 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5cf73c2b-28f6-49f1-a119-224c05679d2c could not be found. Jul 06 13:55:46.660321 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi Jul 06 13:55:46.660321 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 06 13:55:46.660321 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi Jul 06 13:55:46.660321 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 06 13:55:46.660321 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 06 13:55:46.660321 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 06 13:55:46.660321 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 06 13:55:46.660321 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 06 13:55:46.660321 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5cf73c2b-28f6-49f1-a119-224c05679d2c could not be found. Jul 06 13:55:46.660321 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi Jul 06 13:55:46.661725 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-e3e24823-4eba-4c04-a36e-009ec21fb34d tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Returning 404 to user: Instance 5cf73c2b-28f6-49f1-a119-224c05679d2c could not be found. {{(pid=124368) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 06 13:55:46.661725 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-e3e24823-4eba-4c04-a36e-009ec21fb34d tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] 10.222.0.20 "DELETE /compute/v2.1/servers/5cf73c2b-28f6-49f1-a119-224c05679d2c" status: 404 len: 111 microversion: 2.1 time: 0.029817 Jul 06 13:55:46.661725 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 520/1032] 10.222.0.20 () {58 vars in 1238 bytes} [Wed Jul 6 13:55:46 2022] DELETE /compute/v2.1/servers/5cf73c2b-28f6-49f1-a119-224c05679d2c => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 06 13:55:46.666580 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-3956c24c-bc71-453b-a31d-73915354da37 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:55:46.667196 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-3956c24c-bc71-453b-a31d-73915354da37 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] [instance: 5cf73c2b-28f6-49f1-a119-224c05679d2c] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:55:46.674443 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-3956c24c-bc71-453b-a31d-73915354da37 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:55:46.675154 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-3956c24c-bc71-453b-a31d-73915354da37 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:55:46.675926 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-3956c24c-bc71-453b-a31d-73915354da37 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:55:46.676366 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-3956c24c-bc71-453b-a31d-73915354da37 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:55:46.689909 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.wsgi [None req-3956c24c-bc71-453b-a31d-73915354da37 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] HTTP exception thrown: Instance 5cf73c2b-28f6-49f1-a119-224c05679d2c could not be found. Jul 06 13:55:46.691432 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-3956c24c-bc71-453b-a31d-73915354da37 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Request method failure captured: Jul 06 13:55:46.691432 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: request: GET /compute/v2.1/servers/5cf73c2b-28f6-49f1-a119-224c05679d2c HTTP/1.1 Jul 06 13:55:46.691432 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: Accept: application/json Jul 06 13:55:46.691432 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: Accept-Encoding: identity Jul 06 13:55:46.691432 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: Connection: close Jul 06 13:55:46.691432 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: Content-Length: 0 Jul 06 13:55:46.691432 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: Content-Type: application/json Jul 06 13:55:46.691432 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: Host: 10.222.0.20 Jul 06 13:55:46.691432 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: Openstack-System-Scope: None Jul 06 13:55:46.691432 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: User-Agent: python-urllib3/1.26.9 Jul 06 13:55:46.691432 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: X-Auth-Token: gAAAAABixZH4I4dgmb0Q3wbjrFWrBMh6OmJtrlg6lZ88SjHzAtW3fxMyo3s0_pJVvHdnPyxERhBQTWBNewTHA0QeJRzzLbnn4Csb1lAz3C9NjKcuSHUaArYBZ7P3u01dtbqramyieBExBREkl13A9tBRRuVoPmOumXVJ74UVBAMWWamo1ttSwGg Jul 06 13:55:46.691432 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: X-Domain-Id: None Jul 06 13:55:46.691432 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: X-Domain-Name: None Jul 06 13:55:46.691432 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: X-Identity-Status: Confirmed Jul 06 13:55:46.691432 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: X-Is-Admin-Project: True Jul 06 13:55:46.691432 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: X-Project-Domain-Id: default Jul 06 13:55:46.691432 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: X-Project-Domain-Name: Default Jul 06 13:55:46.691432 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: X-Project-Id: bd85f2a57a0847debf5aaf81aab7a638 Jul 06 13:55:46.691432 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: X-Project-Name: tempest-AttachVolumeNegativeTest-1016924223 Jul 06 13:55:46.691432 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: X-Role: reader,member Jul 06 13:55:46.691432 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: X-Roles: reader,member Jul 06 13:55:46.692921 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_bd85f2a57a0847debf5aaf81aab7a638"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/bd85f2a57a0847debf5aaf81aab7a638"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/bd85f2a57a0847debf5aaf81aab7a638"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/bd85f2a57a0847debf5aaf81aab7a638"}]}] Jul 06 13:55:46.692921 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: X-Tenant: tempest-AttachVolumeNegativeTest-1016924223 Jul 06 13:55:46.692921 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: X-Tenant-Id: bd85f2a57a0847debf5aaf81aab7a638 Jul 06 13:55:46.692921 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1016924223 Jul 06 13:55:46.692921 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: X-User: tempest-AttachVolumeNegativeTest-1016924223-project Jul 06 13:55:46.692921 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: X-User-Domain-Id: default Jul 06 13:55:46.692921 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: X-User-Domain-Name: Default Jul 06 13:55:46.692921 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: X-User-Id: 7b572a8f465048558fc969b85b2aec5b Jul 06 13:55:46.692921 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: X-User-Name: tempest-AttachVolumeNegativeTest-1016924223-project Jul 06 13:55:46.692921 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: method: > Jul 06 13:55:46.692921 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: exception: Instance 5cf73c2b-28f6-49f1-a119-224c05679d2c could not be found. Jul 06 13:55:46.692921 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: action_args: {'id': '5cf73c2b-28f6-49f1-a119-224c05679d2c'} Jul 06 13:55:46.693827 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 06 13:55:46.693827 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 06 13:55:46.693827 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 06 13:55:46.693827 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 06 13:55:46.693827 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 06 13:55:46.693827 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 06 13:55:46.693827 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 06 13:55:46.693827 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 06 13:55:46.693827 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 06 13:55:46.693827 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 06 13:55:46.693827 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5cf73c2b-28f6-49f1-a119-224c05679d2c could not be found. Jul 06 13:55:46.693827 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi Jul 06 13:55:46.693827 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 06 13:55:46.693827 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi Jul 06 13:55:46.693827 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 06 13:55:46.693827 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 06 13:55:46.693827 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 06 13:55:46.693827 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 06 13:55:46.693827 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 06 13:55:46.693827 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 06 13:55:46.695352 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 06 13:55:46.695352 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 06 13:55:46.695352 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 06 13:55:46.695352 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 06 13:55:46.695352 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 06 13:55:46.695352 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 06 13:55:46.695352 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 06 13:55:46.695352 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5cf73c2b-28f6-49f1-a119-224c05679d2c could not be found. Jul 06 13:55:46.695352 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi Jul 06 13:55:46.695352 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 06 13:55:46.695352 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi Jul 06 13:55:46.695352 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 06 13:55:46.695352 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 06 13:55:46.695352 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 06 13:55:46.695352 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 06 13:55:46.695352 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 06 13:55:46.695352 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5cf73c2b-28f6-49f1-a119-224c05679d2c could not be found. Jul 06 13:55:46.695352 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi Jul 06 13:55:46.696821 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-3956c24c-bc71-453b-a31d-73915354da37 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] Returning 404 to user: Instance 5cf73c2b-28f6-49f1-a119-224c05679d2c could not be found. {{(pid=124367) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 06 13:55:46.696821 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-3956c24c-bc71-453b-a31d-73915354da37 tempest-AttachVolumeNegativeTest-1016924223 tempest-AttachVolumeNegativeTest-1016924223-project] 10.222.0.20 "GET /compute/v2.1/servers/5cf73c2b-28f6-49f1-a119-224c05679d2c" status: 404 len: 111 microversion: 2.1 time: 0.030026 Jul 06 13:55:46.697176 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 513/1033] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:55:46 2022] GET /compute/v2.1/servers/5cf73c2b-28f6-49f1-a119-224c05679d2c => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 06 13:55:46.791688 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-231f304b-bd32-4297-91df-5b12cbffc6e9 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Calling method '>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:55:46.792311 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-231f304b-bd32-4297-91df-5b12cbffc6e9 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] [instance: 4c0c4bb6-269f-46bc-b460-7d0299277753] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:55:46.801592 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-231f304b-bd32-4297-91df-5b12cbffc6e9 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:55:46.802044 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-231f304b-bd32-4297-91df-5b12cbffc6e9 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:55:46.802831 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-231f304b-bd32-4297-91df-5b12cbffc6e9 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:55:46.803273 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-231f304b-bd32-4297-91df-5b12cbffc6e9 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:55:47.077550 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-231f304b-bd32-4297-91df-5b12cbffc6e9 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c85251638bc64deca16008b696b11ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3edb8d53184b98b7055ffc145f186d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:55:47.092227 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-231f304b-bd32-4297-91df-5b12cbffc6e9 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c85251638bc64deca16008b696b11ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3edb8d53184b98b7055ffc145f186d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:55:47.094937 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-231f304b-bd32-4297-91df-5b12cbffc6e9 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c85251638bc64deca16008b696b11ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3edb8d53184b98b7055ffc145f186d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:55:47.097160 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-231f304b-bd32-4297-91df-5b12cbffc6e9 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] 10.222.0.20 "GET /compute/v2.1/servers/4c0c4bb6-269f-46bc-b460-7d0299277753" status: 200 len: 1808 microversion: 2.20 time: 0.308817 Jul 06 13:55:47.098599 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 521/1034] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 6 13:55:46 2022] GET /compute/v2.1/servers/4c0c4bb6-269f-46bc-b460-7d0299277753 => generated 1808 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 06 13:55:48.116546 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-4e4defe5-cc5b-4a23-b8b6-5f863dccd0ee tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:55:48.117331 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-4e4defe5-cc5b-4a23-b8b6-5f863dccd0ee tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] [instance: 4c0c4bb6-269f-46bc-b460-7d0299277753] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:55:48.151181 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-4e4defe5-cc5b-4a23-b8b6-5f863dccd0ee tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:55:48.152255 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-4e4defe5-cc5b-4a23-b8b6-5f863dccd0ee tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:55:48.154656 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-4e4defe5-cc5b-4a23-b8b6-5f863dccd0ee tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:55:48.155389 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-4e4defe5-cc5b-4a23-b8b6-5f863dccd0ee tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:55:48.437151 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-4e4defe5-cc5b-4a23-b8b6-5f863dccd0ee tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c85251638bc64deca16008b696b11ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3edb8d53184b98b7055ffc145f186d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:55:48.447379 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-4e4defe5-cc5b-4a23-b8b6-5f863dccd0ee tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c85251638bc64deca16008b696b11ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3edb8d53184b98b7055ffc145f186d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:55:48.448878 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-4e4defe5-cc5b-4a23-b8b6-5f863dccd0ee tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c85251638bc64deca16008b696b11ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3edb8d53184b98b7055ffc145f186d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:55:48.451346 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-4e4defe5-cc5b-4a23-b8b6-5f863dccd0ee tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] 10.222.0.20 "GET /compute/v2.1/servers/4c0c4bb6-269f-46bc-b460-7d0299277753" status: 200 len: 1808 microversion: 2.20 time: 0.338202 Jul 06 13:55:48.461572 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 514/1035] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 6 13:55:48 2022] GET /compute/v2.1/servers/4c0c4bb6-269f-46bc-b460-7d0299277753 => generated 1808 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 06 13:55:49.469922 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-25497ac7-ae7e-4422-ad93-ba8ed5082d47 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Calling method '>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:55:49.473464 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-25497ac7-ae7e-4422-ad93-ba8ed5082d47 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] [instance: 4c0c4bb6-269f-46bc-b460-7d0299277753] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:55:49.484662 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-25497ac7-ae7e-4422-ad93-ba8ed5082d47 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:55:49.491712 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-25497ac7-ae7e-4422-ad93-ba8ed5082d47 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:55:49.492828 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-25497ac7-ae7e-4422-ad93-ba8ed5082d47 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:55:49.495809 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-25497ac7-ae7e-4422-ad93-ba8ed5082d47 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:55:49.684589 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-25497ac7-ae7e-4422-ad93-ba8ed5082d47 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c85251638bc64deca16008b696b11ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3edb8d53184b98b7055ffc145f186d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:55:49.703024 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-25497ac7-ae7e-4422-ad93-ba8ed5082d47 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c85251638bc64deca16008b696b11ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3edb8d53184b98b7055ffc145f186d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:55:49.710653 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-25497ac7-ae7e-4422-ad93-ba8ed5082d47 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c85251638bc64deca16008b696b11ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3edb8d53184b98b7055ffc145f186d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:55:49.718964 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-25497ac7-ae7e-4422-ad93-ba8ed5082d47 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] 10.222.0.20 "GET /compute/v2.1/servers/4c0c4bb6-269f-46bc-b460-7d0299277753" status: 200 len: 1808 microversion: 2.20 time: 0.253545 Jul 06 13:55:49.740911 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 522/1036] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 6 13:55:49 2022] GET /compute/v2.1/servers/4c0c4bb6-269f-46bc-b460-7d0299277753 => generated 1808 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 06 13:55:50.747670 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-a17e62a8-1883-457d-9acc-31a148b5782d tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:55:50.748280 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-a17e62a8-1883-457d-9acc-31a148b5782d tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] [instance: 4c0c4bb6-269f-46bc-b460-7d0299277753] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:55:50.774022 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-a17e62a8-1883-457d-9acc-31a148b5782d tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:55:50.775312 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-a17e62a8-1883-457d-9acc-31a148b5782d tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:55:50.778483 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-a17e62a8-1883-457d-9acc-31a148b5782d tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:55:50.779663 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-a17e62a8-1883-457d-9acc-31a148b5782d tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:55:51.775902 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-a17e62a8-1883-457d-9acc-31a148b5782d tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c85251638bc64deca16008b696b11ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3edb8d53184b98b7055ffc145f186d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:55:51.788779 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-a17e62a8-1883-457d-9acc-31a148b5782d tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c85251638bc64deca16008b696b11ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3edb8d53184b98b7055ffc145f186d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:55:51.791247 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-a17e62a8-1883-457d-9acc-31a148b5782d tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c85251638bc64deca16008b696b11ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3edb8d53184b98b7055ffc145f186d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:55:51.792726 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-a17e62a8-1883-457d-9acc-31a148b5782d tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] 10.222.0.20 "GET /compute/v2.1/servers/4c0c4bb6-269f-46bc-b460-7d0299277753" status: 200 len: 1808 microversion: 2.20 time: 1.049444 Jul 06 13:55:51.805663 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 515/1037] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 6 13:55:50 2022] GET /compute/v2.1/servers/4c0c4bb6-269f-46bc-b460-7d0299277753 => generated 1808 bytes in 1063 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 06 13:55:52.812056 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-2d93a136-c2d9-4063-b702-359c636911c3 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Calling method '>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:55:52.813186 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-2d93a136-c2d9-4063-b702-359c636911c3 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] [instance: 4c0c4bb6-269f-46bc-b460-7d0299277753] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:55:52.827189 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-2d93a136-c2d9-4063-b702-359c636911c3 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:55:52.828042 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-2d93a136-c2d9-4063-b702-359c636911c3 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:55:52.832508 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-2d93a136-c2d9-4063-b702-359c636911c3 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:55:52.833096 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-2d93a136-c2d9-4063-b702-359c636911c3 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:55:53.527926 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-2d93a136-c2d9-4063-b702-359c636911c3 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c85251638bc64deca16008b696b11ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3edb8d53184b98b7055ffc145f186d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:55:53.563778 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-2d93a136-c2d9-4063-b702-359c636911c3 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c85251638bc64deca16008b696b11ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3edb8d53184b98b7055ffc145f186d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:55:53.566447 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-2d93a136-c2d9-4063-b702-359c636911c3 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c85251638bc64deca16008b696b11ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3edb8d53184b98b7055ffc145f186d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:55:53.568525 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-2d93a136-c2d9-4063-b702-359c636911c3 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] 10.222.0.20 "GET /compute/v2.1/servers/4c0c4bb6-269f-46bc-b460-7d0299277753" status: 200 len: 1808 microversion: 2.20 time: 0.760811 Jul 06 13:55:53.573671 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 523/1038] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 6 13:55:52 2022] GET /compute/v2.1/servers/4c0c4bb6-269f-46bc-b460-7d0299277753 => generated 1808 bytes in 766 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 06 13:55:54.590977 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-f6d4b8aa-6ed7-4601-b001-52ee6d71ae19 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:55:54.592241 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-f6d4b8aa-6ed7-4601-b001-52ee6d71ae19 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] [instance: 4c0c4bb6-269f-46bc-b460-7d0299277753] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:55:54.600016 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-f6d4b8aa-6ed7-4601-b001-52ee6d71ae19 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:55:54.600548 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-f6d4b8aa-6ed7-4601-b001-52ee6d71ae19 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:55:54.601539 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-f6d4b8aa-6ed7-4601-b001-52ee6d71ae19 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:55:54.602126 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-f6d4b8aa-6ed7-4601-b001-52ee6d71ae19 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:55:54.773574 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-f6d4b8aa-6ed7-4601-b001-52ee6d71ae19 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c85251638bc64deca16008b696b11ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3edb8d53184b98b7055ffc145f186d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:55:54.786428 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-f6d4b8aa-6ed7-4601-b001-52ee6d71ae19 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c85251638bc64deca16008b696b11ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3edb8d53184b98b7055ffc145f186d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:55:54.788227 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-f6d4b8aa-6ed7-4601-b001-52ee6d71ae19 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c85251638bc64deca16008b696b11ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3edb8d53184b98b7055ffc145f186d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:55:54.789583 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-f6d4b8aa-6ed7-4601-b001-52ee6d71ae19 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] 10.222.0.20 "GET /compute/v2.1/servers/4c0c4bb6-269f-46bc-b460-7d0299277753" status: 200 len: 1808 microversion: 2.20 time: 0.202523 Jul 06 13:55:54.800566 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 516/1039] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 6 13:55:54 2022] GET /compute/v2.1/servers/4c0c4bb6-269f-46bc-b460-7d0299277753 => generated 1808 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 06 13:55:55.807822 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-eacc4465-5b09-48e6-8982-07221dacaed8 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Calling method '>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:55:55.808546 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-eacc4465-5b09-48e6-8982-07221dacaed8 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] [instance: 4c0c4bb6-269f-46bc-b460-7d0299277753] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:55:55.815200 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-eacc4465-5b09-48e6-8982-07221dacaed8 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:55:55.815745 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-eacc4465-5b09-48e6-8982-07221dacaed8 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:55:55.816638 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-eacc4465-5b09-48e6-8982-07221dacaed8 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:55:55.817189 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-eacc4465-5b09-48e6-8982-07221dacaed8 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:55:55.954026 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-eacc4465-5b09-48e6-8982-07221dacaed8 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c85251638bc64deca16008b696b11ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3edb8d53184b98b7055ffc145f186d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:55:55.963813 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-eacc4465-5b09-48e6-8982-07221dacaed8 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c85251638bc64deca16008b696b11ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3edb8d53184b98b7055ffc145f186d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:55:55.966164 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-eacc4465-5b09-48e6-8982-07221dacaed8 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c85251638bc64deca16008b696b11ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3edb8d53184b98b7055ffc145f186d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:55:55.967459 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-eacc4465-5b09-48e6-8982-07221dacaed8 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] 10.222.0.20 "GET /compute/v2.1/servers/4c0c4bb6-269f-46bc-b460-7d0299277753" status: 200 len: 1808 microversion: 2.20 time: 0.163633 Jul 06 13:55:55.968031 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 524/1040] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 6 13:55:55 2022] GET /compute/v2.1/servers/4c0c4bb6-269f-46bc-b460-7d0299277753 => generated 1808 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 06 13:55:56.986021 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-8312aefe-facf-4bf0-9f32-02075840e6aa tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:55:56.986745 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-8312aefe-facf-4bf0-9f32-02075840e6aa tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] [instance: 4c0c4bb6-269f-46bc-b460-7d0299277753] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:55:56.993314 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-8312aefe-facf-4bf0-9f32-02075840e6aa tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:55:56.993926 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-8312aefe-facf-4bf0-9f32-02075840e6aa tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:55:56.994880 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-8312aefe-facf-4bf0-9f32-02075840e6aa tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:55:56.995382 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-8312aefe-facf-4bf0-9f32-02075840e6aa tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:55:57.157336 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-8312aefe-facf-4bf0-9f32-02075840e6aa tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c85251638bc64deca16008b696b11ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3edb8d53184b98b7055ffc145f186d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:55:57.168377 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-8312aefe-facf-4bf0-9f32-02075840e6aa tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c85251638bc64deca16008b696b11ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3edb8d53184b98b7055ffc145f186d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:55:57.170061 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-8312aefe-facf-4bf0-9f32-02075840e6aa tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c85251638bc64deca16008b696b11ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3edb8d53184b98b7055ffc145f186d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:55:57.171215 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-8312aefe-facf-4bf0-9f32-02075840e6aa tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] 10.222.0.20 "GET /compute/v2.1/servers/4c0c4bb6-269f-46bc-b460-7d0299277753" status: 200 len: 1808 microversion: 2.20 time: 0.189984 Jul 06 13:55:57.171747 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 517/1041] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 6 13:55:56 2022] GET /compute/v2.1/servers/4c0c4bb6-269f-46bc-b460-7d0299277753 => generated 1808 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 06 13:55:58.190590 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-6f5d19e0-99ad-4296-9a50-0bfe36a5a160 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Calling method '>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:55:58.191202 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-6f5d19e0-99ad-4296-9a50-0bfe36a5a160 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] [instance: 4c0c4bb6-269f-46bc-b460-7d0299277753] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:55:58.197842 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-6f5d19e0-99ad-4296-9a50-0bfe36a5a160 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:55:58.198300 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-6f5d19e0-99ad-4296-9a50-0bfe36a5a160 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:55:58.199074 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-6f5d19e0-99ad-4296-9a50-0bfe36a5a160 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:55:58.199523 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-6f5d19e0-99ad-4296-9a50-0bfe36a5a160 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:55:58.335949 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-6f5d19e0-99ad-4296-9a50-0bfe36a5a160 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c85251638bc64deca16008b696b11ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3edb8d53184b98b7055ffc145f186d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:55:58.345371 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-6f5d19e0-99ad-4296-9a50-0bfe36a5a160 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c85251638bc64deca16008b696b11ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3edb8d53184b98b7055ffc145f186d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:55:58.347019 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-6f5d19e0-99ad-4296-9a50-0bfe36a5a160 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c85251638bc64deca16008b696b11ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3edb8d53184b98b7055ffc145f186d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:55:58.348190 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-6f5d19e0-99ad-4296-9a50-0bfe36a5a160 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] 10.222.0.20 "GET /compute/v2.1/servers/4c0c4bb6-269f-46bc-b460-7d0299277753" status: 200 len: 1808 microversion: 2.20 time: 0.161524 Jul 06 13:55:58.354173 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 525/1042] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 6 13:55:58 2022] GET /compute/v2.1/servers/4c0c4bb6-269f-46bc-b460-7d0299277753 => generated 1808 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 06 13:55:59.373701 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-765deeb2-7887-46bd-ba5a-b51b0fa6d1d3 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:55:59.375088 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-765deeb2-7887-46bd-ba5a-b51b0fa6d1d3 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] [instance: 4c0c4bb6-269f-46bc-b460-7d0299277753] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:55:59.379878 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG dbcounter [-] [124367] Writing DB stats nova_api:SELECT=53,nova_api:UPDATE=1 {{(pid=124367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:55:59.383968 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-765deeb2-7887-46bd-ba5a-b51b0fa6d1d3 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:55:59.384565 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-765deeb2-7887-46bd-ba5a-b51b0fa6d1d3 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:55:59.385668 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-765deeb2-7887-46bd-ba5a-b51b0fa6d1d3 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:55:59.386141 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-765deeb2-7887-46bd-ba5a-b51b0fa6d1d3 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:55:59.547172 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-765deeb2-7887-46bd-ba5a-b51b0fa6d1d3 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c85251638bc64deca16008b696b11ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3edb8d53184b98b7055ffc145f186d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:55:59.555648 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-765deeb2-7887-46bd-ba5a-b51b0fa6d1d3 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c85251638bc64deca16008b696b11ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3edb8d53184b98b7055ffc145f186d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:55:59.557170 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-765deeb2-7887-46bd-ba5a-b51b0fa6d1d3 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c85251638bc64deca16008b696b11ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3edb8d53184b98b7055ffc145f186d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:55:59.558320 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-765deeb2-7887-46bd-ba5a-b51b0fa6d1d3 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] 10.222.0.20 "GET /compute/v2.1/servers/4c0c4bb6-269f-46bc-b460-7d0299277753" status: 200 len: 1808 microversion: 2.20 time: 0.194039 Jul 06 13:55:59.558877 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 518/1043] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 6 13:55:59 2022] GET /compute/v2.1/servers/4c0c4bb6-269f-46bc-b460-7d0299277753 => generated 1808 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 06 13:56:00.577793 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-a9c59f5f-ee05-4ff1-bca0-efcb6733313e tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Calling method '>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:56:00.578555 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-a9c59f5f-ee05-4ff1-bca0-efcb6733313e tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] [instance: 4c0c4bb6-269f-46bc-b460-7d0299277753] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:56:00.580910 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG dbcounter [-] [124368] Writing DB stats nova_api:SELECT=53,nova_api:DELETE=1 {{(pid=124368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:56:00.586140 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-a9c59f5f-ee05-4ff1-bca0-efcb6733313e tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:56:00.586594 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-a9c59f5f-ee05-4ff1-bca0-efcb6733313e tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:56:00.587362 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-a9c59f5f-ee05-4ff1-bca0-efcb6733313e tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:56:00.587844 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-a9c59f5f-ee05-4ff1-bca0-efcb6733313e tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:56:00.606965 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG dbcounter [-] [124368] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:56:00.727542 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-a9c59f5f-ee05-4ff1-bca0-efcb6733313e tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c85251638bc64deca16008b696b11ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3edb8d53184b98b7055ffc145f186d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:56:00.741425 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-a9c59f5f-ee05-4ff1-bca0-efcb6733313e tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c85251638bc64deca16008b696b11ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3edb8d53184b98b7055ffc145f186d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:56:00.741425 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-a9c59f5f-ee05-4ff1-bca0-efcb6733313e tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c85251638bc64deca16008b696b11ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3edb8d53184b98b7055ffc145f186d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:56:00.741425 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-a9c59f5f-ee05-4ff1-bca0-efcb6733313e tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] 10.222.0.20 "GET /compute/v2.1/servers/4c0c4bb6-269f-46bc-b460-7d0299277753" status: 200 len: 1808 microversion: 2.20 time: 0.166115 Jul 06 13:56:00.741745 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 526/1044] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 6 13:56:00 2022] GET /compute/v2.1/servers/4c0c4bb6-269f-46bc-b460-7d0299277753 => generated 1808 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 06 13:56:01.757936 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-f34ed1ef-3195-4c13-b870-f61427ce88f6 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:56:01.758539 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-f34ed1ef-3195-4c13-b870-f61427ce88f6 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] [instance: 4c0c4bb6-269f-46bc-b460-7d0299277753] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:56:01.765210 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-f34ed1ef-3195-4c13-b870-f61427ce88f6 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:56:01.765660 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-f34ed1ef-3195-4c13-b870-f61427ce88f6 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:56:01.766412 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-f34ed1ef-3195-4c13-b870-f61427ce88f6 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:56:01.766865 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-f34ed1ef-3195-4c13-b870-f61427ce88f6 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:56:01.895203 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-f34ed1ef-3195-4c13-b870-f61427ce88f6 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c85251638bc64deca16008b696b11ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3edb8d53184b98b7055ffc145f186d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:56:01.898652 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG dbcounter [-] [124367] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=124367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:56:01.905034 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-f34ed1ef-3195-4c13-b870-f61427ce88f6 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c85251638bc64deca16008b696b11ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3edb8d53184b98b7055ffc145f186d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:56:01.906520 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-f34ed1ef-3195-4c13-b870-f61427ce88f6 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c85251638bc64deca16008b696b11ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3edb8d53184b98b7055ffc145f186d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:56:01.907661 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-f34ed1ef-3195-4c13-b870-f61427ce88f6 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] 10.222.0.20 "GET /compute/v2.1/servers/4c0c4bb6-269f-46bc-b460-7d0299277753" status: 200 len: 1808 microversion: 2.20 time: 0.153637 Jul 06 13:56:01.908232 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 519/1045] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 6 13:56:01 2022] GET /compute/v2.1/servers/4c0c4bb6-269f-46bc-b460-7d0299277753 => generated 1808 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 06 13:56:02.926560 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-a938cf84-b44f-4413-b956-2224b744669a tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Calling method '>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:56:02.927169 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-a938cf84-b44f-4413-b956-2224b744669a tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] [instance: 4c0c4bb6-269f-46bc-b460-7d0299277753] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:56:02.933756 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-a938cf84-b44f-4413-b956-2224b744669a tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:56:02.934879 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-a938cf84-b44f-4413-b956-2224b744669a tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:56:02.935826 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-a938cf84-b44f-4413-b956-2224b744669a tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:56:02.936268 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-a938cf84-b44f-4413-b956-2224b744669a tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:56:03.063445 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-a938cf84-b44f-4413-b956-2224b744669a tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c85251638bc64deca16008b696b11ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3edb8d53184b98b7055ffc145f186d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:56:03.071783 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-a938cf84-b44f-4413-b956-2224b744669a tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c85251638bc64deca16008b696b11ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3edb8d53184b98b7055ffc145f186d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:56:03.073302 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-a938cf84-b44f-4413-b956-2224b744669a tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c85251638bc64deca16008b696b11ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3edb8d53184b98b7055ffc145f186d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:56:03.074453 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-a938cf84-b44f-4413-b956-2224b744669a tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] 10.222.0.20 "GET /compute/v2.1/servers/4c0c4bb6-269f-46bc-b460-7d0299277753" status: 200 len: 1808 microversion: 2.20 time: 0.152034 Jul 06 13:56:03.075178 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 527/1046] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 6 13:56:02 2022] GET /compute/v2.1/servers/4c0c4bb6-269f-46bc-b460-7d0299277753 => generated 1808 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 06 13:56:04.093750 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-d988689a-8814-4795-b21e-9bb7b5f259f4 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:56:04.094356 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-d988689a-8814-4795-b21e-9bb7b5f259f4 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] [instance: 4c0c4bb6-269f-46bc-b460-7d0299277753] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:56:04.102124 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-d988689a-8814-4795-b21e-9bb7b5f259f4 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:56:04.102578 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-d988689a-8814-4795-b21e-9bb7b5f259f4 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:56:04.103347 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-d988689a-8814-4795-b21e-9bb7b5f259f4 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:56:04.103781 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-d988689a-8814-4795-b21e-9bb7b5f259f4 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:56:04.240960 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-d988689a-8814-4795-b21e-9bb7b5f259f4 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c85251638bc64deca16008b696b11ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3edb8d53184b98b7055ffc145f186d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:56:04.250398 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-d988689a-8814-4795-b21e-9bb7b5f259f4 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c85251638bc64deca16008b696b11ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3edb8d53184b98b7055ffc145f186d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:56:04.251911 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-d988689a-8814-4795-b21e-9bb7b5f259f4 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c85251638bc64deca16008b696b11ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3edb8d53184b98b7055ffc145f186d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:56:04.253098 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-d988689a-8814-4795-b21e-9bb7b5f259f4 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] 10.222.0.20 "GET /compute/v2.1/servers/4c0c4bb6-269f-46bc-b460-7d0299277753" status: 200 len: 1808 microversion: 2.20 time: 0.164397 Jul 06 13:56:04.253647 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 520/1047] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 6 13:56:04 2022] GET /compute/v2.1/servers/4c0c4bb6-269f-46bc-b460-7d0299277753 => generated 1808 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 06 13:56:05.271069 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-9698b509-0a3a-4950-89a6-881b4a58a4fd tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Calling method '>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:56:05.271687 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-9698b509-0a3a-4950-89a6-881b4a58a4fd tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] [instance: 4c0c4bb6-269f-46bc-b460-7d0299277753] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:56:05.278120 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-9698b509-0a3a-4950-89a6-881b4a58a4fd tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:56:05.278759 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-9698b509-0a3a-4950-89a6-881b4a58a4fd tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:56:05.279540 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-9698b509-0a3a-4950-89a6-881b4a58a4fd tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:56:05.279990 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-9698b509-0a3a-4950-89a6-881b4a58a4fd tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:56:05.420230 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-9698b509-0a3a-4950-89a6-881b4a58a4fd tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c85251638bc64deca16008b696b11ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3edb8d53184b98b7055ffc145f186d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:56:05.429213 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-9698b509-0a3a-4950-89a6-881b4a58a4fd tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c85251638bc64deca16008b696b11ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3edb8d53184b98b7055ffc145f186d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:56:05.430974 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-9698b509-0a3a-4950-89a6-881b4a58a4fd tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c85251638bc64deca16008b696b11ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3edb8d53184b98b7055ffc145f186d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:56:05.432201 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-9698b509-0a3a-4950-89a6-881b4a58a4fd tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] 10.222.0.20 "GET /compute/v2.1/servers/4c0c4bb6-269f-46bc-b460-7d0299277753" status: 200 len: 1808 microversion: 2.20 time: 0.165074 Jul 06 13:56:05.433248 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 528/1048] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 6 13:56:05 2022] GET /compute/v2.1/servers/4c0c4bb6-269f-46bc-b460-7d0299277753 => generated 1808 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 06 13:56:06.451213 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-a64c514f-b461-49b8-a43b-6541dea7830f tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:56:06.451817 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-a64c514f-b461-49b8-a43b-6541dea7830f tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] [instance: 4c0c4bb6-269f-46bc-b460-7d0299277753] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:56:06.458336 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-a64c514f-b461-49b8-a43b-6541dea7830f tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:56:06.458788 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-a64c514f-b461-49b8-a43b-6541dea7830f tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:56:06.459556 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-a64c514f-b461-49b8-a43b-6541dea7830f tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:56:06.459989 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-a64c514f-b461-49b8-a43b-6541dea7830f tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:56:06.591508 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-a64c514f-b461-49b8-a43b-6541dea7830f tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c85251638bc64deca16008b696b11ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3edb8d53184b98b7055ffc145f186d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:56:06.600449 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-a64c514f-b461-49b8-a43b-6541dea7830f tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c85251638bc64deca16008b696b11ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3edb8d53184b98b7055ffc145f186d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:56:06.604889 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-a64c514f-b461-49b8-a43b-6541dea7830f tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c85251638bc64deca16008b696b11ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3edb8d53184b98b7055ffc145f186d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:56:06.604889 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-a64c514f-b461-49b8-a43b-6541dea7830f tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] 10.222.0.20 "GET /compute/v2.1/servers/4c0c4bb6-269f-46bc-b460-7d0299277753" status: 200 len: 1808 microversion: 2.20 time: 0.156476 Jul 06 13:56:06.604889 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 521/1049] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 6 13:56:06 2022] GET /compute/v2.1/servers/4c0c4bb6-269f-46bc-b460-7d0299277753 => generated 1808 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 06 13:56:07.622544 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-1675d101-e404-44fc-89e8-a01a0be7c992 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Calling method '>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:56:07.623345 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-1675d101-e404-44fc-89e8-a01a0be7c992 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] [instance: 4c0c4bb6-269f-46bc-b460-7d0299277753] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:56:07.630671 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-1675d101-e404-44fc-89e8-a01a0be7c992 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:56:07.631032 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-1675d101-e404-44fc-89e8-a01a0be7c992 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:56:07.631923 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-1675d101-e404-44fc-89e8-a01a0be7c992 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:56:07.632363 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-1675d101-e404-44fc-89e8-a01a0be7c992 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:56:07.771737 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-1675d101-e404-44fc-89e8-a01a0be7c992 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c85251638bc64deca16008b696b11ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3edb8d53184b98b7055ffc145f186d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:56:07.780741 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-1675d101-e404-44fc-89e8-a01a0be7c992 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c85251638bc64deca16008b696b11ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3edb8d53184b98b7055ffc145f186d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:56:07.782368 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-1675d101-e404-44fc-89e8-a01a0be7c992 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c85251638bc64deca16008b696b11ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3edb8d53184b98b7055ffc145f186d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:56:07.783532 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-1675d101-e404-44fc-89e8-a01a0be7c992 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] 10.222.0.20 "GET /compute/v2.1/servers/4c0c4bb6-269f-46bc-b460-7d0299277753" status: 200 len: 1808 microversion: 2.20 time: 0.165914 Jul 06 13:56:07.784082 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 529/1050] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 6 13:56:07 2022] GET /compute/v2.1/servers/4c0c4bb6-269f-46bc-b460-7d0299277753 => generated 1808 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 06 13:56:08.802686 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-de3eebb9-438e-4903-989c-c498f6a706b1 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:56:08.803288 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-de3eebb9-438e-4903-989c-c498f6a706b1 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] [instance: 4c0c4bb6-269f-46bc-b460-7d0299277753] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:56:08.810263 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-de3eebb9-438e-4903-989c-c498f6a706b1 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:56:08.810711 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-de3eebb9-438e-4903-989c-c498f6a706b1 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:56:08.811503 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-de3eebb9-438e-4903-989c-c498f6a706b1 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:56:08.811934 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-de3eebb9-438e-4903-989c-c498f6a706b1 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:56:08.960478 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-de3eebb9-438e-4903-989c-c498f6a706b1 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c85251638bc64deca16008b696b11ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3edb8d53184b98b7055ffc145f186d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:56:08.971471 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-de3eebb9-438e-4903-989c-c498f6a706b1 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c85251638bc64deca16008b696b11ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3edb8d53184b98b7055ffc145f186d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:56:08.973082 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-de3eebb9-438e-4903-989c-c498f6a706b1 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c85251638bc64deca16008b696b11ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3edb8d53184b98b7055ffc145f186d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:56:08.975319 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-de3eebb9-438e-4903-989c-c498f6a706b1 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] 10.222.0.20 "GET /compute/v2.1/servers/4c0c4bb6-269f-46bc-b460-7d0299277753" status: 200 len: 1808 microversion: 2.20 time: 0.176784 Jul 06 13:56:08.976133 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 522/1051] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 6 13:56:08 2022] GET /compute/v2.1/servers/4c0c4bb6-269f-46bc-b460-7d0299277753 => generated 1808 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 06 13:56:09.995530 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-8e5bf6e1-e1cb-4ea9-9066-b715912f3e51 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Calling method '>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:56:09.996151 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-8e5bf6e1-e1cb-4ea9-9066-b715912f3e51 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] [instance: 4c0c4bb6-269f-46bc-b460-7d0299277753] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:56:10.003895 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-8e5bf6e1-e1cb-4ea9-9066-b715912f3e51 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:56:10.004642 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-8e5bf6e1-e1cb-4ea9-9066-b715912f3e51 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:56:10.005708 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-8e5bf6e1-e1cb-4ea9-9066-b715912f3e51 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:56:10.006393 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-8e5bf6e1-e1cb-4ea9-9066-b715912f3e51 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:56:10.156575 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-8e5bf6e1-e1cb-4ea9-9066-b715912f3e51 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c85251638bc64deca16008b696b11ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3edb8d53184b98b7055ffc145f186d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:56:10.166297 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-8e5bf6e1-e1cb-4ea9-9066-b715912f3e51 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c85251638bc64deca16008b696b11ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3edb8d53184b98b7055ffc145f186d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:56:10.168114 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-8e5bf6e1-e1cb-4ea9-9066-b715912f3e51 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c85251638bc64deca16008b696b11ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3edb8d53184b98b7055ffc145f186d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:56:10.170479 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-8e5bf6e1-e1cb-4ea9-9066-b715912f3e51 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] 10.222.0.20 "GET /compute/v2.1/servers/4c0c4bb6-269f-46bc-b460-7d0299277753" status: 200 len: 1808 microversion: 2.20 time: 0.178844 Jul 06 13:56:10.171551 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 530/1052] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 6 13:56:09 2022] GET /compute/v2.1/servers/4c0c4bb6-269f-46bc-b460-7d0299277753 => generated 1808 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 06 13:56:11.189836 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-9df181fb-fe49-4815-851f-f90c18fc62e7 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:56:11.190432 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-9df181fb-fe49-4815-851f-f90c18fc62e7 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] [instance: 4c0c4bb6-269f-46bc-b460-7d0299277753] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:56:11.196887 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-9df181fb-fe49-4815-851f-f90c18fc62e7 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:56:11.197365 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-9df181fb-fe49-4815-851f-f90c18fc62e7 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:56:11.198133 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-9df181fb-fe49-4815-851f-f90c18fc62e7 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:56:11.198557 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-9df181fb-fe49-4815-851f-f90c18fc62e7 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:56:11.339091 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-9df181fb-fe49-4815-851f-f90c18fc62e7 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c85251638bc64deca16008b696b11ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3edb8d53184b98b7055ffc145f186d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:56:11.348080 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-9df181fb-fe49-4815-851f-f90c18fc62e7 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c85251638bc64deca16008b696b11ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3edb8d53184b98b7055ffc145f186d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:56:11.349606 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-9df181fb-fe49-4815-851f-f90c18fc62e7 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c85251638bc64deca16008b696b11ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3edb8d53184b98b7055ffc145f186d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:56:11.351028 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-9df181fb-fe49-4815-851f-f90c18fc62e7 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] 10.222.0.20 "GET /compute/v2.1/servers/4c0c4bb6-269f-46bc-b460-7d0299277753" status: 200 len: 1808 microversion: 2.20 time: 0.165125 Jul 06 13:56:11.352084 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 523/1053] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 6 13:56:11 2022] GET /compute/v2.1/servers/4c0c4bb6-269f-46bc-b460-7d0299277753 => generated 1808 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 06 13:56:11.544709 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [req-bd55d56c-30a8-4db0-b0d6-20966c6a68ce req-bf7fd6a1-b6f7-4c51-bf1a-c73611826e62 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4c0c4bb6-269f-46bc-b460-7d0299277753", "name": "network-vif-plugged", "status": "completed", "tag": "92164628-0711-4bbe-835d-289c030d699a"}]} {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 06 13:56:11.558228 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [req-bd55d56c-30a8-4db0-b0d6-20966c6a68ce req-bf7fd6a1-b6f7-4c51-bf1a-c73611826e62 service nova] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:56:11.558688 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [req-bd55d56c-30a8-4db0-b0d6-20966c6a68ce req-bf7fd6a1-b6f7-4c51-bf1a-c73611826e62 service nova] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:56:11.570590 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.compute.server_external_events [req-bd55d56c-30a8-4db0-b0d6-20966c6a68ce req-bf7fd6a1-b6f7-4c51-bf1a-c73611826e62 service nova] Creating event network-vif-plugged:92164628-0711-4bbe-835d-289c030d699a for instance 4c0c4bb6-269f-46bc-b460-7d0299277753 on hv-cinder-81914 Jul 06 13:56:11.576151 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [req-bd55d56c-30a8-4db0-b0d6-20966c6a68ce req-bf7fd6a1-b6f7-4c51-bf1a-c73611826e62 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035761 Jul 06 13:56:11.576959 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 531/1054] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 6 13:56:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 06 13:56:12.371409 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-5e90eb85-d429-4a25-bbdd-586d557ec6a6 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:56:12.373332 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-5e90eb85-d429-4a25-bbdd-586d557ec6a6 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] [instance: 4c0c4bb6-269f-46bc-b460-7d0299277753] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:56:12.380166 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-5e90eb85-d429-4a25-bbdd-586d557ec6a6 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:56:12.380616 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-5e90eb85-d429-4a25-bbdd-586d557ec6a6 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:56:12.381416 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-5e90eb85-d429-4a25-bbdd-586d557ec6a6 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:56:12.381852 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-5e90eb85-d429-4a25-bbdd-586d557ec6a6 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:56:12.511357 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-5e90eb85-d429-4a25-bbdd-586d557ec6a6 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c85251638bc64deca16008b696b11ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3edb8d53184b98b7055ffc145f186d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:56:12.520223 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-5e90eb85-d429-4a25-bbdd-586d557ec6a6 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c85251638bc64deca16008b696b11ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3edb8d53184b98b7055ffc145f186d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:56:12.521757 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-5e90eb85-d429-4a25-bbdd-586d557ec6a6 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c85251638bc64deca16008b696b11ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3edb8d53184b98b7055ffc145f186d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:56:12.522916 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-5e90eb85-d429-4a25-bbdd-586d557ec6a6 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] 10.222.0.20 "GET /compute/v2.1/servers/4c0c4bb6-269f-46bc-b460-7d0299277753" status: 200 len: 1808 microversion: 2.20 time: 0.155506 Jul 06 13:56:12.523595 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 524/1055] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 6 13:56:12 2022] GET /compute/v2.1/servers/4c0c4bb6-269f-46bc-b460-7d0299277753 => generated 1808 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 06 13:56:13.542907 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-75155823-aaa3-4ade-83b7-feaae2912d0c tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Calling method '>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:56:13.543876 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-75155823-aaa3-4ade-83b7-feaae2912d0c tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] [instance: 4c0c4bb6-269f-46bc-b460-7d0299277753] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:56:13.551071 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-75155823-aaa3-4ade-83b7-feaae2912d0c tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:56:13.551518 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-75155823-aaa3-4ade-83b7-feaae2912d0c tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:56:13.552284 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-75155823-aaa3-4ade-83b7-feaae2912d0c tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:56:13.552718 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-75155823-aaa3-4ade-83b7-feaae2912d0c tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:56:13.681691 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-75155823-aaa3-4ade-83b7-feaae2912d0c tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c85251638bc64deca16008b696b11ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3edb8d53184b98b7055ffc145f186d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:56:13.690519 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-75155823-aaa3-4ade-83b7-feaae2912d0c tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c85251638bc64deca16008b696b11ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3edb8d53184b98b7055ffc145f186d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:56:13.692019 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-75155823-aaa3-4ade-83b7-feaae2912d0c tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c85251638bc64deca16008b696b11ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3edb8d53184b98b7055ffc145f186d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:56:13.693196 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-75155823-aaa3-4ade-83b7-feaae2912d0c tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] 10.222.0.20 "GET /compute/v2.1/servers/4c0c4bb6-269f-46bc-b460-7d0299277753" status: 200 len: 1808 microversion: 2.20 time: 0.154733 Jul 06 13:56:13.693741 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 532/1056] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 6 13:56:13 2022] GET /compute/v2.1/servers/4c0c4bb6-269f-46bc-b460-7d0299277753 => generated 1808 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 06 13:56:14.711737 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-df3ed11d-4a4f-47d0-bed3-d8487cee00e2 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:56:14.712334 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-df3ed11d-4a4f-47d0-bed3-d8487cee00e2 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] [instance: 4c0c4bb6-269f-46bc-b460-7d0299277753] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:56:14.718875 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-df3ed11d-4a4f-47d0-bed3-d8487cee00e2 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:56:14.719304 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-df3ed11d-4a4f-47d0-bed3-d8487cee00e2 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:56:14.720053 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-df3ed11d-4a4f-47d0-bed3-d8487cee00e2 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:56:14.720509 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-df3ed11d-4a4f-47d0-bed3-d8487cee00e2 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:56:14.859197 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-df3ed11d-4a4f-47d0-bed3-d8487cee00e2 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c85251638bc64deca16008b696b11ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3edb8d53184b98b7055ffc145f186d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:56:14.868401 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-df3ed11d-4a4f-47d0-bed3-d8487cee00e2 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c85251638bc64deca16008b696b11ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3edb8d53184b98b7055ffc145f186d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:56:14.870066 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-df3ed11d-4a4f-47d0-bed3-d8487cee00e2 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c85251638bc64deca16008b696b11ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3edb8d53184b98b7055ffc145f186d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:56:14.872013 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-df3ed11d-4a4f-47d0-bed3-d8487cee00e2 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] 10.222.0.20 "GET /compute/v2.1/servers/4c0c4bb6-269f-46bc-b460-7d0299277753" status: 200 len: 1808 microversion: 2.20 time: 0.163411 Jul 06 13:56:14.872995 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 525/1057] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 6 13:56:14 2022] GET /compute/v2.1/servers/4c0c4bb6-269f-46bc-b460-7d0299277753 => generated 1808 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 06 13:56:15.892294 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-0ae4c2e4-62dd-42ae-9a76-32efbe70bca9 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Calling method '>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:56:15.893089 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-0ae4c2e4-62dd-42ae-9a76-32efbe70bca9 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] [instance: 4c0c4bb6-269f-46bc-b460-7d0299277753] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:56:15.900627 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-0ae4c2e4-62dd-42ae-9a76-32efbe70bca9 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:56:15.901145 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-0ae4c2e4-62dd-42ae-9a76-32efbe70bca9 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:56:15.901954 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-0ae4c2e4-62dd-42ae-9a76-32efbe70bca9 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:56:15.902454 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-0ae4c2e4-62dd-42ae-9a76-32efbe70bca9 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:56:16.039699 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-0ae4c2e4-62dd-42ae-9a76-32efbe70bca9 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c85251638bc64deca16008b696b11ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3edb8d53184b98b7055ffc145f186d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:56:16.048995 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-0ae4c2e4-62dd-42ae-9a76-32efbe70bca9 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c85251638bc64deca16008b696b11ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3edb8d53184b98b7055ffc145f186d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:56:16.050770 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-0ae4c2e4-62dd-42ae-9a76-32efbe70bca9 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c85251638bc64deca16008b696b11ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3edb8d53184b98b7055ffc145f186d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:56:16.051949 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-0ae4c2e4-62dd-42ae-9a76-32efbe70bca9 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] 10.222.0.20 "GET /compute/v2.1/servers/4c0c4bb6-269f-46bc-b460-7d0299277753" status: 200 len: 1808 microversion: 2.20 time: 0.165000 Jul 06 13:56:16.052503 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 533/1058] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 6 13:56:15 2022] GET /compute/v2.1/servers/4c0c4bb6-269f-46bc-b460-7d0299277753 => generated 1808 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 06 13:56:17.070929 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-a289f4ba-84fb-4c36-9683-cfac7179c898 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:56:17.071511 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-a289f4ba-84fb-4c36-9683-cfac7179c898 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] [instance: 4c0c4bb6-269f-46bc-b460-7d0299277753] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:56:17.078704 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-a289f4ba-84fb-4c36-9683-cfac7179c898 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:56:17.079307 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-a289f4ba-84fb-4c36-9683-cfac7179c898 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:56:17.080180 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-a289f4ba-84fb-4c36-9683-cfac7179c898 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:56:17.080741 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-a289f4ba-84fb-4c36-9683-cfac7179c898 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:56:17.211107 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-a289f4ba-84fb-4c36-9683-cfac7179c898 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c85251638bc64deca16008b696b11ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3edb8d53184b98b7055ffc145f186d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:56:17.220422 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-a289f4ba-84fb-4c36-9683-cfac7179c898 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c85251638bc64deca16008b696b11ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3edb8d53184b98b7055ffc145f186d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:56:17.221935 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-a289f4ba-84fb-4c36-9683-cfac7179c898 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c85251638bc64deca16008b696b11ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3edb8d53184b98b7055ffc145f186d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:56:17.223069 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-a289f4ba-84fb-4c36-9683-cfac7179c898 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] 10.222.0.20 "GET /compute/v2.1/servers/4c0c4bb6-269f-46bc-b460-7d0299277753" status: 200 len: 1808 microversion: 2.20 time: 0.156033 Jul 06 13:56:17.223615 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 526/1059] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 6 13:56:17 2022] GET /compute/v2.1/servers/4c0c4bb6-269f-46bc-b460-7d0299277753 => generated 1808 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 06 13:56:18.242386 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-51768841-b2d3-48da-bd84-7d0a1935c395 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Calling method '>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:56:18.243008 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-51768841-b2d3-48da-bd84-7d0a1935c395 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] [instance: 4c0c4bb6-269f-46bc-b460-7d0299277753] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:56:18.249605 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-51768841-b2d3-48da-bd84-7d0a1935c395 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:56:18.250072 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-51768841-b2d3-48da-bd84-7d0a1935c395 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:56:18.250830 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-51768841-b2d3-48da-bd84-7d0a1935c395 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:56:18.251304 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-51768841-b2d3-48da-bd84-7d0a1935c395 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:56:18.390525 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-51768841-b2d3-48da-bd84-7d0a1935c395 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c85251638bc64deca16008b696b11ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3edb8d53184b98b7055ffc145f186d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:56:18.398985 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-51768841-b2d3-48da-bd84-7d0a1935c395 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c85251638bc64deca16008b696b11ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3edb8d53184b98b7055ffc145f186d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:56:18.400513 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-51768841-b2d3-48da-bd84-7d0a1935c395 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c85251638bc64deca16008b696b11ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3edb8d53184b98b7055ffc145f186d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:56:18.401716 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-51768841-b2d3-48da-bd84-7d0a1935c395 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] 10.222.0.20 "GET /compute/v2.1/servers/4c0c4bb6-269f-46bc-b460-7d0299277753" status: 200 len: 1808 microversion: 2.20 time: 0.163300 Jul 06 13:56:18.402343 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 534/1060] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 6 13:56:18 2022] GET /compute/v2.1/servers/4c0c4bb6-269f-46bc-b460-7d0299277753 => generated 1808 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 06 13:56:19.423375 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-43decfc2-66fc-44e8-aabf-2db160ec14c7 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:56:19.423978 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-43decfc2-66fc-44e8-aabf-2db160ec14c7 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] [instance: 4c0c4bb6-269f-46bc-b460-7d0299277753] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:56:19.430775 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-43decfc2-66fc-44e8-aabf-2db160ec14c7 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:56:19.431224 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-43decfc2-66fc-44e8-aabf-2db160ec14c7 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:56:19.431982 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-43decfc2-66fc-44e8-aabf-2db160ec14c7 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:56:19.432416 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-43decfc2-66fc-44e8-aabf-2db160ec14c7 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:56:19.565411 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-43decfc2-66fc-44e8-aabf-2db160ec14c7 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c85251638bc64deca16008b696b11ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3edb8d53184b98b7055ffc145f186d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:56:19.573739 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-43decfc2-66fc-44e8-aabf-2db160ec14c7 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c85251638bc64deca16008b696b11ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3edb8d53184b98b7055ffc145f186d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:56:19.575941 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-43decfc2-66fc-44e8-aabf-2db160ec14c7 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c85251638bc64deca16008b696b11ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3edb8d53184b98b7055ffc145f186d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:56:19.577105 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-43decfc2-66fc-44e8-aabf-2db160ec14c7 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] 10.222.0.20 "GET /compute/v2.1/servers/4c0c4bb6-269f-46bc-b460-7d0299277753" status: 200 len: 1808 microversion: 2.20 time: 0.157672 Jul 06 13:56:19.577654 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 527/1061] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 6 13:56:19 2022] GET /compute/v2.1/servers/4c0c4bb6-269f-46bc-b460-7d0299277753 => generated 1808 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 06 13:56:20.595638 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-cc067eb7-2b92-432b-82fb-4e1f7e255267 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Calling method '>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:56:20.596179 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-cc067eb7-2b92-432b-82fb-4e1f7e255267 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] [instance: 4c0c4bb6-269f-46bc-b460-7d0299277753] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:56:20.602626 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-cc067eb7-2b92-432b-82fb-4e1f7e255267 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:56:20.603073 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-cc067eb7-2b92-432b-82fb-4e1f7e255267 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:56:20.603830 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-cc067eb7-2b92-432b-82fb-4e1f7e255267 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:56:20.604265 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-cc067eb7-2b92-432b-82fb-4e1f7e255267 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:56:20.740374 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-cc067eb7-2b92-432b-82fb-4e1f7e255267 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c85251638bc64deca16008b696b11ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3edb8d53184b98b7055ffc145f186d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:56:20.749439 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-cc067eb7-2b92-432b-82fb-4e1f7e255267 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c85251638bc64deca16008b696b11ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3edb8d53184b98b7055ffc145f186d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:56:20.750941 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-cc067eb7-2b92-432b-82fb-4e1f7e255267 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c85251638bc64deca16008b696b11ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3edb8d53184b98b7055ffc145f186d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:56:20.752091 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-cc067eb7-2b92-432b-82fb-4e1f7e255267 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] 10.222.0.20 "GET /compute/v2.1/servers/4c0c4bb6-269f-46bc-b460-7d0299277753" status: 200 len: 1808 microversion: 2.20 time: 0.160423 Jul 06 13:56:20.752640 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 535/1062] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 6 13:56:20 2022] GET /compute/v2.1/servers/4c0c4bb6-269f-46bc-b460-7d0299277753 => generated 1808 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 06 13:56:21.770485 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-182fd76c-6b32-440f-8453-9716eb8e913f tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:56:21.771099 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-182fd76c-6b32-440f-8453-9716eb8e913f tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] [instance: 4c0c4bb6-269f-46bc-b460-7d0299277753] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:56:21.778123 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-182fd76c-6b32-440f-8453-9716eb8e913f tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:56:21.778577 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-182fd76c-6b32-440f-8453-9716eb8e913f tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:56:21.779336 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-182fd76c-6b32-440f-8453-9716eb8e913f tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:56:21.779768 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-182fd76c-6b32-440f-8453-9716eb8e913f tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:56:21.909901 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-182fd76c-6b32-440f-8453-9716eb8e913f tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c85251638bc64deca16008b696b11ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3edb8d53184b98b7055ffc145f186d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:56:21.919305 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-182fd76c-6b32-440f-8453-9716eb8e913f tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c85251638bc64deca16008b696b11ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3edb8d53184b98b7055ffc145f186d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:56:21.920816 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-182fd76c-6b32-440f-8453-9716eb8e913f tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c85251638bc64deca16008b696b11ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3edb8d53184b98b7055ffc145f186d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:56:21.921997 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-182fd76c-6b32-440f-8453-9716eb8e913f tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] 10.222.0.20 "GET /compute/v2.1/servers/4c0c4bb6-269f-46bc-b460-7d0299277753" status: 200 len: 1808 microversion: 2.20 time: 0.155400 Jul 06 13:56:21.922556 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 528/1063] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 6 13:56:21 2022] GET /compute/v2.1/servers/4c0c4bb6-269f-46bc-b460-7d0299277753 => generated 1808 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 06 13:56:22.940860 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-c7555660-0abe-4a6b-83b2-da0d4a84e327 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Calling method '>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:56:22.941507 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-c7555660-0abe-4a6b-83b2-da0d4a84e327 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] [instance: 4c0c4bb6-269f-46bc-b460-7d0299277753] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:56:22.948051 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-c7555660-0abe-4a6b-83b2-da0d4a84e327 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:56:22.948498 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-c7555660-0abe-4a6b-83b2-da0d4a84e327 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:56:22.949306 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-c7555660-0abe-4a6b-83b2-da0d4a84e327 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:56:22.949740 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-c7555660-0abe-4a6b-83b2-da0d4a84e327 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:56:23.081834 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-c7555660-0abe-4a6b-83b2-da0d4a84e327 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c85251638bc64deca16008b696b11ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3edb8d53184b98b7055ffc145f186d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:56:23.090662 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-c7555660-0abe-4a6b-83b2-da0d4a84e327 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c85251638bc64deca16008b696b11ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3edb8d53184b98b7055ffc145f186d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:56:23.092227 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-c7555660-0abe-4a6b-83b2-da0d4a84e327 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c85251638bc64deca16008b696b11ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3edb8d53184b98b7055ffc145f186d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:56:23.093439 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-c7555660-0abe-4a6b-83b2-da0d4a84e327 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] 10.222.0.20 "GET /compute/v2.1/servers/4c0c4bb6-269f-46bc-b460-7d0299277753" status: 200 len: 1808 microversion: 2.20 time: 0.156522 Jul 06 13:56:23.093993 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 536/1064] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 6 13:56:22 2022] GET /compute/v2.1/servers/4c0c4bb6-269f-46bc-b460-7d0299277753 => generated 1808 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 06 13:56:24.112929 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-dccd39c4-0a72-46ba-af42-47dcda2d711c tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:56:24.113673 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-dccd39c4-0a72-46ba-af42-47dcda2d711c tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] [instance: 4c0c4bb6-269f-46bc-b460-7d0299277753] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:56:24.120994 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-dccd39c4-0a72-46ba-af42-47dcda2d711c tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:56:24.127597 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-dccd39c4-0a72-46ba-af42-47dcda2d711c tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:56:24.128767 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-dccd39c4-0a72-46ba-af42-47dcda2d711c tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:56:24.129522 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-dccd39c4-0a72-46ba-af42-47dcda2d711c tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:56:24.284455 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-dccd39c4-0a72-46ba-af42-47dcda2d711c tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c85251638bc64deca16008b696b11ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3edb8d53184b98b7055ffc145f186d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:56:24.294415 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-dccd39c4-0a72-46ba-af42-47dcda2d711c tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c85251638bc64deca16008b696b11ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3edb8d53184b98b7055ffc145f186d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:56:24.295792 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-dccd39c4-0a72-46ba-af42-47dcda2d711c tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c85251638bc64deca16008b696b11ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3edb8d53184b98b7055ffc145f186d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:56:24.297154 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-dccd39c4-0a72-46ba-af42-47dcda2d711c tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] 10.222.0.20 "GET /compute/v2.1/servers/4c0c4bb6-269f-46bc-b460-7d0299277753" status: 200 len: 1808 microversion: 2.20 time: 0.188977 Jul 06 13:56:24.298709 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 529/1065] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 6 13:56:24 2022] GET /compute/v2.1/servers/4c0c4bb6-269f-46bc-b460-7d0299277753 => generated 1808 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 06 13:56:25.323548 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-dc7763aa-9058-4ca4-a71d-75c6accc2a20 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Calling method '>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:56:25.324674 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-dc7763aa-9058-4ca4-a71d-75c6accc2a20 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] [instance: 4c0c4bb6-269f-46bc-b460-7d0299277753] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:56:25.330942 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-dc7763aa-9058-4ca4-a71d-75c6accc2a20 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:56:25.331397 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-dc7763aa-9058-4ca4-a71d-75c6accc2a20 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:56:25.332164 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-dc7763aa-9058-4ca4-a71d-75c6accc2a20 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:56:25.332609 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-dc7763aa-9058-4ca4-a71d-75c6accc2a20 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:56:25.460426 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-dc7763aa-9058-4ca4-a71d-75c6accc2a20 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c85251638bc64deca16008b696b11ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3edb8d53184b98b7055ffc145f186d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:56:25.468873 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-dc7763aa-9058-4ca4-a71d-75c6accc2a20 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c85251638bc64deca16008b696b11ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3edb8d53184b98b7055ffc145f186d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:56:25.470421 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-dc7763aa-9058-4ca4-a71d-75c6accc2a20 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c85251638bc64deca16008b696b11ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3edb8d53184b98b7055ffc145f186d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:56:25.471580 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-dc7763aa-9058-4ca4-a71d-75c6accc2a20 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] 10.222.0.20 "GET /compute/v2.1/servers/4c0c4bb6-269f-46bc-b460-7d0299277753" status: 200 len: 1795 microversion: 2.20 time: 0.152076 Jul 06 13:56:25.472139 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 537/1066] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 6 13:56:25 2022] GET /compute/v2.1/servers/4c0c4bb6-269f-46bc-b460-7d0299277753 => generated 1795 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 06 13:56:30.975645 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-070347f5-099b-4850-9c37-5f50589ea011 tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-2049441039", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1950493681", "security_groups": [{"name": "tempest-secgroup-smoke-113773701"}], "block_device_mapping_v2": [{"uuid": "a8958b5e-f654-4ac5-9b7f-7970dbee2500", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "6522e807-4f7f-4722-945c-07724b4eff64"}]}} {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 06 13:56:30.988309 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG dbcounter [-] [124367] Writing DB stats nova_api:SELECT=24 {{(pid=124367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:56:31.105730 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.network.neutron [None req-070347f5-099b-4850-9c37-5f50589ea011 tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] validate_networks() for [('6522e807-4f7f-4722-945c-07724b4eff64', None, None, None, None, None)] {{(pid=124367) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 06 13:56:31.501760 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.virt.hardware [None req-070347f5-099b-4850-9c37-5f50589ea011 tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Flavor limits 0:0:0 {{(pid=124367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 06 13:56:31.502166 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.virt.hardware [None req-070347f5-099b-4850-9c37-5f50589ea011 tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Image limits 0:0:0 {{(pid=124367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 06 13:56:31.502644 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.virt.hardware [None req-070347f5-099b-4850-9c37-5f50589ea011 tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Flavor pref 0:0:0 {{(pid=124367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 06 13:56:31.503050 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.virt.hardware [None req-070347f5-099b-4850-9c37-5f50589ea011 tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Image pref 0:0:0 {{(pid=124367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 06 13:56:31.503495 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.virt.hardware [None req-070347f5-099b-4850-9c37-5f50589ea011 tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 06 13:56:31.513393 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-070347f5-099b-4850-9c37-5f50589ea011 tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:56:31.513840 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-070347f5-099b-4850-9c37-5f50589ea011 tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:56:31.514754 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-070347f5-099b-4850-9c37-5f50589ea011 tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:56:31.515196 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-070347f5-099b-4850-9c37-5f50589ea011 tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:56:31.533500 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.quota [None req-070347f5-099b-4850-9c37-5f50589ea011 tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Getting quotas for project 7bf864bb1764452e8e3a6f0d5929da9f. Resources: {'instances', 'cores', 'ram'} {{(pid=124367) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 06 13:56:31.537918 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.quota [None req-070347f5-099b-4850-9c37-5f50589ea011 tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Getting quotas for user 32a8191b1c184c75b428579ace2da61c and project 7bf864bb1764452e8e3a6f0d5929da9f. Resources: {'instances', 'cores', 'ram'} {{(pid=124367) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 06 13:56:31.610017 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-070347f5-099b-4850-9c37-5f50589ea011 tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Going to run 1 instances... {{(pid=124367) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 06 13:56:31.612210 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-070347f5-099b-4850-9c37-5f50589ea011 tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] [instance: 74abce3a-f884-4edd-906c-b7ea211c3b5a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='a8958b5e-f654-4ac5-9b7f-7970dbee2500',volume_size=None,volume_type=None)] {{(pid=124367) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 06 13:56:31.749859 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-070347f5-099b-4850-9c37-5f50589ea011 tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.778069 Jul 06 13:56:31.750725 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 530/1067] 10.222.0.20 () {60 vars in 1146 bytes} [Wed Jul 6 13:56:30 2022] POST /compute/v2.1/servers => generated 405 bytes in 780 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 06 13:56:31.760652 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-af690e25-e33d-493a-91c3-a16eea5bbc52 tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Calling method '>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:56:31.761729 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-af690e25-e33d-493a-91c3-a16eea5bbc52 tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] [instance: 74abce3a-f884-4edd-906c-b7ea211c3b5a] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:56:31.765318 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG dbcounter [-] [124368] Writing DB stats nova_api:SELECT=24 {{(pid=124368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:56:32.087388 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-af690e25-e33d-493a-91c3-a16eea5bbc52 tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32a8191b1c184c75b428579ace2da61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bf864bb1764452e8e3a6f0d5929da9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:56:32.095718 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-af690e25-e33d-493a-91c3-a16eea5bbc52 tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] 10.222.0.20 "GET /compute/v2.1/servers/74abce3a-f884-4edd-906c-b7ea211c3b5a" status: 200 len: 1095 microversion: 2.1 time: 0.337840 Jul 06 13:56:32.096299 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 538/1068] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:56:31 2022] GET /compute/v2.1/servers/74abce3a-f884-4edd-906c-b7ea211c3b5a => generated 1095 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:56:33.118737 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-411d68b7-e6e9-4a49-8644-3b2aa5428f95 tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:56:33.120624 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-411d68b7-e6e9-4a49-8644-3b2aa5428f95 tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] [instance: 74abce3a-f884-4edd-906c-b7ea211c3b5a] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:56:33.140826 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-411d68b7-e6e9-4a49-8644-3b2aa5428f95 tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:56:33.143796 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-411d68b7-e6e9-4a49-8644-3b2aa5428f95 tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:56:33.144609 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-411d68b7-e6e9-4a49-8644-3b2aa5428f95 tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:56:33.145080 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-411d68b7-e6e9-4a49-8644-3b2aa5428f95 tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:56:33.225602 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-411d68b7-e6e9-4a49-8644-3b2aa5428f95 tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32a8191b1c184c75b428579ace2da61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bf864bb1764452e8e3a6f0d5929da9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:56:33.233694 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-411d68b7-e6e9-4a49-8644-3b2aa5428f95 tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] 10.222.0.20 "GET /compute/v2.1/servers/74abce3a-f884-4edd-906c-b7ea211c3b5a" status: 200 len: 1211 microversion: 2.1 time: 0.125287 Jul 06 13:56:33.234342 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 531/1069] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:56:33 2022] GET /compute/v2.1/servers/74abce3a-f884-4edd-906c-b7ea211c3b5a => generated 1211 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 06 13:56:34.252687 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-ac9792e8-a968-42d6-9a54-ddea280c9fef tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Calling method '>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:56:34.253415 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-ac9792e8-a968-42d6-9a54-ddea280c9fef tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] [instance: 74abce3a-f884-4edd-906c-b7ea211c3b5a] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:56:34.260545 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-ac9792e8-a968-42d6-9a54-ddea280c9fef tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:56:34.261249 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-ac9792e8-a968-42d6-9a54-ddea280c9fef tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:56:34.262822 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-ac9792e8-a968-42d6-9a54-ddea280c9fef tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:56:34.264708 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-ac9792e8-a968-42d6-9a54-ddea280c9fef tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:56:34.270545 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG dbcounter [-] [124368] Writing DB stats nova_cell1:SELECT=65 {{(pid=124368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:56:34.414060 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-ac9792e8-a968-42d6-9a54-ddea280c9fef tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32a8191b1c184c75b428579ace2da61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bf864bb1764452e8e3a6f0d5929da9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:56:34.422281 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-ac9792e8-a968-42d6-9a54-ddea280c9fef tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] 10.222.0.20 "GET /compute/v2.1/servers/74abce3a-f884-4edd-906c-b7ea211c3b5a" status: 200 len: 1278 microversion: 2.1 time: 0.174587 Jul 06 13:56:34.423007 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 539/1070] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:56:34 2022] GET /compute/v2.1/servers/74abce3a-f884-4edd-906c-b7ea211c3b5a => generated 1278 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:56:34.660032 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [req-b1ae0de1-829a-4906-9df1-9ba0a373fe01 req-7cdc1fb9-ff05-4787-96e4-29858fa5e472 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "74abce3a-f884-4edd-906c-b7ea211c3b5a", "tag": "424688a9-34bc-4310-80b7-d8344dc05c86"}]} {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 06 13:56:34.668279 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [req-b1ae0de1-829a-4906-9df1-9ba0a373fe01 req-7cdc1fb9-ff05-4787-96e4-29858fa5e472 service nova] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:56:34.668722 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [req-b1ae0de1-829a-4906-9df1-9ba0a373fe01 req-7cdc1fb9-ff05-4787-96e4-29858fa5e472 service nova] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:56:34.672371 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG dbcounter [-] [124367] Writing DB stats nova_cell1:SELECT=69 {{(pid=124367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:56:34.683105 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.compute.server_external_events [req-b1ae0de1-829a-4906-9df1-9ba0a373fe01 req-7cdc1fb9-ff05-4787-96e4-29858fa5e472 service nova] Creating event network-changed:424688a9-34bc-4310-80b7-d8344dc05c86 for instance 74abce3a-f884-4edd-906c-b7ea211c3b5a on hv-cinder-81914 Jul 06 13:56:34.689566 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [req-b1ae0de1-829a-4906-9df1-9ba0a373fe01 req-7cdc1fb9-ff05-4787-96e4-29858fa5e472 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.190960 Jul 06 13:56:34.690162 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 532/1071] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 6 13:56:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 06 13:56:35.439780 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-7f2f2f06-3edb-4f7b-8da0-8b1d53850990 tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Calling method '>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:56:35.440392 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-7f2f2f06-3edb-4f7b-8da0-8b1d53850990 tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] [instance: 74abce3a-f884-4edd-906c-b7ea211c3b5a] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:56:35.446900 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-7f2f2f06-3edb-4f7b-8da0-8b1d53850990 tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:56:35.447354 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-7f2f2f06-3edb-4f7b-8da0-8b1d53850990 tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:56:35.448116 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-7f2f2f06-3edb-4f7b-8da0-8b1d53850990 tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:56:35.448555 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-7f2f2f06-3edb-4f7b-8da0-8b1d53850990 tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:56:35.591712 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-7f2f2f06-3edb-4f7b-8da0-8b1d53850990 tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32a8191b1c184c75b428579ace2da61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bf864bb1764452e8e3a6f0d5929da9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:56:35.599216 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-7f2f2f06-3edb-4f7b-8da0-8b1d53850990 tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] 10.222.0.20 "GET /compute/v2.1/servers/74abce3a-f884-4edd-906c-b7ea211c3b5a" status: 200 len: 1266 microversion: 2.1 time: 0.163946 Jul 06 13:56:35.599794 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 540/1072] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:56:35 2022] GET /compute/v2.1/servers/74abce3a-f884-4edd-906c-b7ea211c3b5a => generated 1266 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:56:36.616619 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-418e17a6-36fd-4e37-83ab-aa0197dd6597 tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:56:36.617341 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-418e17a6-36fd-4e37-83ab-aa0197dd6597 tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] [instance: 74abce3a-f884-4edd-906c-b7ea211c3b5a] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:56:36.623940 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-418e17a6-36fd-4e37-83ab-aa0197dd6597 tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:56:36.624396 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-418e17a6-36fd-4e37-83ab-aa0197dd6597 tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:56:36.625204 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-418e17a6-36fd-4e37-83ab-aa0197dd6597 tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:56:36.625644 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-418e17a6-36fd-4e37-83ab-aa0197dd6597 tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:56:36.763668 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-418e17a6-36fd-4e37-83ab-aa0197dd6597 tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32a8191b1c184c75b428579ace2da61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bf864bb1764452e8e3a6f0d5929da9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:56:36.772265 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-418e17a6-36fd-4e37-83ab-aa0197dd6597 tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] 10.222.0.20 "GET /compute/v2.1/servers/74abce3a-f884-4edd-906c-b7ea211c3b5a" status: 200 len: 1266 microversion: 2.1 time: 0.160275 Jul 06 13:56:36.772828 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 533/1073] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:56:36 2022] GET /compute/v2.1/servers/74abce3a-f884-4edd-906c-b7ea211c3b5a => generated 1266 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:56:37.788541 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-9e4a2fc3-3cf6-41f8-bc79-9d842bd140fb tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Calling method '>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:56:37.789462 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-9e4a2fc3-3cf6-41f8-bc79-9d842bd140fb tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] [instance: 74abce3a-f884-4edd-906c-b7ea211c3b5a] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:56:37.797072 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-9e4a2fc3-3cf6-41f8-bc79-9d842bd140fb tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:56:37.798146 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-9e4a2fc3-3cf6-41f8-bc79-9d842bd140fb tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:56:37.798999 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-9e4a2fc3-3cf6-41f8-bc79-9d842bd140fb tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:56:37.799540 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-9e4a2fc3-3cf6-41f8-bc79-9d842bd140fb tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:56:37.939577 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-9e4a2fc3-3cf6-41f8-bc79-9d842bd140fb tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32a8191b1c184c75b428579ace2da61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bf864bb1764452e8e3a6f0d5929da9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:56:37.947643 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-9e4a2fc3-3cf6-41f8-bc79-9d842bd140fb tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] 10.222.0.20 "GET /compute/v2.1/servers/74abce3a-f884-4edd-906c-b7ea211c3b5a" status: 200 len: 1266 microversion: 2.1 time: 0.162898 Jul 06 13:56:37.948222 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 541/1074] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:56:37 2022] GET /compute/v2.1/servers/74abce3a-f884-4edd-906c-b7ea211c3b5a => generated 1266 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:56:38.965322 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-50154c2e-9386-4191-a0cd-15ef828ce5c0 tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:56:38.966069 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-50154c2e-9386-4191-a0cd-15ef828ce5c0 tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] [instance: 74abce3a-f884-4edd-906c-b7ea211c3b5a] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:56:38.972978 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-50154c2e-9386-4191-a0cd-15ef828ce5c0 tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:56:38.973471 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-50154c2e-9386-4191-a0cd-15ef828ce5c0 tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:56:38.974488 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-50154c2e-9386-4191-a0cd-15ef828ce5c0 tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:56:38.974932 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-50154c2e-9386-4191-a0cd-15ef828ce5c0 tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:56:39.383611 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-50154c2e-9386-4191-a0cd-15ef828ce5c0 tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32a8191b1c184c75b428579ace2da61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bf864bb1764452e8e3a6f0d5929da9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:56:39.391992 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-50154c2e-9386-4191-a0cd-15ef828ce5c0 tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] 10.222.0.20 "GET /compute/v2.1/servers/74abce3a-f884-4edd-906c-b7ea211c3b5a" status: 200 len: 1266 microversion: 2.1 time: 0.430566 Jul 06 13:56:39.392534 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 534/1075] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:56:38 2022] GET /compute/v2.1/servers/74abce3a-f884-4edd-906c-b7ea211c3b5a => generated 1266 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:56:40.409598 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-d2e7903f-11f3-455e-b9be-d987bfa73918 tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Calling method '>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:56:40.410212 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-d2e7903f-11f3-455e-b9be-d987bfa73918 tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] [instance: 74abce3a-f884-4edd-906c-b7ea211c3b5a] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:56:40.416645 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-d2e7903f-11f3-455e-b9be-d987bfa73918 tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:56:40.417130 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-d2e7903f-11f3-455e-b9be-d987bfa73918 tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:56:40.417898 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-d2e7903f-11f3-455e-b9be-d987bfa73918 tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:56:40.418386 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-d2e7903f-11f3-455e-b9be-d987bfa73918 tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:56:40.566737 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-d2e7903f-11f3-455e-b9be-d987bfa73918 tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32a8191b1c184c75b428579ace2da61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bf864bb1764452e8e3a6f0d5929da9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:56:40.578547 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-d2e7903f-11f3-455e-b9be-d987bfa73918 tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] 10.222.0.20 "GET /compute/v2.1/servers/74abce3a-f884-4edd-906c-b7ea211c3b5a" status: 200 len: 1266 microversion: 2.1 time: 0.171562 Jul 06 13:56:40.579120 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 542/1076] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:56:40 2022] GET /compute/v2.1/servers/74abce3a-f884-4edd-906c-b7ea211c3b5a => generated 1266 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:56:41.595293 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-d0fabdcb-9e22-44d0-b2ac-c7b2afcac708 tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:56:41.595892 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-d0fabdcb-9e22-44d0-b2ac-c7b2afcac708 tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] [instance: 74abce3a-f884-4edd-906c-b7ea211c3b5a] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:56:41.598306 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG dbcounter [-] [124367] Writing DB stats nova_cell0:SELECT=2 {{(pid=124367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:56:41.599151 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG dbcounter [-] [124367] Writing DB stats nova_cell0:SELECT=6 {{(pid=124367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:56:41.604641 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-d0fabdcb-9e22-44d0-b2ac-c7b2afcac708 tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:56:41.605118 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-d0fabdcb-9e22-44d0-b2ac-c7b2afcac708 tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:56:41.605871 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-d0fabdcb-9e22-44d0-b2ac-c7b2afcac708 tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:56:41.606299 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-d0fabdcb-9e22-44d0-b2ac-c7b2afcac708 tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:56:41.744462 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-d0fabdcb-9e22-44d0-b2ac-c7b2afcac708 tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32a8191b1c184c75b428579ace2da61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bf864bb1764452e8e3a6f0d5929da9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:56:41.752788 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-d0fabdcb-9e22-44d0-b2ac-c7b2afcac708 tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] 10.222.0.20 "GET /compute/v2.1/servers/74abce3a-f884-4edd-906c-b7ea211c3b5a" status: 200 len: 1266 microversion: 2.1 time: 0.161417 Jul 06 13:56:41.753392 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 535/1077] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:56:41 2022] GET /compute/v2.1/servers/74abce3a-f884-4edd-906c-b7ea211c3b5a => generated 1266 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:56:42.771342 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-8ea23c5c-46b0-44b7-b091-c3b4ffa62572 tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Calling method '>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:56:42.771967 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-8ea23c5c-46b0-44b7-b091-c3b4ffa62572 tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] [instance: 74abce3a-f884-4edd-906c-b7ea211c3b5a] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:56:42.774259 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG dbcounter [-] [124368] Writing DB stats nova_cell0:SELECT=2 {{(pid=124368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:56:42.780378 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-8ea23c5c-46b0-44b7-b091-c3b4ffa62572 tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:56:42.780853 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-8ea23c5c-46b0-44b7-b091-c3b4ffa62572 tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:56:42.781657 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-8ea23c5c-46b0-44b7-b091-c3b4ffa62572 tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:56:42.782097 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-8ea23c5c-46b0-44b7-b091-c3b4ffa62572 tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:56:42.923623 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-8ea23c5c-46b0-44b7-b091-c3b4ffa62572 tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32a8191b1c184c75b428579ace2da61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bf864bb1764452e8e3a6f0d5929da9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:56:42.928558 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-8ea23c5c-46b0-44b7-b091-c3b4ffa62572 tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] 10.222.0.20 "GET /compute/v2.1/servers/74abce3a-f884-4edd-906c-b7ea211c3b5a" status: 200 len: 1266 microversion: 2.1 time: 0.162179 Jul 06 13:56:42.929286 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 543/1078] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:56:42 2022] GET /compute/v2.1/servers/74abce3a-f884-4edd-906c-b7ea211c3b5a => generated 1266 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:56:43.944704 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-e474fac9-c931-458a-813d-25bcf73e35c7 tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:56:43.945355 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-e474fac9-c931-458a-813d-25bcf73e35c7 tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] [instance: 74abce3a-f884-4edd-906c-b7ea211c3b5a] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:56:43.952322 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-e474fac9-c931-458a-813d-25bcf73e35c7 tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:56:43.952767 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-e474fac9-c931-458a-813d-25bcf73e35c7 tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:56:43.953653 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-e474fac9-c931-458a-813d-25bcf73e35c7 tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:56:43.954087 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-e474fac9-c931-458a-813d-25bcf73e35c7 tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:56:44.250801 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-e474fac9-c931-458a-813d-25bcf73e35c7 tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32a8191b1c184c75b428579ace2da61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bf864bb1764452e8e3a6f0d5929da9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:56:44.258334 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-e474fac9-c931-458a-813d-25bcf73e35c7 tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] 10.222.0.20 "GET /compute/v2.1/servers/74abce3a-f884-4edd-906c-b7ea211c3b5a" status: 200 len: 1266 microversion: 2.1 time: 0.317433 Jul 06 13:56:44.258900 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 536/1079] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:56:43 2022] GET /compute/v2.1/servers/74abce3a-f884-4edd-906c-b7ea211c3b5a => generated 1266 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:56:44.633031 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-eb5e1354-fb55-45cf-b0aa-59ccdb388682 tempest-VolumesNegativeTest-700443590 tempest-VolumesNegativeTest-700443590-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-628523585", "imageRef": "b08481d9-1e39-41e8-97bd-b05a9c35b377", "flavorRef": "452"}} {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 06 13:56:44.685527 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.network.neutron [None req-eb5e1354-fb55-45cf-b0aa-59ccdb388682 tempest-VolumesNegativeTest-700443590 tempest-VolumesNegativeTest-700443590-project] validate_networks() for None {{(pid=124368) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 06 13:56:44.964633 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.virt.hardware [None req-eb5e1354-fb55-45cf-b0aa-59ccdb388682 tempest-VolumesNegativeTest-700443590 tempest-VolumesNegativeTest-700443590-project] Flavor limits 0:0:0 {{(pid=124368) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 06 13:56:44.965099 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.virt.hardware [None req-eb5e1354-fb55-45cf-b0aa-59ccdb388682 tempest-VolumesNegativeTest-700443590 tempest-VolumesNegativeTest-700443590-project] Image limits 0:0:0 {{(pid=124368) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 06 13:56:44.965631 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.virt.hardware [None req-eb5e1354-fb55-45cf-b0aa-59ccdb388682 tempest-VolumesNegativeTest-700443590 tempest-VolumesNegativeTest-700443590-project] Flavor pref 0:0:0 {{(pid=124368) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 06 13:56:44.966048 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.virt.hardware [None req-eb5e1354-fb55-45cf-b0aa-59ccdb388682 tempest-VolumesNegativeTest-700443590 tempest-VolumesNegativeTest-700443590-project] Image pref 0:0:0 {{(pid=124368) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 06 13:56:44.966466 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.virt.hardware [None req-eb5e1354-fb55-45cf-b0aa-59ccdb388682 tempest-VolumesNegativeTest-700443590 tempest-VolumesNegativeTest-700443590-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124368) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 06 13:56:44.975838 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-eb5e1354-fb55-45cf-b0aa-59ccdb388682 tempest-VolumesNegativeTest-700443590 tempest-VolumesNegativeTest-700443590-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:56:44.976296 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-eb5e1354-fb55-45cf-b0aa-59ccdb388682 tempest-VolumesNegativeTest-700443590 tempest-VolumesNegativeTest-700443590-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:56:44.977166 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-eb5e1354-fb55-45cf-b0aa-59ccdb388682 tempest-VolumesNegativeTest-700443590 tempest-VolumesNegativeTest-700443590-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:56:44.977614 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-eb5e1354-fb55-45cf-b0aa-59ccdb388682 tempest-VolumesNegativeTest-700443590 tempest-VolumesNegativeTest-700443590-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:56:44.994623 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.quota [None req-eb5e1354-fb55-45cf-b0aa-59ccdb388682 tempest-VolumesNegativeTest-700443590 tempest-VolumesNegativeTest-700443590-project] Getting quotas for project c8ca80cbead344739f19271930c14d3b. Resources: {'instances', 'cores', 'ram'} {{(pid=124368) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 06 13:56:44.998575 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.quota [None req-eb5e1354-fb55-45cf-b0aa-59ccdb388682 tempest-VolumesNegativeTest-700443590 tempest-VolumesNegativeTest-700443590-project] Getting quotas for user f44d7a12a15c4d54b32e0e6e045be419 and project c8ca80cbead344739f19271930c14d3b. Resources: {'instances', 'cores', 'ram'} {{(pid=124368) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 06 13:56:45.009431 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-eb5e1354-fb55-45cf-b0aa-59ccdb388682 tempest-VolumesNegativeTest-700443590 tempest-VolumesNegativeTest-700443590-project] Going to run 1 instances... {{(pid=124368) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 06 13:56:45.011654 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-eb5e1354-fb55-45cf-b0aa-59ccdb388682 tempest-VolumesNegativeTest-700443590 tempest-VolumesNegativeTest-700443590-project] [instance: b2ca483f-d16b-41a4-97ef-fa182e708ad8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b08481d9-1e39-41e8-97bd-b05a9c35b377',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124368) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 06 13:56:45.054926 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-eb5e1354-fb55-45cf-b0aa-59ccdb388682 tempest-VolumesNegativeTest-700443590 tempest-VolumesNegativeTest-700443590-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.425728 Jul 06 13:56:45.055739 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 544/1080] 10.222.0.20 () {60 vars in 1146 bytes} [Wed Jul 6 13:56:44 2022] POST /compute/v2.1/servers => generated 380 bytes in 427 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 06 13:56:45.065428 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-636de6d5-9622-46fb-a538-746e97645ff6 tempest-VolumesNegativeTest-700443590 tempest-VolumesNegativeTest-700443590-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:56:45.066042 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-636de6d5-9622-46fb-a538-746e97645ff6 tempest-VolumesNegativeTest-700443590 tempest-VolumesNegativeTest-700443590-project] [instance: b2ca483f-d16b-41a4-97ef-fa182e708ad8] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:56:45.118902 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-636de6d5-9622-46fb-a538-746e97645ff6 tempest-VolumesNegativeTest-700443590 tempest-VolumesNegativeTest-700443590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f44d7a12a15c4d54b32e0e6e045be419', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8ca80cbead344739f19271930c14d3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:56:45.128272 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-636de6d5-9622-46fb-a538-746e97645ff6 tempest-VolumesNegativeTest-700443590 tempest-VolumesNegativeTest-700443590-project] 10.222.0.20 "GET /compute/v2.1/servers/b2ca483f-d16b-41a4-97ef-fa182e708ad8" status: 200 len: 1214 microversion: 2.1 time: 0.065412 Jul 06 13:56:45.128944 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 537/1081] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:56:45 2022] GET /compute/v2.1/servers/b2ca483f-d16b-41a4-97ef-fa182e708ad8 => generated 1214 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:56:45.276071 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-605c0a1f-bc28-46b1-ac1f-542deba5b51c tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Calling method '>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:56:45.277575 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-605c0a1f-bc28-46b1-ac1f-542deba5b51c tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] [instance: 74abce3a-f884-4edd-906c-b7ea211c3b5a] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:56:45.287804 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-605c0a1f-bc28-46b1-ac1f-542deba5b51c tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:56:45.288537 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-605c0a1f-bc28-46b1-ac1f-542deba5b51c tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:56:45.289591 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-605c0a1f-bc28-46b1-ac1f-542deba5b51c tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:56:45.290203 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-605c0a1f-bc28-46b1-ac1f-542deba5b51c tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:56:45.454048 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-605c0a1f-bc28-46b1-ac1f-542deba5b51c tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32a8191b1c184c75b428579ace2da61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bf864bb1764452e8e3a6f0d5929da9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:56:45.461974 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-605c0a1f-bc28-46b1-ac1f-542deba5b51c tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] 10.222.0.20 "GET /compute/v2.1/servers/74abce3a-f884-4edd-906c-b7ea211c3b5a" status: 200 len: 1266 microversion: 2.1 time: 0.190213 Jul 06 13:56:45.463253 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 545/1082] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:56:45 2022] GET /compute/v2.1/servers/74abce3a-f884-4edd-906c-b7ea211c3b5a => generated 1266 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:56:46.145602 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-0a899c50-fbf4-4de5-a61c-b5d490c88177 tempest-VolumesNegativeTest-700443590 tempest-VolumesNegativeTest-700443590-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:56:46.146530 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-0a899c50-fbf4-4de5-a61c-b5d490c88177 tempest-VolumesNegativeTest-700443590 tempest-VolumesNegativeTest-700443590-project] [instance: b2ca483f-d16b-41a4-97ef-fa182e708ad8] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:56:46.156397 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-0a899c50-fbf4-4de5-a61c-b5d490c88177 tempest-VolumesNegativeTest-700443590 tempest-VolumesNegativeTest-700443590-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:56:46.157100 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-0a899c50-fbf4-4de5-a61c-b5d490c88177 tempest-VolumesNegativeTest-700443590 tempest-VolumesNegativeTest-700443590-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:56:46.158506 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-0a899c50-fbf4-4de5-a61c-b5d490c88177 tempest-VolumesNegativeTest-700443590 tempest-VolumesNegativeTest-700443590-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:56:46.159397 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-0a899c50-fbf4-4de5-a61c-b5d490c88177 tempest-VolumesNegativeTest-700443590 tempest-VolumesNegativeTest-700443590-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:56:46.279286 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-0a899c50-fbf4-4de5-a61c-b5d490c88177 tempest-VolumesNegativeTest-700443590 tempest-VolumesNegativeTest-700443590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f44d7a12a15c4d54b32e0e6e045be419', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8ca80cbead344739f19271930c14d3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:56:46.291168 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-0a899c50-fbf4-4de5-a61c-b5d490c88177 tempest-VolumesNegativeTest-700443590 tempest-VolumesNegativeTest-700443590-project] 10.222.0.20 "GET /compute/v2.1/servers/b2ca483f-d16b-41a4-97ef-fa182e708ad8" status: 200 len: 1274 microversion: 2.1 time: 0.150065 Jul 06 13:56:46.307454 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 538/1083] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:56:46 2022] GET /compute/v2.1/servers/b2ca483f-d16b-41a4-97ef-fa182e708ad8 => generated 1274 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:56:46.480112 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-f085a6ac-9f52-4c0a-b7ef-23bc5ca521f8 tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Calling method '>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:56:46.480727 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-f085a6ac-9f52-4c0a-b7ef-23bc5ca521f8 tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] [instance: 74abce3a-f884-4edd-906c-b7ea211c3b5a] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:56:46.487707 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-f085a6ac-9f52-4c0a-b7ef-23bc5ca521f8 tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:56:46.488156 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-f085a6ac-9f52-4c0a-b7ef-23bc5ca521f8 tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:56:46.488924 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-f085a6ac-9f52-4c0a-b7ef-23bc5ca521f8 tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:56:46.489416 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-f085a6ac-9f52-4c0a-b7ef-23bc5ca521f8 tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:56:46.628616 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-f085a6ac-9f52-4c0a-b7ef-23bc5ca521f8 tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32a8191b1c184c75b428579ace2da61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bf864bb1764452e8e3a6f0d5929da9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:56:46.637764 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-f085a6ac-9f52-4c0a-b7ef-23bc5ca521f8 tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] 10.222.0.20 "GET /compute/v2.1/servers/74abce3a-f884-4edd-906c-b7ea211c3b5a" status: 200 len: 1266 microversion: 2.1 time: 0.161372 Jul 06 13:56:46.638658 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 546/1084] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:56:46 2022] GET /compute/v2.1/servers/74abce3a-f884-4edd-906c-b7ea211c3b5a => generated 1266 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:56:47.315492 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-76fc58a2-d774-4bb0-92f4-a06f2170a486 tempest-VolumesNegativeTest-700443590 tempest-VolumesNegativeTest-700443590-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:56:47.316735 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-76fc58a2-d774-4bb0-92f4-a06f2170a486 tempest-VolumesNegativeTest-700443590 tempest-VolumesNegativeTest-700443590-project] [instance: b2ca483f-d16b-41a4-97ef-fa182e708ad8] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:56:47.323493 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-76fc58a2-d774-4bb0-92f4-a06f2170a486 tempest-VolumesNegativeTest-700443590 tempest-VolumesNegativeTest-700443590-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:56:47.324144 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-76fc58a2-d774-4bb0-92f4-a06f2170a486 tempest-VolumesNegativeTest-700443590 tempest-VolumesNegativeTest-700443590-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:56:47.325152 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-76fc58a2-d774-4bb0-92f4-a06f2170a486 tempest-VolumesNegativeTest-700443590 tempest-VolumesNegativeTest-700443590-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:56:47.325767 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-76fc58a2-d774-4bb0-92f4-a06f2170a486 tempest-VolumesNegativeTest-700443590 tempest-VolumesNegativeTest-700443590-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:56:47.599277 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-76fc58a2-d774-4bb0-92f4-a06f2170a486 tempest-VolumesNegativeTest-700443590 tempest-VolumesNegativeTest-700443590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f44d7a12a15c4d54b32e0e6e045be419', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8ca80cbead344739f19271930c14d3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:56:47.615997 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-76fc58a2-d774-4bb0-92f4-a06f2170a486 tempest-VolumesNegativeTest-700443590 tempest-VolumesNegativeTest-700443590-project] 10.222.0.20 "GET /compute/v2.1/servers/b2ca483f-d16b-41a4-97ef-fa182e708ad8" status: 200 len: 1314 microversion: 2.1 time: 0.304216 Jul 06 13:56:47.626496 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 539/1085] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:56:47 2022] GET /compute/v2.1/servers/b2ca483f-d16b-41a4-97ef-fa182e708ad8 => generated 1314 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:56:47.656771 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-42ee6997-669c-450a-84c0-19503bd17dd0 tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Calling method '>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:56:47.657424 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-42ee6997-669c-450a-84c0-19503bd17dd0 tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] [instance: 74abce3a-f884-4edd-906c-b7ea211c3b5a] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:56:47.666546 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-42ee6997-669c-450a-84c0-19503bd17dd0 tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:56:47.667011 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-42ee6997-669c-450a-84c0-19503bd17dd0 tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:56:47.668574 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-42ee6997-669c-450a-84c0-19503bd17dd0 tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:56:47.669362 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-42ee6997-669c-450a-84c0-19503bd17dd0 tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:56:47.831222 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-42ee6997-669c-450a-84c0-19503bd17dd0 tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32a8191b1c184c75b428579ace2da61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bf864bb1764452e8e3a6f0d5929da9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:56:47.843114 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-42ee6997-669c-450a-84c0-19503bd17dd0 tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] 10.222.0.20 "GET /compute/v2.1/servers/74abce3a-f884-4edd-906c-b7ea211c3b5a" status: 200 len: 1266 microversion: 2.1 time: 0.192116 Jul 06 13:56:47.844330 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 547/1086] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:56:47 2022] GET /compute/v2.1/servers/74abce3a-f884-4edd-906c-b7ea211c3b5a => generated 1266 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:56:47.906822 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [req-a7d4ee66-93a9-44fd-a2ec-972515c83f26 req-3e3f79f6-806a-4cb8-8807-ac607bb7dd23 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "74abce3a-f884-4edd-906c-b7ea211c3b5a", "name": "network-vif-plugged", "status": "completed", "tag": "424688a9-34bc-4310-80b7-d8344dc05c86"}]} {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 06 13:56:47.918803 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [req-a7d4ee66-93a9-44fd-a2ec-972515c83f26 req-3e3f79f6-806a-4cb8-8807-ac607bb7dd23 service nova] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:56:47.919669 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [req-a7d4ee66-93a9-44fd-a2ec-972515c83f26 req-3e3f79f6-806a-4cb8-8807-ac607bb7dd23 service nova] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:56:47.931544 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.compute.server_external_events [req-a7d4ee66-93a9-44fd-a2ec-972515c83f26 req-3e3f79f6-806a-4cb8-8807-ac607bb7dd23 service nova] Creating event network-vif-plugged:424688a9-34bc-4310-80b7-d8344dc05c86 for instance 74abce3a-f884-4edd-906c-b7ea211c3b5a on hv-cinder-81914 Jul 06 13:56:47.942041 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [req-a7d4ee66-93a9-44fd-a2ec-972515c83f26 req-3e3f79f6-806a-4cb8-8807-ac607bb7dd23 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.240169 Jul 06 13:56:47.943337 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 540/1087] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 6 13:56:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 06 13:56:48.126735 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [req-771ffb32-59e3-485d-b1dd-95001ae87436 req-6ff32ace-b279-4ed3-be3a-4a7df6b11576 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b2ca483f-d16b-41a4-97ef-fa182e708ad8", "tag": "078e0444-c97b-4d66-ba75-3caa6aa99a0e"}]} {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 06 13:56:48.140183 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [req-771ffb32-59e3-485d-b1dd-95001ae87436 req-6ff32ace-b279-4ed3-be3a-4a7df6b11576 service nova] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:56:48.141295 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [req-771ffb32-59e3-485d-b1dd-95001ae87436 req-6ff32ace-b279-4ed3-be3a-4a7df6b11576 service nova] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:56:48.171486 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.compute.server_external_events [req-771ffb32-59e3-485d-b1dd-95001ae87436 req-6ff32ace-b279-4ed3-be3a-4a7df6b11576 service nova] Creating event network-changed:078e0444-c97b-4d66-ba75-3caa6aa99a0e for instance b2ca483f-d16b-41a4-97ef-fa182e708ad8 on hv-cinder-81914 Jul 06 13:56:48.174487 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [req-771ffb32-59e3-485d-b1dd-95001ae87436 req-6ff32ace-b279-4ed3-be3a-4a7df6b11576 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053202 Jul 06 13:56:48.175146 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 548/1088] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 6 13:56:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 06 13:56:48.633683 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-40154db0-3701-4ded-bd93-1ad053c7a0cc tempest-VolumesNegativeTest-700443590 tempest-VolumesNegativeTest-700443590-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:56:48.634374 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-40154db0-3701-4ded-bd93-1ad053c7a0cc tempest-VolumesNegativeTest-700443590 tempest-VolumesNegativeTest-700443590-project] [instance: b2ca483f-d16b-41a4-97ef-fa182e708ad8] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:56:48.642052 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-40154db0-3701-4ded-bd93-1ad053c7a0cc tempest-VolumesNegativeTest-700443590 tempest-VolumesNegativeTest-700443590-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:56:48.642570 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-40154db0-3701-4ded-bd93-1ad053c7a0cc tempest-VolumesNegativeTest-700443590 tempest-VolumesNegativeTest-700443590-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:56:48.643402 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-40154db0-3701-4ded-bd93-1ad053c7a0cc tempest-VolumesNegativeTest-700443590 tempest-VolumesNegativeTest-700443590-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:56:48.643908 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-40154db0-3701-4ded-bd93-1ad053c7a0cc tempest-VolumesNegativeTest-700443590 tempest-VolumesNegativeTest-700443590-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:56:48.771866 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-40154db0-3701-4ded-bd93-1ad053c7a0cc tempest-VolumesNegativeTest-700443590 tempest-VolumesNegativeTest-700443590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f44d7a12a15c4d54b32e0e6e045be419', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8ca80cbead344739f19271930c14d3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:56:48.779145 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-40154db0-3701-4ded-bd93-1ad053c7a0cc tempest-VolumesNegativeTest-700443590 tempest-VolumesNegativeTest-700443590-project] 10.222.0.20 "GET /compute/v2.1/servers/b2ca483f-d16b-41a4-97ef-fa182e708ad8" status: 200 len: 1314 microversion: 2.1 time: 0.149710 Jul 06 13:56:48.779871 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 541/1089] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:56:48 2022] GET /compute/v2.1/servers/b2ca483f-d16b-41a4-97ef-fa182e708ad8 => generated 1314 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:56:48.860549 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-34c9202f-1b92-4fcc-877b-c2dd1e04785f tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Calling method '>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:56:48.861243 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-34c9202f-1b92-4fcc-877b-c2dd1e04785f tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] [instance: 74abce3a-f884-4edd-906c-b7ea211c3b5a] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:56:48.868116 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-34c9202f-1b92-4fcc-877b-c2dd1e04785f tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:56:48.868576 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-34c9202f-1b92-4fcc-877b-c2dd1e04785f tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:56:48.869390 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-34c9202f-1b92-4fcc-877b-c2dd1e04785f tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:56:48.869836 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-34c9202f-1b92-4fcc-877b-c2dd1e04785f tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:56:49.007887 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-34c9202f-1b92-4fcc-877b-c2dd1e04785f tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32a8191b1c184c75b428579ace2da61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bf864bb1764452e8e3a6f0d5929da9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:56:49.015434 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-34c9202f-1b92-4fcc-877b-c2dd1e04785f tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] 10.222.0.20 "GET /compute/v2.1/servers/74abce3a-f884-4edd-906c-b7ea211c3b5a" status: 200 len: 1266 microversion: 2.1 time: 0.159411 Jul 06 13:56:49.016001 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 549/1090] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:56:48 2022] GET /compute/v2.1/servers/74abce3a-f884-4edd-906c-b7ea211c3b5a => generated 1266 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:56:49.796567 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-3e75fc00-282c-40f7-b92a-840dcd5e77ef tempest-VolumesNegativeTest-700443590 tempest-VolumesNegativeTest-700443590-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:56:49.797224 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-3e75fc00-282c-40f7-b92a-840dcd5e77ef tempest-VolumesNegativeTest-700443590 tempest-VolumesNegativeTest-700443590-project] [instance: b2ca483f-d16b-41a4-97ef-fa182e708ad8] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:56:49.804273 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-3e75fc00-282c-40f7-b92a-840dcd5e77ef tempest-VolumesNegativeTest-700443590 tempest-VolumesNegativeTest-700443590-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:56:49.804804 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-3e75fc00-282c-40f7-b92a-840dcd5e77ef tempest-VolumesNegativeTest-700443590 tempest-VolumesNegativeTest-700443590-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:56:49.805702 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-3e75fc00-282c-40f7-b92a-840dcd5e77ef tempest-VolumesNegativeTest-700443590 tempest-VolumesNegativeTest-700443590-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:56:49.806228 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-3e75fc00-282c-40f7-b92a-840dcd5e77ef tempest-VolumesNegativeTest-700443590 tempest-VolumesNegativeTest-700443590-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:56:49.938118 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-3e75fc00-282c-40f7-b92a-840dcd5e77ef tempest-VolumesNegativeTest-700443590 tempest-VolumesNegativeTest-700443590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f44d7a12a15c4d54b32e0e6e045be419', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8ca80cbead344739f19271930c14d3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:56:49.945424 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-3e75fc00-282c-40f7-b92a-840dcd5e77ef tempest-VolumesNegativeTest-700443590 tempest-VolumesNegativeTest-700443590-project] 10.222.0.20 "GET /compute/v2.1/servers/b2ca483f-d16b-41a4-97ef-fa182e708ad8" status: 200 len: 1314 microversion: 2.1 time: 0.153394 Jul 06 13:56:49.945985 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 542/1091] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:56:49 2022] GET /compute/v2.1/servers/b2ca483f-d16b-41a4-97ef-fa182e708ad8 => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:56:50.032511 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-298e0a9c-b502-4b01-a29a-a4821b3c56da tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Calling method '>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:56:50.033226 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-298e0a9c-b502-4b01-a29a-a4821b3c56da tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] [instance: 74abce3a-f884-4edd-906c-b7ea211c3b5a] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:56:50.040035 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-298e0a9c-b502-4b01-a29a-a4821b3c56da tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:56:50.040501 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-298e0a9c-b502-4b01-a29a-a4821b3c56da tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:56:50.041665 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-298e0a9c-b502-4b01-a29a-a4821b3c56da tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:56:50.042226 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-298e0a9c-b502-4b01-a29a-a4821b3c56da tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:56:50.189929 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-298e0a9c-b502-4b01-a29a-a4821b3c56da tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32a8191b1c184c75b428579ace2da61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bf864bb1764452e8e3a6f0d5929da9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:56:50.197236 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-298e0a9c-b502-4b01-a29a-a4821b3c56da tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] 10.222.0.20 "GET /compute/v2.1/servers/74abce3a-f884-4edd-906c-b7ea211c3b5a" status: 200 len: 1266 microversion: 2.1 time: 0.169188 Jul 06 13:56:50.197789 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 550/1092] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:56:50 2022] GET /compute/v2.1/servers/74abce3a-f884-4edd-906c-b7ea211c3b5a => generated 1266 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:56:50.962926 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-e2f18d6f-967b-45a6-a133-bc074eb4da14 tempest-VolumesNegativeTest-700443590 tempest-VolumesNegativeTest-700443590-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:56:50.963540 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-e2f18d6f-967b-45a6-a133-bc074eb4da14 tempest-VolumesNegativeTest-700443590 tempest-VolumesNegativeTest-700443590-project] [instance: b2ca483f-d16b-41a4-97ef-fa182e708ad8] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:56:50.970993 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-e2f18d6f-967b-45a6-a133-bc074eb4da14 tempest-VolumesNegativeTest-700443590 tempest-VolumesNegativeTest-700443590-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:56:50.971440 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-e2f18d6f-967b-45a6-a133-bc074eb4da14 tempest-VolumesNegativeTest-700443590 tempest-VolumesNegativeTest-700443590-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:56:50.972208 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-e2f18d6f-967b-45a6-a133-bc074eb4da14 tempest-VolumesNegativeTest-700443590 tempest-VolumesNegativeTest-700443590-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:56:50.972635 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-e2f18d6f-967b-45a6-a133-bc074eb4da14 tempest-VolumesNegativeTest-700443590 tempest-VolumesNegativeTest-700443590-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:56:51.099953 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-e2f18d6f-967b-45a6-a133-bc074eb4da14 tempest-VolumesNegativeTest-700443590 tempest-VolumesNegativeTest-700443590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f44d7a12a15c4d54b32e0e6e045be419', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8ca80cbead344739f19271930c14d3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:56:51.107384 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-e2f18d6f-967b-45a6-a133-bc074eb4da14 tempest-VolumesNegativeTest-700443590 tempest-VolumesNegativeTest-700443590-project] 10.222.0.20 "GET /compute/v2.1/servers/b2ca483f-d16b-41a4-97ef-fa182e708ad8" status: 200 len: 1314 microversion: 2.1 time: 0.148555 Jul 06 13:56:51.109170 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 543/1093] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:56:50 2022] GET /compute/v2.1/servers/b2ca483f-d16b-41a4-97ef-fa182e708ad8 => generated 1314 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:56:51.214027 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-867c083a-79d2-4d9f-823a-fdd18e7c2380 tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Calling method '>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:56:51.214652 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-867c083a-79d2-4d9f-823a-fdd18e7c2380 tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] [instance: 74abce3a-f884-4edd-906c-b7ea211c3b5a] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:56:51.221866 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-867c083a-79d2-4d9f-823a-fdd18e7c2380 tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:56:51.222318 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-867c083a-79d2-4d9f-823a-fdd18e7c2380 tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:56:51.223088 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-867c083a-79d2-4d9f-823a-fdd18e7c2380 tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:56:51.223524 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-867c083a-79d2-4d9f-823a-fdd18e7c2380 tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:56:51.368747 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-867c083a-79d2-4d9f-823a-fdd18e7c2380 tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32a8191b1c184c75b428579ace2da61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bf864bb1764452e8e3a6f0d5929da9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:56:51.377243 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-867c083a-79d2-4d9f-823a-fdd18e7c2380 tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] 10.222.0.20 "GET /compute/v2.1/servers/74abce3a-f884-4edd-906c-b7ea211c3b5a" status: 200 len: 1266 microversion: 2.1 time: 0.167019 Jul 06 13:56:51.377920 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 551/1094] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:56:51 2022] GET /compute/v2.1/servers/74abce3a-f884-4edd-906c-b7ea211c3b5a => generated 1266 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:56:52.125774 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-bb648318-3d82-4a4b-a5ad-a638a8fb0929 tempest-VolumesNegativeTest-700443590 tempest-VolumesNegativeTest-700443590-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:56:52.127561 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-bb648318-3d82-4a4b-a5ad-a638a8fb0929 tempest-VolumesNegativeTest-700443590 tempest-VolumesNegativeTest-700443590-project] [instance: b2ca483f-d16b-41a4-97ef-fa182e708ad8] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:56:52.134106 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-bb648318-3d82-4a4b-a5ad-a638a8fb0929 tempest-VolumesNegativeTest-700443590 tempest-VolumesNegativeTest-700443590-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:56:52.134565 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-bb648318-3d82-4a4b-a5ad-a638a8fb0929 tempest-VolumesNegativeTest-700443590 tempest-VolumesNegativeTest-700443590-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:56:52.135339 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-bb648318-3d82-4a4b-a5ad-a638a8fb0929 tempest-VolumesNegativeTest-700443590 tempest-VolumesNegativeTest-700443590-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:56:52.135779 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-bb648318-3d82-4a4b-a5ad-a638a8fb0929 tempest-VolumesNegativeTest-700443590 tempest-VolumesNegativeTest-700443590-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:56:52.266683 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-bb648318-3d82-4a4b-a5ad-a638a8fb0929 tempest-VolumesNegativeTest-700443590 tempest-VolumesNegativeTest-700443590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f44d7a12a15c4d54b32e0e6e045be419', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8ca80cbead344739f19271930c14d3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:56:52.275683 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-bb648318-3d82-4a4b-a5ad-a638a8fb0929 tempest-VolumesNegativeTest-700443590 tempest-VolumesNegativeTest-700443590-project] 10.222.0.20 "GET /compute/v2.1/servers/b2ca483f-d16b-41a4-97ef-fa182e708ad8" status: 200 len: 1314 microversion: 2.1 time: 0.154165 Jul 06 13:56:52.279474 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 544/1095] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:56:52 2022] GET /compute/v2.1/servers/b2ca483f-d16b-41a4-97ef-fa182e708ad8 => generated 1314 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:56:52.394044 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-7f0f1742-6c91-436e-bcab-a100fb7669e4 tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Calling method '>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:56:52.394669 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-7f0f1742-6c91-436e-bcab-a100fb7669e4 tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] [instance: 74abce3a-f884-4edd-906c-b7ea211c3b5a] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:56:52.401110 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-7f0f1742-6c91-436e-bcab-a100fb7669e4 tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:56:52.401569 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-7f0f1742-6c91-436e-bcab-a100fb7669e4 tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:56:52.402347 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-7f0f1742-6c91-436e-bcab-a100fb7669e4 tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:56:52.402794 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-7f0f1742-6c91-436e-bcab-a100fb7669e4 tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:56:52.537623 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-7f0f1742-6c91-436e-bcab-a100fb7669e4 tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32a8191b1c184c75b428579ace2da61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bf864bb1764452e8e3a6f0d5929da9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:56:52.546651 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-7f0f1742-6c91-436e-bcab-a100fb7669e4 tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] 10.222.0.20 "GET /compute/v2.1/servers/74abce3a-f884-4edd-906c-b7ea211c3b5a" status: 200 len: 1454 microversion: 2.1 time: 0.155157 Jul 06 13:56:52.547222 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 552/1096] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:56:52 2022] GET /compute/v2.1/servers/74abce3a-f884-4edd-906c-b7ea211c3b5a => generated 1454 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 06 13:56:52.562594 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-d1315f6d-7f5c-4e76-8354-09d79c41630e tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:56:52.563304 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-d1315f6d-7f5c-4e76-8354-09d79c41630e tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] [instance: 74abce3a-f884-4edd-906c-b7ea211c3b5a] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:56:52.569282 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-d1315f6d-7f5c-4e76-8354-09d79c41630e tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:56:52.569732 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-d1315f6d-7f5c-4e76-8354-09d79c41630e tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:56:52.570494 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-d1315f6d-7f5c-4e76-8354-09d79c41630e tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:56:52.570927 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-d1315f6d-7f5c-4e76-8354-09d79c41630e tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:56:52.708530 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-d1315f6d-7f5c-4e76-8354-09d79c41630e tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32a8191b1c184c75b428579ace2da61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bf864bb1764452e8e3a6f0d5929da9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:56:52.716638 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-d1315f6d-7f5c-4e76-8354-09d79c41630e tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] 10.222.0.20 "GET /compute/v2.1/servers/74abce3a-f884-4edd-906c-b7ea211c3b5a" status: 200 len: 1454 microversion: 2.1 time: 0.157918 Jul 06 13:56:52.718373 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 545/1097] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:56:52 2022] GET /compute/v2.1/servers/74abce3a-f884-4edd-906c-b7ea211c3b5a => generated 1454 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:56:53.295780 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-08fce2fe-149c-4b65-9852-149e3643625d tempest-VolumesNegativeTest-700443590 tempest-VolumesNegativeTest-700443590-project] Calling method '>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:56:53.296410 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-08fce2fe-149c-4b65-9852-149e3643625d tempest-VolumesNegativeTest-700443590 tempest-VolumesNegativeTest-700443590-project] [instance: b2ca483f-d16b-41a4-97ef-fa182e708ad8] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:56:53.303606 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-08fce2fe-149c-4b65-9852-149e3643625d tempest-VolumesNegativeTest-700443590 tempest-VolumesNegativeTest-700443590-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:56:53.304061 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-08fce2fe-149c-4b65-9852-149e3643625d tempest-VolumesNegativeTest-700443590 tempest-VolumesNegativeTest-700443590-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:56:53.305116 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-08fce2fe-149c-4b65-9852-149e3643625d tempest-VolumesNegativeTest-700443590 tempest-VolumesNegativeTest-700443590-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:56:53.305771 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-08fce2fe-149c-4b65-9852-149e3643625d tempest-VolumesNegativeTest-700443590 tempest-VolumesNegativeTest-700443590-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:56:53.533567 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-08fce2fe-149c-4b65-9852-149e3643625d tempest-VolumesNegativeTest-700443590 tempest-VolumesNegativeTest-700443590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f44d7a12a15c4d54b32e0e6e045be419', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8ca80cbead344739f19271930c14d3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:56:53.551396 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-08fce2fe-149c-4b65-9852-149e3643625d tempest-VolumesNegativeTest-700443590 tempest-VolumesNegativeTest-700443590-project] 10.222.0.20 "GET /compute/v2.1/servers/b2ca483f-d16b-41a4-97ef-fa182e708ad8" status: 200 len: 1314 microversion: 2.1 time: 0.259091 Jul 06 13:56:53.553194 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 553/1098] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:56:53 2022] GET /compute/v2.1/servers/b2ca483f-d16b-41a4-97ef-fa182e708ad8 => generated 1314 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:56:54.569720 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-4c878679-1746-44a2-b924-5aa9b8dcc5f9 tempest-VolumesNegativeTest-700443590 tempest-VolumesNegativeTest-700443590-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:56:54.570999 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-4c878679-1746-44a2-b924-5aa9b8dcc5f9 tempest-VolumesNegativeTest-700443590 tempest-VolumesNegativeTest-700443590-project] [instance: b2ca483f-d16b-41a4-97ef-fa182e708ad8] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:56:54.579132 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-4c878679-1746-44a2-b924-5aa9b8dcc5f9 tempest-VolumesNegativeTest-700443590 tempest-VolumesNegativeTest-700443590-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:56:54.579679 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-4c878679-1746-44a2-b924-5aa9b8dcc5f9 tempest-VolumesNegativeTest-700443590 tempest-VolumesNegativeTest-700443590-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:56:54.580742 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-4c878679-1746-44a2-b924-5aa9b8dcc5f9 tempest-VolumesNegativeTest-700443590 tempest-VolumesNegativeTest-700443590-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:56:54.581425 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-4c878679-1746-44a2-b924-5aa9b8dcc5f9 tempest-VolumesNegativeTest-700443590 tempest-VolumesNegativeTest-700443590-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:56:54.742012 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [req-e882489b-d2ea-4e85-913e-00922c0fd588 req-637f9480-8f64-4a7b-ab92-b95e4adb09c7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "74abce3a-f884-4edd-906c-b7ea211c3b5a", "tag": "424688a9-34bc-4310-80b7-d8344dc05c86"}]} {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 06 13:56:54.745447 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-4c878679-1746-44a2-b924-5aa9b8dcc5f9 tempest-VolumesNegativeTest-700443590 tempest-VolumesNegativeTest-700443590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f44d7a12a15c4d54b32e0e6e045be419', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8ca80cbead344739f19271930c14d3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:56:54.753926 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-4c878679-1746-44a2-b924-5aa9b8dcc5f9 tempest-VolumesNegativeTest-700443590 tempest-VolumesNegativeTest-700443590-project] 10.222.0.20 "GET /compute/v2.1/servers/b2ca483f-d16b-41a4-97ef-fa182e708ad8" status: 200 len: 1314 microversion: 2.1 time: 0.187951 Jul 06 13:56:54.754508 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 546/1099] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:56:54 2022] GET /compute/v2.1/servers/b2ca483f-d16b-41a4-97ef-fa182e708ad8 => generated 1314 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 06 13:56:54.765660 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [req-e882489b-d2ea-4e85-913e-00922c0fd588 req-637f9480-8f64-4a7b-ab92-b95e4adb09c7 service nova] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:56:54.766121 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [req-e882489b-d2ea-4e85-913e-00922c0fd588 req-637f9480-8f64-4a7b-ab92-b95e4adb09c7 service nova] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:56:54.778660 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.compute.server_external_events [req-e882489b-d2ea-4e85-913e-00922c0fd588 req-637f9480-8f64-4a7b-ab92-b95e4adb09c7 service nova] Creating event network-changed:424688a9-34bc-4310-80b7-d8344dc05c86 for instance 74abce3a-f884-4edd-906c-b7ea211c3b5a on hv-cinder-81914 Jul 06 13:56:54.783835 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [req-e882489b-d2ea-4e85-913e-00922c0fd588 req-637f9480-8f64-4a7b-ab92-b95e4adb09c7 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.186503 Jul 06 13:56:54.784526 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 554/1100] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 6 13:56:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 06 13:56:55.762956 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [req-c0ed811d-e809-4901-992d-99ff57d71c6b req-05464bf1-5e3a-4326-a0e3-9319fb20f4d3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b2ca483f-d16b-41a4-97ef-fa182e708ad8", "name": "network-vif-plugged", "status": "completed", "tag": "078e0444-c97b-4d66-ba75-3caa6aa99a0e"}]} {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 06 13:56:55.767181 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG dbcounter [-] [124367] Writing DB stats nova_cell0:SELECT=2 {{(pid=124367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:56:55.769045 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG dbcounter [-] [124368] Writing DB stats nova_cell0:SELECT=2 {{(pid=124368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:56:55.770477 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG dbcounter [-] [124368] Writing DB stats nova_cell0:SELECT=6 {{(pid=124368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:56:55.775725 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [req-c0ed811d-e809-4901-992d-99ff57d71c6b req-05464bf1-5e3a-4326-a0e3-9319fb20f4d3 service nova] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:56:55.776638 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [req-c0ed811d-e809-4901-992d-99ff57d71c6b req-05464bf1-5e3a-4326-a0e3-9319fb20f4d3 service nova] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:56:55.781014 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-3889ccf9-d1ef-4544-b3a3-839a2aefece5 tempest-VolumesNegativeTest-700443590 tempest-VolumesNegativeTest-700443590-project] Calling method '>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:56:55.782397 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-3889ccf9-d1ef-4544-b3a3-839a2aefece5 tempest-VolumesNegativeTest-700443590 tempest-VolumesNegativeTest-700443590-project] [instance: b2ca483f-d16b-41a4-97ef-fa182e708ad8] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:56:55.791874 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-3889ccf9-d1ef-4544-b3a3-839a2aefece5 tempest-VolumesNegativeTest-700443590 tempest-VolumesNegativeTest-700443590-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:56:55.792213 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-3889ccf9-d1ef-4544-b3a3-839a2aefece5 tempest-VolumesNegativeTest-700443590 tempest-VolumesNegativeTest-700443590-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:56:55.793343 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-3889ccf9-d1ef-4544-b3a3-839a2aefece5 tempest-VolumesNegativeTest-700443590 tempest-VolumesNegativeTest-700443590-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:56:55.794011 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-3889ccf9-d1ef-4544-b3a3-839a2aefece5 tempest-VolumesNegativeTest-700443590 tempest-VolumesNegativeTest-700443590-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:56:55.807770 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.compute.server_external_events [req-c0ed811d-e809-4901-992d-99ff57d71c6b req-05464bf1-5e3a-4326-a0e3-9319fb20f4d3 service nova] Creating event network-vif-plugged:078e0444-c97b-4d66-ba75-3caa6aa99a0e for instance b2ca483f-d16b-41a4-97ef-fa182e708ad8 on hv-cinder-81914 Jul 06 13:56:55.816490 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [req-c0ed811d-e809-4901-992d-99ff57d71c6b req-05464bf1-5e3a-4326-a0e3-9319fb20f4d3 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057454 Jul 06 13:56:55.821577 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 547/1101] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 6 13:56:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 06 13:56:55.961554 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-3889ccf9-d1ef-4544-b3a3-839a2aefece5 tempest-VolumesNegativeTest-700443590 tempest-VolumesNegativeTest-700443590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f44d7a12a15c4d54b32e0e6e045be419', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8ca80cbead344739f19271930c14d3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:56:55.970792 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-3889ccf9-d1ef-4544-b3a3-839a2aefece5 tempest-VolumesNegativeTest-700443590 tempest-VolumesNegativeTest-700443590-project] 10.222.0.20 "GET /compute/v2.1/servers/b2ca483f-d16b-41a4-97ef-fa182e708ad8" status: 200 len: 1314 microversion: 2.1 time: 0.202764 Jul 06 13:56:55.971370 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 555/1102] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:56:55 2022] GET /compute/v2.1/servers/b2ca483f-d16b-41a4-97ef-fa182e708ad8 => generated 1314 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:56:56.988764 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-f7119282-d567-4dd4-8fd0-517a8f791719 tempest-VolumesNegativeTest-700443590 tempest-VolumesNegativeTest-700443590-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:56:56.989478 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-f7119282-d567-4dd4-8fd0-517a8f791719 tempest-VolumesNegativeTest-700443590 tempest-VolumesNegativeTest-700443590-project] [instance: b2ca483f-d16b-41a4-97ef-fa182e708ad8] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:56:56.996258 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-f7119282-d567-4dd4-8fd0-517a8f791719 tempest-VolumesNegativeTest-700443590 tempest-VolumesNegativeTest-700443590-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:56:56.996705 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-f7119282-d567-4dd4-8fd0-517a8f791719 tempest-VolumesNegativeTest-700443590 tempest-VolumesNegativeTest-700443590-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:56:56.997491 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-f7119282-d567-4dd4-8fd0-517a8f791719 tempest-VolumesNegativeTest-700443590 tempest-VolumesNegativeTest-700443590-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:56:56.997988 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-f7119282-d567-4dd4-8fd0-517a8f791719 tempest-VolumesNegativeTest-700443590 tempest-VolumesNegativeTest-700443590-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:56:57.128327 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-f7119282-d567-4dd4-8fd0-517a8f791719 tempest-VolumesNegativeTest-700443590 tempest-VolumesNegativeTest-700443590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f44d7a12a15c4d54b32e0e6e045be419', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8ca80cbead344739f19271930c14d3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:56:57.135867 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-f7119282-d567-4dd4-8fd0-517a8f791719 tempest-VolumesNegativeTest-700443590 tempest-VolumesNegativeTest-700443590-project] 10.222.0.20 "GET /compute/v2.1/servers/b2ca483f-d16b-41a4-97ef-fa182e708ad8" status: 200 len: 1314 microversion: 2.1 time: 0.151265 Jul 06 13:56:57.136423 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 548/1103] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:56:56 2022] GET /compute/v2.1/servers/b2ca483f-d16b-41a4-97ef-fa182e708ad8 => generated 1314 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:56:58.152790 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-703ea929-df58-41f0-b3d7-72052cdb05ae tempest-VolumesNegativeTest-700443590 tempest-VolumesNegativeTest-700443590-project] Calling method '>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:56:58.153371 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-703ea929-df58-41f0-b3d7-72052cdb05ae tempest-VolumesNegativeTest-700443590 tempest-VolumesNegativeTest-700443590-project] [instance: b2ca483f-d16b-41a4-97ef-fa182e708ad8] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:56:58.160021 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-703ea929-df58-41f0-b3d7-72052cdb05ae tempest-VolumesNegativeTest-700443590 tempest-VolumesNegativeTest-700443590-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:56:58.160480 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-703ea929-df58-41f0-b3d7-72052cdb05ae tempest-VolumesNegativeTest-700443590 tempest-VolumesNegativeTest-700443590-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:56:58.161277 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-703ea929-df58-41f0-b3d7-72052cdb05ae tempest-VolumesNegativeTest-700443590 tempest-VolumesNegativeTest-700443590-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:56:58.161727 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-703ea929-df58-41f0-b3d7-72052cdb05ae tempest-VolumesNegativeTest-700443590 tempest-VolumesNegativeTest-700443590-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:56:58.291104 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-703ea929-df58-41f0-b3d7-72052cdb05ae tempest-VolumesNegativeTest-700443590 tempest-VolumesNegativeTest-700443590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f44d7a12a15c4d54b32e0e6e045be419', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8ca80cbead344739f19271930c14d3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:56:58.300358 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-703ea929-df58-41f0-b3d7-72052cdb05ae tempest-VolumesNegativeTest-700443590 tempest-VolumesNegativeTest-700443590-project] 10.222.0.20 "GET /compute/v2.1/servers/b2ca483f-d16b-41a4-97ef-fa182e708ad8" status: 200 len: 1314 microversion: 2.1 time: 0.151400 Jul 06 13:56:58.301440 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 556/1104] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:56:58 2022] GET /compute/v2.1/servers/b2ca483f-d16b-41a4-97ef-fa182e708ad8 => generated 1314 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:56:59.323226 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-90516405-f95c-4f2c-bded-5256374fb495 tempest-VolumesNegativeTest-700443590 tempest-VolumesNegativeTest-700443590-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:56:59.323832 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-90516405-f95c-4f2c-bded-5256374fb495 tempest-VolumesNegativeTest-700443590 tempest-VolumesNegativeTest-700443590-project] [instance: b2ca483f-d16b-41a4-97ef-fa182e708ad8] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:56:59.332089 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-90516405-f95c-4f2c-bded-5256374fb495 tempest-VolumesNegativeTest-700443590 tempest-VolumesNegativeTest-700443590-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:56:59.332539 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-90516405-f95c-4f2c-bded-5256374fb495 tempest-VolumesNegativeTest-700443590 tempest-VolumesNegativeTest-700443590-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:56:59.333405 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-90516405-f95c-4f2c-bded-5256374fb495 tempest-VolumesNegativeTest-700443590 tempest-VolumesNegativeTest-700443590-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:56:59.333843 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-90516405-f95c-4f2c-bded-5256374fb495 tempest-VolumesNegativeTest-700443590 tempest-VolumesNegativeTest-700443590-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:56:59.461210 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-90516405-f95c-4f2c-bded-5256374fb495 tempest-VolumesNegativeTest-700443590 tempest-VolumesNegativeTest-700443590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f44d7a12a15c4d54b32e0e6e045be419', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8ca80cbead344739f19271930c14d3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:56:59.468758 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-90516405-f95c-4f2c-bded-5256374fb495 tempest-VolumesNegativeTest-700443590 tempest-VolumesNegativeTest-700443590-project] 10.222.0.20 "GET /compute/v2.1/servers/b2ca483f-d16b-41a4-97ef-fa182e708ad8" status: 200 len: 1314 microversion: 2.1 time: 0.151970 Jul 06 13:56:59.469292 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 549/1105] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:56:59 2022] GET /compute/v2.1/servers/b2ca483f-d16b-41a4-97ef-fa182e708ad8 => generated 1314 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:57:00.485186 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-59c8dab3-f047-4376-ae67-cc837d9c0fa6 tempest-VolumesNegativeTest-700443590 tempest-VolumesNegativeTest-700443590-project] Calling method '>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:57:00.485804 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-59c8dab3-f047-4376-ae67-cc837d9c0fa6 tempest-VolumesNegativeTest-700443590 tempest-VolumesNegativeTest-700443590-project] [instance: b2ca483f-d16b-41a4-97ef-fa182e708ad8] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:57:00.492223 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-59c8dab3-f047-4376-ae67-cc837d9c0fa6 tempest-VolumesNegativeTest-700443590 tempest-VolumesNegativeTest-700443590-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:57:00.492676 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-59c8dab3-f047-4376-ae67-cc837d9c0fa6 tempest-VolumesNegativeTest-700443590 tempest-VolumesNegativeTest-700443590-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:57:00.493477 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-59c8dab3-f047-4376-ae67-cc837d9c0fa6 tempest-VolumesNegativeTest-700443590 tempest-VolumesNegativeTest-700443590-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:57:00.493918 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-59c8dab3-f047-4376-ae67-cc837d9c0fa6 tempest-VolumesNegativeTest-700443590 tempest-VolumesNegativeTest-700443590-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:57:00.623301 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-59c8dab3-f047-4376-ae67-cc837d9c0fa6 tempest-VolumesNegativeTest-700443590 tempest-VolumesNegativeTest-700443590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f44d7a12a15c4d54b32e0e6e045be419', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8ca80cbead344739f19271930c14d3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:57:00.625736 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG dbcounter [-] [124368] Writing DB stats nova_cell1:SELECT=100 {{(pid=124368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:57:00.632463 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-59c8dab3-f047-4376-ae67-cc837d9c0fa6 tempest-VolumesNegativeTest-700443590 tempest-VolumesNegativeTest-700443590-project] 10.222.0.20 "GET /compute/v2.1/servers/b2ca483f-d16b-41a4-97ef-fa182e708ad8" status: 200 len: 1314 microversion: 2.1 time: 0.151454 Jul 06 13:57:00.633053 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 557/1106] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:57:00 2022] GET /compute/v2.1/servers/b2ca483f-d16b-41a4-97ef-fa182e708ad8 => generated 1314 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:57:01.649666 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-ba4cebbb-463b-41d4-989a-676de412e44a tempest-VolumesNegativeTest-700443590 tempest-VolumesNegativeTest-700443590-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:57:01.650277 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-ba4cebbb-463b-41d4-989a-676de412e44a tempest-VolumesNegativeTest-700443590 tempest-VolumesNegativeTest-700443590-project] [instance: b2ca483f-d16b-41a4-97ef-fa182e708ad8] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:57:01.652691 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG dbcounter [-] [124367] Writing DB stats nova_api:SELECT=55,nova_api:INSERT=3 {{(pid=124367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:57:01.657880 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-ba4cebbb-463b-41d4-989a-676de412e44a tempest-VolumesNegativeTest-700443590 tempest-VolumesNegativeTest-700443590-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:57:01.658330 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-ba4cebbb-463b-41d4-989a-676de412e44a tempest-VolumesNegativeTest-700443590 tempest-VolumesNegativeTest-700443590-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:57:01.659104 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-ba4cebbb-463b-41d4-989a-676de412e44a tempest-VolumesNegativeTest-700443590 tempest-VolumesNegativeTest-700443590-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:57:01.659541 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-ba4cebbb-463b-41d4-989a-676de412e44a tempest-VolumesNegativeTest-700443590 tempest-VolumesNegativeTest-700443590-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:57:01.792704 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-ba4cebbb-463b-41d4-989a-676de412e44a tempest-VolumesNegativeTest-700443590 tempest-VolumesNegativeTest-700443590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f44d7a12a15c4d54b32e0e6e045be419', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8ca80cbead344739f19271930c14d3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:57:01.801025 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-ba4cebbb-463b-41d4-989a-676de412e44a tempest-VolumesNegativeTest-700443590 tempest-VolumesNegativeTest-700443590-project] 10.222.0.20 "GET /compute/v2.1/servers/b2ca483f-d16b-41a4-97ef-fa182e708ad8" status: 200 len: 1464 microversion: 2.1 time: 0.154945 Jul 06 13:57:01.801591 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 550/1107] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:57:01 2022] GET /compute/v2.1/servers/b2ca483f-d16b-41a4-97ef-fa182e708ad8 => generated 1464 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:57:01.840090 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-3244a9ce-c054-439f-bc65-7f3393b8248c tempest-VolumesNegativeTest-700443590 tempest-VolumesNegativeTest-700443590-project] Calling method '>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:57:01.840598 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-3244a9ce-c054-439f-bc65-7f3393b8248c tempest-VolumesNegativeTest-700443590 tempest-VolumesNegativeTest-700443590-project] [instance: b2ca483f-d16b-41a4-97ef-fa182e708ad8] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:57:01.843827 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG dbcounter [-] [124368] Writing DB stats nova_api:SELECT=53,nova_api:INSERT=3 {{(pid=124368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:57:01.850695 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-3244a9ce-c054-439f-bc65-7f3393b8248c tempest-VolumesNegativeTest-700443590 tempest-VolumesNegativeTest-700443590-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:57:01.851155 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-3244a9ce-c054-439f-bc65-7f3393b8248c tempest-VolumesNegativeTest-700443590 tempest-VolumesNegativeTest-700443590-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:57:01.851937 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-3244a9ce-c054-439f-bc65-7f3393b8248c tempest-VolumesNegativeTest-700443590 tempest-VolumesNegativeTest-700443590-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:57:01.852381 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-3244a9ce-c054-439f-bc65-7f3393b8248c tempest-VolumesNegativeTest-700443590 tempest-VolumesNegativeTest-700443590-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:57:01.881234 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-3244a9ce-c054-439f-bc65-7f3393b8248c tempest-VolumesNegativeTest-700443590 tempest-VolumesNegativeTest-700443590-project] [instance: b2ca483f-d16b-41a4-97ef-fa182e708ad8] Going to try to terminate instance {{(pid=124368) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 06 13:57:01.964721 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-3244a9ce-c054-439f-bc65-7f3393b8248c tempest-VolumesNegativeTest-700443590 tempest-VolumesNegativeTest-700443590-project] 10.222.0.20 "DELETE /compute/v2.1/servers/b2ca483f-d16b-41a4-97ef-fa182e708ad8" status: 204 len: 0 microversion: 2.1 time: 0.128072 Jul 06 13:57:01.965511 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 558/1108] 10.222.0.20 () {58 vars in 1238 bytes} [Wed Jul 6 13:57:01 2022] DELETE /compute/v2.1/servers/b2ca483f-d16b-41a4-97ef-fa182e708ad8 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 06 13:57:01.975687 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-6836016d-0d21-4392-9947-507095db1575 tempest-VolumesNegativeTest-700443590 tempest-VolumesNegativeTest-700443590-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:57:01.976310 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-6836016d-0d21-4392-9947-507095db1575 tempest-VolumesNegativeTest-700443590 tempest-VolumesNegativeTest-700443590-project] [instance: b2ca483f-d16b-41a4-97ef-fa182e708ad8] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:57:01.989327 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-6836016d-0d21-4392-9947-507095db1575 tempest-VolumesNegativeTest-700443590 tempest-VolumesNegativeTest-700443590-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:57:01.989327 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-6836016d-0d21-4392-9947-507095db1575 tempest-VolumesNegativeTest-700443590 tempest-VolumesNegativeTest-700443590-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:57:01.989751 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-6836016d-0d21-4392-9947-507095db1575 tempest-VolumesNegativeTest-700443590 tempest-VolumesNegativeTest-700443590-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:57:01.990134 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-6836016d-0d21-4392-9947-507095db1575 tempest-VolumesNegativeTest-700443590 tempest-VolumesNegativeTest-700443590-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:57:02.130789 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-6836016d-0d21-4392-9947-507095db1575 tempest-VolumesNegativeTest-700443590 tempest-VolumesNegativeTest-700443590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f44d7a12a15c4d54b32e0e6e045be419', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8ca80cbead344739f19271930c14d3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:57:02.133190 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG dbcounter [-] [124367] Writing DB stats nova_cell1:SELECT=100 {{(pid=124367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:57:02.140377 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-6836016d-0d21-4392-9947-507095db1575 tempest-VolumesNegativeTest-700443590 tempest-VolumesNegativeTest-700443590-project] 10.222.0.20 "GET /compute/v2.1/servers/b2ca483f-d16b-41a4-97ef-fa182e708ad8" status: 200 len: 1470 microversion: 2.1 time: 0.168705 Jul 06 13:57:02.140955 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 551/1109] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:57:01 2022] GET /compute/v2.1/servers/b2ca483f-d16b-41a4-97ef-fa182e708ad8 => generated 1470 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:57:03.157303 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-de033304-9023-4adf-be07-3a9f81b0b4d6 tempest-VolumesNegativeTest-700443590 tempest-VolumesNegativeTest-700443590-project] Calling method '>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:57:03.158018 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-de033304-9023-4adf-be07-3a9f81b0b4d6 tempest-VolumesNegativeTest-700443590 tempest-VolumesNegativeTest-700443590-project] [instance: b2ca483f-d16b-41a4-97ef-fa182e708ad8] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:57:03.164554 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-de033304-9023-4adf-be07-3a9f81b0b4d6 tempest-VolumesNegativeTest-700443590 tempest-VolumesNegativeTest-700443590-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:57:03.165108 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-de033304-9023-4adf-be07-3a9f81b0b4d6 tempest-VolumesNegativeTest-700443590 tempest-VolumesNegativeTest-700443590-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:57:03.165897 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-de033304-9023-4adf-be07-3a9f81b0b4d6 tempest-VolumesNegativeTest-700443590 tempest-VolumesNegativeTest-700443590-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:57:03.166375 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-de033304-9023-4adf-be07-3a9f81b0b4d6 tempest-VolumesNegativeTest-700443590 tempest-VolumesNegativeTest-700443590-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:57:03.297602 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-de033304-9023-4adf-be07-3a9f81b0b4d6 tempest-VolumesNegativeTest-700443590 tempest-VolumesNegativeTest-700443590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f44d7a12a15c4d54b32e0e6e045be419', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8ca80cbead344739f19271930c14d3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:57:03.305383 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-de033304-9023-4adf-be07-3a9f81b0b4d6 tempest-VolumesNegativeTest-700443590 tempest-VolumesNegativeTest-700443590-project] 10.222.0.20 "GET /compute/v2.1/servers/b2ca483f-d16b-41a4-97ef-fa182e708ad8" status: 200 len: 1470 microversion: 2.1 time: 0.152304 Jul 06 13:57:03.305948 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 559/1110] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:57:03 2022] GET /compute/v2.1/servers/b2ca483f-d16b-41a4-97ef-fa182e708ad8 => generated 1470 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:57:04.327978 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-0830a467-bdce-4c35-8395-39a358ef89eb tempest-VolumesNegativeTest-700443590 tempest-VolumesNegativeTest-700443590-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:57:04.328630 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-0830a467-bdce-4c35-8395-39a358ef89eb tempest-VolumesNegativeTest-700443590 tempest-VolumesNegativeTest-700443590-project] [instance: b2ca483f-d16b-41a4-97ef-fa182e708ad8] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:57:04.351953 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-0830a467-bdce-4c35-8395-39a358ef89eb tempest-VolumesNegativeTest-700443590 tempest-VolumesNegativeTest-700443590-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:57:04.352408 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-0830a467-bdce-4c35-8395-39a358ef89eb tempest-VolumesNegativeTest-700443590 tempest-VolumesNegativeTest-700443590-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:57:04.353230 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-0830a467-bdce-4c35-8395-39a358ef89eb tempest-VolumesNegativeTest-700443590 tempest-VolumesNegativeTest-700443590-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:57:04.353662 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-0830a467-bdce-4c35-8395-39a358ef89eb tempest-VolumesNegativeTest-700443590 tempest-VolumesNegativeTest-700443590-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:57:04.376305 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [req-bd4d6947-a42a-42ca-8769-ddc8560f2136 req-aa5be50e-c647-46ae-995a-49f70835869b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b2ca483f-d16b-41a4-97ef-fa182e708ad8", "name": "network-vif-deleted", "tag": "078e0444-c97b-4d66-ba75-3caa6aa99a0e"}]} {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 06 13:57:04.389524 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [req-bd4d6947-a42a-42ca-8769-ddc8560f2136 req-aa5be50e-c647-46ae-995a-49f70835869b service nova] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:57:04.390286 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [req-bd4d6947-a42a-42ca-8769-ddc8560f2136 req-aa5be50e-c647-46ae-995a-49f70835869b service nova] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:57:04.409353 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.compute.server_external_events [req-bd4d6947-a42a-42ca-8769-ddc8560f2136 req-aa5be50e-c647-46ae-995a-49f70835869b service nova] Creating event network-vif-deleted:078e0444-c97b-4d66-ba75-3caa6aa99a0e for instance b2ca483f-d16b-41a4-97ef-fa182e708ad8 on hv-cinder-81914 Jul 06 13:57:04.417496 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [req-bd4d6947-a42a-42ca-8769-ddc8560f2136 req-aa5be50e-c647-46ae-995a-49f70835869b service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047333 Jul 06 13:57:04.418111 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 560/1111] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 6 13:57:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 06 13:57:04.438705 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-0830a467-bdce-4c35-8395-39a358ef89eb tempest-VolumesNegativeTest-700443590 tempest-VolumesNegativeTest-700443590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f44d7a12a15c4d54b32e0e6e045be419', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8ca80cbead344739f19271930c14d3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:57:04.447241 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-0830a467-bdce-4c35-8395-39a358ef89eb tempest-VolumesNegativeTest-700443590 tempest-VolumesNegativeTest-700443590-project] 10.222.0.20 "GET /compute/v2.1/servers/b2ca483f-d16b-41a4-97ef-fa182e708ad8" status: 200 len: 1428 microversion: 2.1 time: 0.127412 Jul 06 13:57:04.448244 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 552/1112] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:57:04 2022] GET /compute/v2.1/servers/b2ca483f-d16b-41a4-97ef-fa182e708ad8 => generated 1428 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:57:05.470243 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-1f3a0026-40e3-4f50-9ef9-da6e0e5aa3d0 tempest-VolumesNegativeTest-700443590 tempest-VolumesNegativeTest-700443590-project] Calling method '>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:57:05.470895 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-1f3a0026-40e3-4f50-9ef9-da6e0e5aa3d0 tempest-VolumesNegativeTest-700443590 tempest-VolumesNegativeTest-700443590-project] [instance: b2ca483f-d16b-41a4-97ef-fa182e708ad8] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:57:05.477542 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-1f3a0026-40e3-4f50-9ef9-da6e0e5aa3d0 tempest-VolumesNegativeTest-700443590 tempest-VolumesNegativeTest-700443590-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:57:05.478070 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-1f3a0026-40e3-4f50-9ef9-da6e0e5aa3d0 tempest-VolumesNegativeTest-700443590 tempest-VolumesNegativeTest-700443590-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:57:05.478859 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-1f3a0026-40e3-4f50-9ef9-da6e0e5aa3d0 tempest-VolumesNegativeTest-700443590 tempest-VolumesNegativeTest-700443590-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:57:05.479292 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-1f3a0026-40e3-4f50-9ef9-da6e0e5aa3d0 tempest-VolumesNegativeTest-700443590 tempest-VolumesNegativeTest-700443590-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:57:05.493572 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.wsgi [None req-1f3a0026-40e3-4f50-9ef9-da6e0e5aa3d0 tempest-VolumesNegativeTest-700443590 tempest-VolumesNegativeTest-700443590-project] HTTP exception thrown: Instance b2ca483f-d16b-41a4-97ef-fa182e708ad8 could not be found. Jul 06 13:57:05.495211 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-1f3a0026-40e3-4f50-9ef9-da6e0e5aa3d0 tempest-VolumesNegativeTest-700443590 tempest-VolumesNegativeTest-700443590-project] Request method failure captured: Jul 06 13:57:05.495211 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: request: GET /compute/v2.1/servers/b2ca483f-d16b-41a4-97ef-fa182e708ad8 HTTP/1.1 Jul 06 13:57:05.495211 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: Accept: application/json Jul 06 13:57:05.495211 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: Accept-Encoding: identity Jul 06 13:57:05.495211 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: Connection: close Jul 06 13:57:05.495211 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: Content-Length: 0 Jul 06 13:57:05.495211 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: Content-Type: application/json Jul 06 13:57:05.495211 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: Host: 10.222.0.20 Jul 06 13:57:05.495211 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: Openstack-System-Scope: None Jul 06 13:57:05.495211 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: User-Agent: python-urllib3/1.26.9 Jul 06 13:57:05.495211 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Auth-Token: gAAAAABixZSbS4sZDLKxV2DAuuR4Ep7UhvRLEF7Py7pcRcfvjjkFhSs8zmxQ-SCdHC6svluEJvRGX4JMNfsbeOvSV_jL0LBKFn_lrwOueCIpa-NXzNMtKQ8H33bUUA-P6AT_79_KurWXi9yTOKfAsbcza3XyCdczze77b42q2Be1tfBajC9vdcE Jul 06 13:57:05.495211 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Domain-Id: None Jul 06 13:57:05.495211 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Domain-Name: None Jul 06 13:57:05.495211 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Identity-Status: Confirmed Jul 06 13:57:05.495211 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Is-Admin-Project: True Jul 06 13:57:05.495211 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Project-Domain-Id: default Jul 06 13:57:05.495211 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Project-Domain-Name: Default Jul 06 13:57:05.495211 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Project-Id: c8ca80cbead344739f19271930c14d3b Jul 06 13:57:05.495211 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Project-Name: tempest-VolumesNegativeTest-700443590 Jul 06 13:57:05.495211 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Role: reader,member Jul 06 13:57:05.495211 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Roles: reader,member Jul 06 13:57:05.496887 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_c8ca80cbead344739f19271930c14d3b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/c8ca80cbead344739f19271930c14d3b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/c8ca80cbead344739f19271930c14d3b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/c8ca80cbead344739f19271930c14d3b"}]}] Jul 06 13:57:05.496887 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Tenant: tempest-VolumesNegativeTest-700443590 Jul 06 13:57:05.496887 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Tenant-Id: c8ca80cbead344739f19271930c14d3b Jul 06 13:57:05.496887 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Tenant-Name: tempest-VolumesNegativeTest-700443590 Jul 06 13:57:05.496887 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-User: tempest-VolumesNegativeTest-700443590-project Jul 06 13:57:05.496887 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-User-Domain-Id: default Jul 06 13:57:05.496887 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-User-Domain-Name: Default Jul 06 13:57:05.496887 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-User-Id: f44d7a12a15c4d54b32e0e6e045be419 Jul 06 13:57:05.496887 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-User-Name: tempest-VolumesNegativeTest-700443590-project Jul 06 13:57:05.496887 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: method: > Jul 06 13:57:05.496887 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: exception: Instance b2ca483f-d16b-41a4-97ef-fa182e708ad8 could not be found. Jul 06 13:57:05.496887 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: action_args: {'id': 'b2ca483f-d16b-41a4-97ef-fa182e708ad8'} Jul 06 13:57:05.497906 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 06 13:57:05.497906 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 06 13:57:05.497906 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 06 13:57:05.497906 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 06 13:57:05.497906 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 06 13:57:05.497906 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 06 13:57:05.497906 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 06 13:57:05.497906 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 06 13:57:05.497906 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 06 13:57:05.497906 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 06 13:57:05.497906 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b2ca483f-d16b-41a4-97ef-fa182e708ad8 could not be found. Jul 06 13:57:05.497906 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi Jul 06 13:57:05.497906 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 06 13:57:05.497906 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi Jul 06 13:57:05.497906 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 06 13:57:05.497906 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 06 13:57:05.497906 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 06 13:57:05.497906 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 06 13:57:05.497906 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 06 13:57:05.497906 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 06 13:57:05.499987 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 06 13:57:05.499987 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 06 13:57:05.499987 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 06 13:57:05.499987 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 06 13:57:05.499987 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 06 13:57:05.499987 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 06 13:57:05.499987 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 06 13:57:05.499987 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b2ca483f-d16b-41a4-97ef-fa182e708ad8 could not be found. Jul 06 13:57:05.499987 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi Jul 06 13:57:05.499987 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 06 13:57:05.499987 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi Jul 06 13:57:05.499987 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 06 13:57:05.499987 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 06 13:57:05.499987 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 06 13:57:05.499987 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 06 13:57:05.499987 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 06 13:57:05.499987 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b2ca483f-d16b-41a4-97ef-fa182e708ad8 could not be found. Jul 06 13:57:05.499987 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi Jul 06 13:57:05.501206 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-1f3a0026-40e3-4f50-9ef9-da6e0e5aa3d0 tempest-VolumesNegativeTest-700443590 tempest-VolumesNegativeTest-700443590-project] Returning 404 to user: Instance b2ca483f-d16b-41a4-97ef-fa182e708ad8 could not be found. {{(pid=124368) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 06 13:57:05.501206 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-1f3a0026-40e3-4f50-9ef9-da6e0e5aa3d0 tempest-VolumesNegativeTest-700443590 tempest-VolumesNegativeTest-700443590-project] 10.222.0.20 "GET /compute/v2.1/servers/b2ca483f-d16b-41a4-97ef-fa182e708ad8" status: 404 len: 111 microversion: 2.1 time: 0.033087 Jul 06 13:57:05.501206 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 561/1113] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:57:05 2022] GET /compute/v2.1/servers/b2ca483f-d16b-41a4-97ef-fa182e708ad8 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 06 13:57:12.690672 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-1e50fe57-3c3e-4bfb-b8db-e39063b88270 tempest-VolumesSnapshotTestJSON-1412015683 tempest-VolumesSnapshotTestJSON-1412015683-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-833654307", "imageRef": "b08481d9-1e39-41e8-97bd-b05a9c35b377", "flavorRef": "452", "networks": [{"uuid": "995c8901-b276-4dfb-8ce7-5546a81a4d42"}]}} {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 06 13:57:12.742380 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.network.neutron [None req-1e50fe57-3c3e-4bfb-b8db-e39063b88270 tempest-VolumesSnapshotTestJSON-1412015683 tempest-VolumesSnapshotTestJSON-1412015683-project] validate_networks() for [('995c8901-b276-4dfb-8ce7-5546a81a4d42', None, None, None, None, None)] {{(pid=124367) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 06 13:57:13.093085 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.virt.hardware [None req-1e50fe57-3c3e-4bfb-b8db-e39063b88270 tempest-VolumesSnapshotTestJSON-1412015683 tempest-VolumesSnapshotTestJSON-1412015683-project] Flavor limits 0:0:0 {{(pid=124367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 06 13:57:13.093507 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.virt.hardware [None req-1e50fe57-3c3e-4bfb-b8db-e39063b88270 tempest-VolumesSnapshotTestJSON-1412015683 tempest-VolumesSnapshotTestJSON-1412015683-project] Image limits 0:0:0 {{(pid=124367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 06 13:57:13.093981 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.virt.hardware [None req-1e50fe57-3c3e-4bfb-b8db-e39063b88270 tempest-VolumesSnapshotTestJSON-1412015683 tempest-VolumesSnapshotTestJSON-1412015683-project] Flavor pref 0:0:0 {{(pid=124367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 06 13:57:13.094389 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.virt.hardware [None req-1e50fe57-3c3e-4bfb-b8db-e39063b88270 tempest-VolumesSnapshotTestJSON-1412015683 tempest-VolumesSnapshotTestJSON-1412015683-project] Image pref 0:0:0 {{(pid=124367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 06 13:57:13.094804 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.virt.hardware [None req-1e50fe57-3c3e-4bfb-b8db-e39063b88270 tempest-VolumesSnapshotTestJSON-1412015683 tempest-VolumesSnapshotTestJSON-1412015683-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 06 13:57:13.103825 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-1e50fe57-3c3e-4bfb-b8db-e39063b88270 tempest-VolumesSnapshotTestJSON-1412015683 tempest-VolumesSnapshotTestJSON-1412015683-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:57:13.104466 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-1e50fe57-3c3e-4bfb-b8db-e39063b88270 tempest-VolumesSnapshotTestJSON-1412015683 tempest-VolumesSnapshotTestJSON-1412015683-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:57:13.105320 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-1e50fe57-3c3e-4bfb-b8db-e39063b88270 tempest-VolumesSnapshotTestJSON-1412015683 tempest-VolumesSnapshotTestJSON-1412015683-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:57:13.105957 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-1e50fe57-3c3e-4bfb-b8db-e39063b88270 tempest-VolumesSnapshotTestJSON-1412015683 tempest-VolumesSnapshotTestJSON-1412015683-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:57:13.124519 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.quota [None req-1e50fe57-3c3e-4bfb-b8db-e39063b88270 tempest-VolumesSnapshotTestJSON-1412015683 tempest-VolumesSnapshotTestJSON-1412015683-project] Getting quotas for project 4349af63ad274dbfad2615fc50446ded. Resources: {'instances', 'cores', 'ram'} {{(pid=124367) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 06 13:57:13.128491 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.quota [None req-1e50fe57-3c3e-4bfb-b8db-e39063b88270 tempest-VolumesSnapshotTestJSON-1412015683 tempest-VolumesSnapshotTestJSON-1412015683-project] Getting quotas for user cce90c0e516c4cc0874e43b14182aa61 and project 4349af63ad274dbfad2615fc50446ded. Resources: {'instances', 'cores', 'ram'} {{(pid=124367) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 06 13:57:13.140807 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-1e50fe57-3c3e-4bfb-b8db-e39063b88270 tempest-VolumesSnapshotTestJSON-1412015683 tempest-VolumesSnapshotTestJSON-1412015683-project] Going to run 1 instances... {{(pid=124367) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 06 13:57:13.143239 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-1e50fe57-3c3e-4bfb-b8db-e39063b88270 tempest-VolumesSnapshotTestJSON-1412015683 tempest-VolumesSnapshotTestJSON-1412015683-project] [instance: 66945654-4f75-4375-b4da-9e0ba0cc800f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b08481d9-1e39-41e8-97bd-b05a9c35b377',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124367) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 06 13:57:13.191716 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-1e50fe57-3c3e-4bfb-b8db-e39063b88270 tempest-VolumesSnapshotTestJSON-1412015683 tempest-VolumesSnapshotTestJSON-1412015683-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.506298 Jul 06 13:57:13.192539 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 553/1114] 10.222.0.20 () {60 vars in 1146 bytes} [Wed Jul 6 13:57:12 2022] POST /compute/v2.1/servers => generated 380 bytes in 508 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 06 13:57:13.202795 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-0e8cf308-7fe2-4c90-9315-cf468869f9de tempest-VolumesSnapshotTestJSON-1412015683 tempest-VolumesSnapshotTestJSON-1412015683-project] Calling method '>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:57:13.203444 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-0e8cf308-7fe2-4c90-9315-cf468869f9de tempest-VolumesSnapshotTestJSON-1412015683 tempest-VolumesSnapshotTestJSON-1412015683-project] [instance: 66945654-4f75-4375-b4da-9e0ba0cc800f] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:57:13.265956 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-0e8cf308-7fe2-4c90-9315-cf468869f9de tempest-VolumesSnapshotTestJSON-1412015683 tempest-VolumesSnapshotTestJSON-1412015683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cce90c0e516c4cc0874e43b14182aa61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4349af63ad274dbfad2615fc50446ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:57:13.272857 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-0e8cf308-7fe2-4c90-9315-cf468869f9de tempest-VolumesSnapshotTestJSON-1412015683 tempest-VolumesSnapshotTestJSON-1412015683-project] 10.222.0.20 "GET /compute/v2.1/servers/66945654-4f75-4375-b4da-9e0ba0cc800f" status: 200 len: 1218 microversion: 2.1 time: 0.074479 Jul 06 13:57:13.273461 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 562/1115] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:57:13 2022] GET /compute/v2.1/servers/66945654-4f75-4375-b4da-9e0ba0cc800f => generated 1218 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:57:14.294883 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-b84b70f7-0b52-4e4f-b53b-ee9d6032271f tempest-VolumesSnapshotTestJSON-1412015683 tempest-VolumesSnapshotTestJSON-1412015683-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:57:14.295756 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-b84b70f7-0b52-4e4f-b53b-ee9d6032271f tempest-VolumesSnapshotTestJSON-1412015683 tempest-VolumesSnapshotTestJSON-1412015683-project] [instance: 66945654-4f75-4375-b4da-9e0ba0cc800f] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:57:14.306630 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-b84b70f7-0b52-4e4f-b53b-ee9d6032271f tempest-VolumesSnapshotTestJSON-1412015683 tempest-VolumesSnapshotTestJSON-1412015683-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:57:14.307161 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-b84b70f7-0b52-4e4f-b53b-ee9d6032271f tempest-VolumesSnapshotTestJSON-1412015683 tempest-VolumesSnapshotTestJSON-1412015683-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:57:14.308036 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-b84b70f7-0b52-4e4f-b53b-ee9d6032271f tempest-VolumesSnapshotTestJSON-1412015683 tempest-VolumesSnapshotTestJSON-1412015683-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:57:14.308539 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-b84b70f7-0b52-4e4f-b53b-ee9d6032271f tempest-VolumesSnapshotTestJSON-1412015683 tempest-VolumesSnapshotTestJSON-1412015683-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:57:14.399377 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-b84b70f7-0b52-4e4f-b53b-ee9d6032271f tempest-VolumesSnapshotTestJSON-1412015683 tempest-VolumesSnapshotTestJSON-1412015683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cce90c0e516c4cc0874e43b14182aa61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4349af63ad274dbfad2615fc50446ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:57:14.408493 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-b84b70f7-0b52-4e4f-b53b-ee9d6032271f tempest-VolumesSnapshotTestJSON-1412015683 tempest-VolumesSnapshotTestJSON-1412015683-project] 10.222.0.20 "GET /compute/v2.1/servers/66945654-4f75-4375-b4da-9e0ba0cc800f" status: 200 len: 1288 microversion: 2.1 time: 0.121543 Jul 06 13:57:14.409112 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 554/1116] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:57:14 2022] GET /compute/v2.1/servers/66945654-4f75-4375-b4da-9e0ba0cc800f => generated 1288 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:57:15.426792 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-8c5b9223-14f2-4a0a-90a6-81725b3a3800 tempest-VolumesSnapshotTestJSON-1412015683 tempest-VolumesSnapshotTestJSON-1412015683-project] Calling method '>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:57:15.427419 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-8c5b9223-14f2-4a0a-90a6-81725b3a3800 tempest-VolumesSnapshotTestJSON-1412015683 tempest-VolumesSnapshotTestJSON-1412015683-project] [instance: 66945654-4f75-4375-b4da-9e0ba0cc800f] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:57:15.434927 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-8c5b9223-14f2-4a0a-90a6-81725b3a3800 tempest-VolumesSnapshotTestJSON-1412015683 tempest-VolumesSnapshotTestJSON-1412015683-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:57:15.435447 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-8c5b9223-14f2-4a0a-90a6-81725b3a3800 tempest-VolumesSnapshotTestJSON-1412015683 tempest-VolumesSnapshotTestJSON-1412015683-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:57:15.436224 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-8c5b9223-14f2-4a0a-90a6-81725b3a3800 tempest-VolumesSnapshotTestJSON-1412015683 tempest-VolumesSnapshotTestJSON-1412015683-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:57:15.436669 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-8c5b9223-14f2-4a0a-90a6-81725b3a3800 tempest-VolumesSnapshotTestJSON-1412015683 tempest-VolumesSnapshotTestJSON-1412015683-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:57:15.569457 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-8c5b9223-14f2-4a0a-90a6-81725b3a3800 tempest-VolumesSnapshotTestJSON-1412015683 tempest-VolumesSnapshotTestJSON-1412015683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cce90c0e516c4cc0874e43b14182aa61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4349af63ad274dbfad2615fc50446ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:57:15.578198 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-8c5b9223-14f2-4a0a-90a6-81725b3a3800 tempest-VolumesSnapshotTestJSON-1412015683 tempest-VolumesSnapshotTestJSON-1412015683-project] 10.222.0.20 "GET /compute/v2.1/servers/66945654-4f75-4375-b4da-9e0ba0cc800f" status: 200 len: 1318 microversion: 2.1 time: 0.155434 Jul 06 13:57:15.579057 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 563/1117] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:57:15 2022] GET /compute/v2.1/servers/66945654-4f75-4375-b4da-9e0ba0cc800f => generated 1318 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:57:15.909699 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [req-03b66e4c-f226-4681-863a-6b729911f7d0 req-11ce677a-4802-485e-a2c2-d7f21c45f234 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "66945654-4f75-4375-b4da-9e0ba0cc800f", "tag": "657b6f46-df3f-4117-bf08-21cc29ec657b"}]} {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 06 13:57:15.921439 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [req-03b66e4c-f226-4681-863a-6b729911f7d0 req-11ce677a-4802-485e-a2c2-d7f21c45f234 service nova] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:57:15.922133 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [req-03b66e4c-f226-4681-863a-6b729911f7d0 req-11ce677a-4802-485e-a2c2-d7f21c45f234 service nova] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:57:15.937708 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.compute.server_external_events [req-03b66e4c-f226-4681-863a-6b729911f7d0 req-11ce677a-4802-485e-a2c2-d7f21c45f234 service nova] Creating event network-changed:657b6f46-df3f-4117-bf08-21cc29ec657b for instance 66945654-4f75-4375-b4da-9e0ba0cc800f on hv-cinder-81914 Jul 06 13:57:15.942629 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [req-03b66e4c-f226-4681-863a-6b729911f7d0 req-11ce677a-4802-485e-a2c2-d7f21c45f234 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036628 Jul 06 13:57:15.943224 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 555/1118] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 6 13:57:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 06 13:57:16.595925 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-f9d9424b-f9c3-4809-9e96-5b0a9d3a3488 tempest-VolumesSnapshotTestJSON-1412015683 tempest-VolumesSnapshotTestJSON-1412015683-project] Calling method '>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:57:16.596473 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-f9d9424b-f9c3-4809-9e96-5b0a9d3a3488 tempest-VolumesSnapshotTestJSON-1412015683 tempest-VolumesSnapshotTestJSON-1412015683-project] [instance: 66945654-4f75-4375-b4da-9e0ba0cc800f] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:57:16.602990 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-f9d9424b-f9c3-4809-9e96-5b0a9d3a3488 tempest-VolumesSnapshotTestJSON-1412015683 tempest-VolumesSnapshotTestJSON-1412015683-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:57:16.603443 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-f9d9424b-f9c3-4809-9e96-5b0a9d3a3488 tempest-VolumesSnapshotTestJSON-1412015683 tempest-VolumesSnapshotTestJSON-1412015683-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:57:16.604211 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-f9d9424b-f9c3-4809-9e96-5b0a9d3a3488 tempest-VolumesSnapshotTestJSON-1412015683 tempest-VolumesSnapshotTestJSON-1412015683-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:57:16.604648 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-f9d9424b-f9c3-4809-9e96-5b0a9d3a3488 tempest-VolumesSnapshotTestJSON-1412015683 tempest-VolumesSnapshotTestJSON-1412015683-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:57:16.745978 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-f9d9424b-f9c3-4809-9e96-5b0a9d3a3488 tempest-VolumesSnapshotTestJSON-1412015683 tempest-VolumesSnapshotTestJSON-1412015683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cce90c0e516c4cc0874e43b14182aa61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4349af63ad274dbfad2615fc50446ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:57:16.753381 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-f9d9424b-f9c3-4809-9e96-5b0a9d3a3488 tempest-VolumesSnapshotTestJSON-1412015683 tempest-VolumesSnapshotTestJSON-1412015683-project] 10.222.0.20 "GET /compute/v2.1/servers/66945654-4f75-4375-b4da-9e0ba0cc800f" status: 200 len: 1318 microversion: 2.1 time: 0.162034 Jul 06 13:57:16.753944 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 564/1119] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:57:16 2022] GET /compute/v2.1/servers/66945654-4f75-4375-b4da-9e0ba0cc800f => generated 1318 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:57:17.769968 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-de0f2002-52cc-4db3-9e7b-0351e858389e tempest-VolumesSnapshotTestJSON-1412015683 tempest-VolumesSnapshotTestJSON-1412015683-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:57:17.770632 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-de0f2002-52cc-4db3-9e7b-0351e858389e tempest-VolumesSnapshotTestJSON-1412015683 tempest-VolumesSnapshotTestJSON-1412015683-project] [instance: 66945654-4f75-4375-b4da-9e0ba0cc800f] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:57:17.777266 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-de0f2002-52cc-4db3-9e7b-0351e858389e tempest-VolumesSnapshotTestJSON-1412015683 tempest-VolumesSnapshotTestJSON-1412015683-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:57:17.777695 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-de0f2002-52cc-4db3-9e7b-0351e858389e tempest-VolumesSnapshotTestJSON-1412015683 tempest-VolumesSnapshotTestJSON-1412015683-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:57:17.778454 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-de0f2002-52cc-4db3-9e7b-0351e858389e tempest-VolumesSnapshotTestJSON-1412015683 tempest-VolumesSnapshotTestJSON-1412015683-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:57:17.778906 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-de0f2002-52cc-4db3-9e7b-0351e858389e tempest-VolumesSnapshotTestJSON-1412015683 tempest-VolumesSnapshotTestJSON-1412015683-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:57:17.916449 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-de0f2002-52cc-4db3-9e7b-0351e858389e tempest-VolumesSnapshotTestJSON-1412015683 tempest-VolumesSnapshotTestJSON-1412015683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cce90c0e516c4cc0874e43b14182aa61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4349af63ad274dbfad2615fc50446ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:57:17.924565 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-de0f2002-52cc-4db3-9e7b-0351e858389e tempest-VolumesSnapshotTestJSON-1412015683 tempest-VolumesSnapshotTestJSON-1412015683-project] 10.222.0.20 "GET /compute/v2.1/servers/66945654-4f75-4375-b4da-9e0ba0cc800f" status: 200 len: 1318 microversion: 2.1 time: 0.158741 Jul 06 13:57:17.925215 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 556/1120] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:57:17 2022] GET /compute/v2.1/servers/66945654-4f75-4375-b4da-9e0ba0cc800f => generated 1318 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:57:18.942045 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-5c27e5f0-34a5-4d34-b12b-e1b5cb7ccf8a tempest-VolumesSnapshotTestJSON-1412015683 tempest-VolumesSnapshotTestJSON-1412015683-project] Calling method '>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:57:18.942666 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-5c27e5f0-34a5-4d34-b12b-e1b5cb7ccf8a tempest-VolumesSnapshotTestJSON-1412015683 tempest-VolumesSnapshotTestJSON-1412015683-project] [instance: 66945654-4f75-4375-b4da-9e0ba0cc800f] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:57:18.949171 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-5c27e5f0-34a5-4d34-b12b-e1b5cb7ccf8a tempest-VolumesSnapshotTestJSON-1412015683 tempest-VolumesSnapshotTestJSON-1412015683-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:57:18.949626 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-5c27e5f0-34a5-4d34-b12b-e1b5cb7ccf8a tempest-VolumesSnapshotTestJSON-1412015683 tempest-VolumesSnapshotTestJSON-1412015683-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:57:18.950393 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-5c27e5f0-34a5-4d34-b12b-e1b5cb7ccf8a tempest-VolumesSnapshotTestJSON-1412015683 tempest-VolumesSnapshotTestJSON-1412015683-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:57:18.951464 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-5c27e5f0-34a5-4d34-b12b-e1b5cb7ccf8a tempest-VolumesSnapshotTestJSON-1412015683 tempest-VolumesSnapshotTestJSON-1412015683-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:57:19.077167 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-5c27e5f0-34a5-4d34-b12b-e1b5cb7ccf8a tempest-VolumesSnapshotTestJSON-1412015683 tempest-VolumesSnapshotTestJSON-1412015683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cce90c0e516c4cc0874e43b14182aa61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4349af63ad274dbfad2615fc50446ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:57:19.084789 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-5c27e5f0-34a5-4d34-b12b-e1b5cb7ccf8a tempest-VolumesSnapshotTestJSON-1412015683 tempest-VolumesSnapshotTestJSON-1412015683-project] 10.222.0.20 "GET /compute/v2.1/servers/66945654-4f75-4375-b4da-9e0ba0cc800f" status: 200 len: 1318 microversion: 2.1 time: 0.146541 Jul 06 13:57:19.085389 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 565/1121] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:57:18 2022] GET /compute/v2.1/servers/66945654-4f75-4375-b4da-9e0ba0cc800f => generated 1318 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:57:20.101775 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-ccc80eba-66d1-413e-87cd-3184b9927fcf tempest-VolumesSnapshotTestJSON-1412015683 tempest-VolumesSnapshotTestJSON-1412015683-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:57:20.102413 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-ccc80eba-66d1-413e-87cd-3184b9927fcf tempest-VolumesSnapshotTestJSON-1412015683 tempest-VolumesSnapshotTestJSON-1412015683-project] [instance: 66945654-4f75-4375-b4da-9e0ba0cc800f] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:57:20.108951 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-ccc80eba-66d1-413e-87cd-3184b9927fcf tempest-VolumesSnapshotTestJSON-1412015683 tempest-VolumesSnapshotTestJSON-1412015683-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:57:20.109434 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-ccc80eba-66d1-413e-87cd-3184b9927fcf tempest-VolumesSnapshotTestJSON-1412015683 tempest-VolumesSnapshotTestJSON-1412015683-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:57:20.110199 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-ccc80eba-66d1-413e-87cd-3184b9927fcf tempest-VolumesSnapshotTestJSON-1412015683 tempest-VolumesSnapshotTestJSON-1412015683-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:57:20.110633 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-ccc80eba-66d1-413e-87cd-3184b9927fcf tempest-VolumesSnapshotTestJSON-1412015683 tempest-VolumesSnapshotTestJSON-1412015683-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:57:20.238105 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-ccc80eba-66d1-413e-87cd-3184b9927fcf tempest-VolumesSnapshotTestJSON-1412015683 tempest-VolumesSnapshotTestJSON-1412015683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cce90c0e516c4cc0874e43b14182aa61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4349af63ad274dbfad2615fc50446ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:57:20.245471 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-ccc80eba-66d1-413e-87cd-3184b9927fcf tempest-VolumesSnapshotTestJSON-1412015683 tempest-VolumesSnapshotTestJSON-1412015683-project] 10.222.0.20 "GET /compute/v2.1/servers/66945654-4f75-4375-b4da-9e0ba0cc800f" status: 200 len: 1318 microversion: 2.1 time: 0.147588 Jul 06 13:57:20.246029 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 557/1122] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:57:20 2022] GET /compute/v2.1/servers/66945654-4f75-4375-b4da-9e0ba0cc800f => generated 1318 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:57:21.262571 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-bc304a5c-8d69-42ce-aded-8fe988cded82 tempest-VolumesSnapshotTestJSON-1412015683 tempest-VolumesSnapshotTestJSON-1412015683-project] Calling method '>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:57:21.263699 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-bc304a5c-8d69-42ce-aded-8fe988cded82 tempest-VolumesSnapshotTestJSON-1412015683 tempest-VolumesSnapshotTestJSON-1412015683-project] [instance: 66945654-4f75-4375-b4da-9e0ba0cc800f] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:57:21.270095 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-bc304a5c-8d69-42ce-aded-8fe988cded82 tempest-VolumesSnapshotTestJSON-1412015683 tempest-VolumesSnapshotTestJSON-1412015683-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:57:21.270544 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-bc304a5c-8d69-42ce-aded-8fe988cded82 tempest-VolumesSnapshotTestJSON-1412015683 tempest-VolumesSnapshotTestJSON-1412015683-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:57:21.271301 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-bc304a5c-8d69-42ce-aded-8fe988cded82 tempest-VolumesSnapshotTestJSON-1412015683 tempest-VolumesSnapshotTestJSON-1412015683-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:57:21.271736 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-bc304a5c-8d69-42ce-aded-8fe988cded82 tempest-VolumesSnapshotTestJSON-1412015683 tempest-VolumesSnapshotTestJSON-1412015683-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:57:21.398605 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-bc304a5c-8d69-42ce-aded-8fe988cded82 tempest-VolumesSnapshotTestJSON-1412015683 tempest-VolumesSnapshotTestJSON-1412015683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cce90c0e516c4cc0874e43b14182aa61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4349af63ad274dbfad2615fc50446ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:57:21.407310 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-bc304a5c-8d69-42ce-aded-8fe988cded82 tempest-VolumesSnapshotTestJSON-1412015683 tempest-VolumesSnapshotTestJSON-1412015683-project] 10.222.0.20 "GET /compute/v2.1/servers/66945654-4f75-4375-b4da-9e0ba0cc800f" status: 200 len: 1318 microversion: 2.1 time: 0.148566 Jul 06 13:57:21.407867 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 566/1123] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:57:21 2022] GET /compute/v2.1/servers/66945654-4f75-4375-b4da-9e0ba0cc800f => generated 1318 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:57:22.423790 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-0a7aa2c5-6663-4556-8524-01546b631d97 tempest-VolumesSnapshotTestJSON-1412015683 tempest-VolumesSnapshotTestJSON-1412015683-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:57:22.424404 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-0a7aa2c5-6663-4556-8524-01546b631d97 tempest-VolumesSnapshotTestJSON-1412015683 tempest-VolumesSnapshotTestJSON-1412015683-project] [instance: 66945654-4f75-4375-b4da-9e0ba0cc800f] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:57:22.431888 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-0a7aa2c5-6663-4556-8524-01546b631d97 tempest-VolumesSnapshotTestJSON-1412015683 tempest-VolumesSnapshotTestJSON-1412015683-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:57:22.432340 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-0a7aa2c5-6663-4556-8524-01546b631d97 tempest-VolumesSnapshotTestJSON-1412015683 tempest-VolumesSnapshotTestJSON-1412015683-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:57:22.433146 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-0a7aa2c5-6663-4556-8524-01546b631d97 tempest-VolumesSnapshotTestJSON-1412015683 tempest-VolumesSnapshotTestJSON-1412015683-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:57:22.433584 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-0a7aa2c5-6663-4556-8524-01546b631d97 tempest-VolumesSnapshotTestJSON-1412015683 tempest-VolumesSnapshotTestJSON-1412015683-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:57:22.566850 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-0a7aa2c5-6663-4556-8524-01546b631d97 tempest-VolumesSnapshotTestJSON-1412015683 tempest-VolumesSnapshotTestJSON-1412015683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cce90c0e516c4cc0874e43b14182aa61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4349af63ad274dbfad2615fc50446ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:57:22.574815 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-0a7aa2c5-6663-4556-8524-01546b631d97 tempest-VolumesSnapshotTestJSON-1412015683 tempest-VolumesSnapshotTestJSON-1412015683-project] 10.222.0.20 "GET /compute/v2.1/servers/66945654-4f75-4375-b4da-9e0ba0cc800f" status: 200 len: 1318 microversion: 2.1 time: 0.154980 Jul 06 13:57:22.575642 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 558/1124] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:57:22 2022] GET /compute/v2.1/servers/66945654-4f75-4375-b4da-9e0ba0cc800f => generated 1318 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:57:23.591949 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-d0c133ee-a967-4217-a33c-40fe2111060d tempest-VolumesSnapshotTestJSON-1412015683 tempest-VolumesSnapshotTestJSON-1412015683-project] Calling method '>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:57:23.592721 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-d0c133ee-a967-4217-a33c-40fe2111060d tempest-VolumesSnapshotTestJSON-1412015683 tempest-VolumesSnapshotTestJSON-1412015683-project] [instance: 66945654-4f75-4375-b4da-9e0ba0cc800f] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:57:23.595114 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG dbcounter [-] [124368] Writing DB stats nova_cell0:SELECT=2 {{(pid=124368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:57:23.600695 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-d0c133ee-a967-4217-a33c-40fe2111060d tempest-VolumesSnapshotTestJSON-1412015683 tempest-VolumesSnapshotTestJSON-1412015683-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:57:23.601186 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-d0c133ee-a967-4217-a33c-40fe2111060d tempest-VolumesSnapshotTestJSON-1412015683 tempest-VolumesSnapshotTestJSON-1412015683-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:57:23.601975 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-d0c133ee-a967-4217-a33c-40fe2111060d tempest-VolumesSnapshotTestJSON-1412015683 tempest-VolumesSnapshotTestJSON-1412015683-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:57:23.602536 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-d0c133ee-a967-4217-a33c-40fe2111060d tempest-VolumesSnapshotTestJSON-1412015683 tempest-VolumesSnapshotTestJSON-1412015683-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:57:23.739281 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-d0c133ee-a967-4217-a33c-40fe2111060d tempest-VolumesSnapshotTestJSON-1412015683 tempest-VolumesSnapshotTestJSON-1412015683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cce90c0e516c4cc0874e43b14182aa61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4349af63ad274dbfad2615fc50446ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:57:23.747895 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-d0c133ee-a967-4217-a33c-40fe2111060d tempest-VolumesSnapshotTestJSON-1412015683 tempest-VolumesSnapshotTestJSON-1412015683-project] 10.222.0.20 "GET /compute/v2.1/servers/66945654-4f75-4375-b4da-9e0ba0cc800f" status: 200 len: 1318 microversion: 2.1 time: 0.159833 Jul 06 13:57:23.748568 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 567/1125] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:57:23 2022] GET /compute/v2.1/servers/66945654-4f75-4375-b4da-9e0ba0cc800f => generated 1318 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:57:24.066928 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [req-180eebec-3115-4460-b2b0-03bb7bc159b8 req-35212564-c82c-4886-810e-ba019ec294c7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "66945654-4f75-4375-b4da-9e0ba0cc800f", "name": "network-vif-plugged", "status": "completed", "tag": "657b6f46-df3f-4117-bf08-21cc29ec657b"}]} {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 06 13:57:24.070463 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG dbcounter [-] [124367] Writing DB stats nova_cell0:SELECT=2 {{(pid=124367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:57:24.071211 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG dbcounter [-] [124367] Writing DB stats nova_cell0:SELECT=6 {{(pid=124367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:57:24.080171 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [req-180eebec-3115-4460-b2b0-03bb7bc159b8 req-35212564-c82c-4886-810e-ba019ec294c7 service nova] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:57:24.080621 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [req-180eebec-3115-4460-b2b0-03bb7bc159b8 req-35212564-c82c-4886-810e-ba019ec294c7 service nova] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:57:24.094747 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.compute.server_external_events [req-180eebec-3115-4460-b2b0-03bb7bc159b8 req-35212564-c82c-4886-810e-ba019ec294c7 service nova] Creating event network-vif-plugged:657b6f46-df3f-4117-bf08-21cc29ec657b for instance 66945654-4f75-4375-b4da-9e0ba0cc800f on hv-cinder-81914 Jul 06 13:57:24.100566 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [req-180eebec-3115-4460-b2b0-03bb7bc159b8 req-35212564-c82c-4886-810e-ba019ec294c7 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037419 Jul 06 13:57:24.101210 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 559/1126] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 6 13:57:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 06 13:57:24.765287 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-7da1aaf9-14d5-4766-a4be-fd3b4ed04ae2 tempest-VolumesSnapshotTestJSON-1412015683 tempest-VolumesSnapshotTestJSON-1412015683-project] Calling method '>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:57:24.765910 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-7da1aaf9-14d5-4766-a4be-fd3b4ed04ae2 tempest-VolumesSnapshotTestJSON-1412015683 tempest-VolumesSnapshotTestJSON-1412015683-project] [instance: 66945654-4f75-4375-b4da-9e0ba0cc800f] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:57:24.772311 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-7da1aaf9-14d5-4766-a4be-fd3b4ed04ae2 tempest-VolumesSnapshotTestJSON-1412015683 tempest-VolumesSnapshotTestJSON-1412015683-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:57:24.772759 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-7da1aaf9-14d5-4766-a4be-fd3b4ed04ae2 tempest-VolumesSnapshotTestJSON-1412015683 tempest-VolumesSnapshotTestJSON-1412015683-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:57:24.773566 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-7da1aaf9-14d5-4766-a4be-fd3b4ed04ae2 tempest-VolumesSnapshotTestJSON-1412015683 tempest-VolumesSnapshotTestJSON-1412015683-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:57:24.774006 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-7da1aaf9-14d5-4766-a4be-fd3b4ed04ae2 tempest-VolumesSnapshotTestJSON-1412015683 tempest-VolumesSnapshotTestJSON-1412015683-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:57:24.903035 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-7da1aaf9-14d5-4766-a4be-fd3b4ed04ae2 tempest-VolumesSnapshotTestJSON-1412015683 tempest-VolumesSnapshotTestJSON-1412015683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cce90c0e516c4cc0874e43b14182aa61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4349af63ad274dbfad2615fc50446ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:57:24.910961 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-7da1aaf9-14d5-4766-a4be-fd3b4ed04ae2 tempest-VolumesSnapshotTestJSON-1412015683 tempest-VolumesSnapshotTestJSON-1412015683-project] 10.222.0.20 "GET /compute/v2.1/servers/66945654-4f75-4375-b4da-9e0ba0cc800f" status: 200 len: 1318 microversion: 2.1 time: 0.150262 Jul 06 13:57:24.911524 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 568/1127] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:57:24 2022] GET /compute/v2.1/servers/66945654-4f75-4375-b4da-9e0ba0cc800f => generated 1318 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:57:25.927932 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-65fd32b8-955e-418a-b53d-7045b6ec9f47 tempest-VolumesSnapshotTestJSON-1412015683 tempest-VolumesSnapshotTestJSON-1412015683-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:57:25.928615 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-65fd32b8-955e-418a-b53d-7045b6ec9f47 tempest-VolumesSnapshotTestJSON-1412015683 tempest-VolumesSnapshotTestJSON-1412015683-project] [instance: 66945654-4f75-4375-b4da-9e0ba0cc800f] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:57:25.936069 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-65fd32b8-955e-418a-b53d-7045b6ec9f47 tempest-VolumesSnapshotTestJSON-1412015683 tempest-VolumesSnapshotTestJSON-1412015683-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:57:25.936511 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-65fd32b8-955e-418a-b53d-7045b6ec9f47 tempest-VolumesSnapshotTestJSON-1412015683 tempest-VolumesSnapshotTestJSON-1412015683-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:57:25.937307 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-65fd32b8-955e-418a-b53d-7045b6ec9f47 tempest-VolumesSnapshotTestJSON-1412015683 tempest-VolumesSnapshotTestJSON-1412015683-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:57:25.937742 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-65fd32b8-955e-418a-b53d-7045b6ec9f47 tempest-VolumesSnapshotTestJSON-1412015683 tempest-VolumesSnapshotTestJSON-1412015683-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:57:26.067645 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-65fd32b8-955e-418a-b53d-7045b6ec9f47 tempest-VolumesSnapshotTestJSON-1412015683 tempest-VolumesSnapshotTestJSON-1412015683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cce90c0e516c4cc0874e43b14182aa61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4349af63ad274dbfad2615fc50446ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:57:26.075084 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-65fd32b8-955e-418a-b53d-7045b6ec9f47 tempest-VolumesSnapshotTestJSON-1412015683 tempest-VolumesSnapshotTestJSON-1412015683-project] 10.222.0.20 "GET /compute/v2.1/servers/66945654-4f75-4375-b4da-9e0ba0cc800f" status: 200 len: 1318 microversion: 2.1 time: 0.151636 Jul 06 13:57:26.075668 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 560/1128] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:57:25 2022] GET /compute/v2.1/servers/66945654-4f75-4375-b4da-9e0ba0cc800f => generated 1318 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:57:27.092013 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-6c761eb6-c29c-432a-9e65-e26b3aa51312 tempest-VolumesSnapshotTestJSON-1412015683 tempest-VolumesSnapshotTestJSON-1412015683-project] Calling method '>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:57:27.092591 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-6c761eb6-c29c-432a-9e65-e26b3aa51312 tempest-VolumesSnapshotTestJSON-1412015683 tempest-VolumesSnapshotTestJSON-1412015683-project] [instance: 66945654-4f75-4375-b4da-9e0ba0cc800f] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:57:27.099140 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-6c761eb6-c29c-432a-9e65-e26b3aa51312 tempest-VolumesSnapshotTestJSON-1412015683 tempest-VolumesSnapshotTestJSON-1412015683-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:57:27.099594 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-6c761eb6-c29c-432a-9e65-e26b3aa51312 tempest-VolumesSnapshotTestJSON-1412015683 tempest-VolumesSnapshotTestJSON-1412015683-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:57:27.100363 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-6c761eb6-c29c-432a-9e65-e26b3aa51312 tempest-VolumesSnapshotTestJSON-1412015683 tempest-VolumesSnapshotTestJSON-1412015683-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:57:27.100807 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-6c761eb6-c29c-432a-9e65-e26b3aa51312 tempest-VolumesSnapshotTestJSON-1412015683 tempest-VolumesSnapshotTestJSON-1412015683-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:57:27.457135 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-6c761eb6-c29c-432a-9e65-e26b3aa51312 tempest-VolumesSnapshotTestJSON-1412015683 tempest-VolumesSnapshotTestJSON-1412015683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cce90c0e516c4cc0874e43b14182aa61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4349af63ad274dbfad2615fc50446ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:57:27.464577 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-6c761eb6-c29c-432a-9e65-e26b3aa51312 tempest-VolumesSnapshotTestJSON-1412015683 tempest-VolumesSnapshotTestJSON-1412015683-project] 10.222.0.20 "GET /compute/v2.1/servers/66945654-4f75-4375-b4da-9e0ba0cc800f" status: 200 len: 1507 microversion: 2.1 time: 0.376725 Jul 06 13:57:27.465166 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 569/1129] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:57:27 2022] GET /compute/v2.1/servers/66945654-4f75-4375-b4da-9e0ba0cc800f => generated 1507 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:57:45.361823 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-26cf1ccd-6096-449e-a0ba-c43ecfaf94a4 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:57:45.362364 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-26cf1ccd-6096-449e-a0ba-c43ecfaf94a4 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] [instance: 4c0c4bb6-269f-46bc-b460-7d0299277753] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:57:45.364384 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG dbcounter [-] [124367] Writing DB stats nova_api:SELECT=32,nova_api:INSERT=3 {{(pid=124367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:57:45.365210 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG dbcounter [-] [124367] Writing DB stats nova_cell1:SELECT=43 {{(pid=124367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:57:45.371394 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-26cf1ccd-6096-449e-a0ba-c43ecfaf94a4 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:57:45.371843 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-26cf1ccd-6096-449e-a0ba-c43ecfaf94a4 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:57:45.372607 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-26cf1ccd-6096-449e-a0ba-c43ecfaf94a4 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:57:45.373072 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-26cf1ccd-6096-449e-a0ba-c43ecfaf94a4 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:57:45.401715 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-26cf1ccd-6096-449e-a0ba-c43ecfaf94a4 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] 10.222.0.20 "GET /compute/v2.1/servers/4c0c4bb6-269f-46bc-b460-7d0299277753/os-volume_attachments/c9da8df1-73a6-4b95-9f0d-980f961c7ec9" status: 200 len: 194 microversion: 2.20 time: 0.044460 Jul 06 13:57:45.402280 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 561/1130] 10.222.0.20 () {60 vars in 1453 bytes} [Wed Jul 6 13:57:45 2022] GET /compute/v2.1/servers/4c0c4bb6-269f-46bc-b460-7d0299277753/os-volume_attachments/c9da8df1-73a6-4b95-9f0d-980f961c7ec9 => generated 194 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 06 13:57:45.475882 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-ccb4722d-8e49-41ea-af36-bccae6b72d91 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Calling method '>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:57:45.476399 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-ccb4722d-8e49-41ea-af36-bccae6b72d91 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] [instance: 4c0c4bb6-269f-46bc-b460-7d0299277753] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:57:45.478828 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG dbcounter [-] [124368] Writing DB stats nova_api:SELECT=30,nova_api:UPDATE=1 {{(pid=124368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:57:45.479633 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG dbcounter [-] [124368] Writing DB stats nova_cell1:SELECT=67,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:57:45.486600 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-ccb4722d-8e49-41ea-af36-bccae6b72d91 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:57:45.487059 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-ccb4722d-8e49-41ea-af36-bccae6b72d91 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:57:45.487835 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-ccb4722d-8e49-41ea-af36-bccae6b72d91 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:57:45.488281 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-ccb4722d-8e49-41ea-af36-bccae6b72d91 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:57:45.573249 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.objects.instance [None req-ccb4722d-8e49-41ea-af36-bccae6b72d91 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lazy-loading 'services' on Instance uuid 4c0c4bb6-269f-46bc-b460-7d0299277753 {{(pid=124368) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 06 13:57:45.645133 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-ccb4722d-8e49-41ea-af36-bccae6b72d91 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] 10.222.0.20 "DELETE /compute/v2.1/servers/4c0c4bb6-269f-46bc-b460-7d0299277753/os-volume_attachments/c9da8df1-73a6-4b95-9f0d-980f961c7ec9" status: 202 len: 0 microversion: 2.20 time: 0.173007 Jul 06 13:57:45.645925 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 570/1131] 10.222.0.20 () {60 vars in 1456 bytes} [Wed Jul 6 13:57:45 2022] DELETE /compute/v2.1/servers/4c0c4bb6-269f-46bc-b460-7d0299277753/os-volume_attachments/c9da8df1-73a6-4b95-9f0d-980f961c7ec9 => generated 0 bytes in 176 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Jul 06 13:57:45.654355 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-bda071d0-5119-47f2-8bc8-d0505fcd1e9e tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:57:45.655273 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-bda071d0-5119-47f2-8bc8-d0505fcd1e9e tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] [instance: 4c0c4bb6-269f-46bc-b460-7d0299277753] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:57:45.662307 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-bda071d0-5119-47f2-8bc8-d0505fcd1e9e tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:57:45.662977 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-bda071d0-5119-47f2-8bc8-d0505fcd1e9e tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:57:45.663966 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-bda071d0-5119-47f2-8bc8-d0505fcd1e9e tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:57:45.664620 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-bda071d0-5119-47f2-8bc8-d0505fcd1e9e tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:57:45.695836 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-bda071d0-5119-47f2-8bc8-d0505fcd1e9e tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] 10.222.0.20 "GET /compute/v2.1/servers/4c0c4bb6-269f-46bc-b460-7d0299277753/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045398 Jul 06 13:57:45.696395 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 562/1132] 10.222.0.20 () {60 vars in 1342 bytes} [Wed Jul 6 13:57:45 2022] GET /compute/v2.1/servers/4c0c4bb6-269f-46bc-b460-7d0299277753/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 06 13:57:46.708462 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-684e2f92-13a4-4039-a37e-922f2d93c9ff tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Calling method '>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:57:46.710116 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-684e2f92-13a4-4039-a37e-922f2d93c9ff tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] [instance: 4c0c4bb6-269f-46bc-b460-7d0299277753] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:57:46.716856 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-684e2f92-13a4-4039-a37e-922f2d93c9ff tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:57:46.717174 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-684e2f92-13a4-4039-a37e-922f2d93c9ff tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:57:46.717960 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-684e2f92-13a4-4039-a37e-922f2d93c9ff tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:57:46.718371 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-684e2f92-13a4-4039-a37e-922f2d93c9ff tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:57:46.750145 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-684e2f92-13a4-4039-a37e-922f2d93c9ff tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] 10.222.0.20 "GET /compute/v2.1/servers/4c0c4bb6-269f-46bc-b460-7d0299277753/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046504 Jul 06 13:57:46.750708 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 571/1133] 10.222.0.20 () {60 vars in 1342 bytes} [Wed Jul 6 13:57:46 2022] GET /compute/v2.1/servers/4c0c4bb6-269f-46bc-b460-7d0299277753/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 06 13:57:47.762052 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-e7ea973c-8dc1-45b4-8397-53bbbc1dd657 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:57:47.762993 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-e7ea973c-8dc1-45b4-8397-53bbbc1dd657 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] [instance: 4c0c4bb6-269f-46bc-b460-7d0299277753] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:57:47.769580 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-e7ea973c-8dc1-45b4-8397-53bbbc1dd657 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:57:47.770056 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-e7ea973c-8dc1-45b4-8397-53bbbc1dd657 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:57:47.770813 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-e7ea973c-8dc1-45b4-8397-53bbbc1dd657 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:57:47.771240 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-e7ea973c-8dc1-45b4-8397-53bbbc1dd657 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:57:47.800078 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-e7ea973c-8dc1-45b4-8397-53bbbc1dd657 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] 10.222.0.20 "GET /compute/v2.1/servers/4c0c4bb6-269f-46bc-b460-7d0299277753/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.041963 Jul 06 13:57:47.800618 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 563/1134] 10.222.0.20 () {60 vars in 1342 bytes} [Wed Jul 6 13:57:47 2022] GET /compute/v2.1/servers/4c0c4bb6-269f-46bc-b460-7d0299277753/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:57:47.859511 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-d02b9ad8-ee80-49cc-903a-9c125e8ac7b8 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Calling method '>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:57:47.860021 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-d02b9ad8-ee80-49cc-903a-9c125e8ac7b8 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] [instance: 4c0c4bb6-269f-46bc-b460-7d0299277753] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:57:47.867284 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-d02b9ad8-ee80-49cc-903a-9c125e8ac7b8 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:57:47.867736 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-d02b9ad8-ee80-49cc-903a-9c125e8ac7b8 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:57:47.868506 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-d02b9ad8-ee80-49cc-903a-9c125e8ac7b8 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:57:47.868944 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-d02b9ad8-ee80-49cc-903a-9c125e8ac7b8 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:57:47.893956 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-d02b9ad8-ee80-49cc-903a-9c125e8ac7b8 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] [instance: 4c0c4bb6-269f-46bc-b460-7d0299277753] Going to try to terminate instance {{(pid=124368) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 06 13:57:47.966833 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-d02b9ad8-ee80-49cc-903a-9c125e8ac7b8 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] 10.222.0.20 "DELETE /compute/v2.1/servers/4c0c4bb6-269f-46bc-b460-7d0299277753" status: 204 len: 0 microversion: 2.20 time: 0.110864 Jul 06 13:57:47.967413 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 572/1135] 10.222.0.20 () {60 vars in 1279 bytes} [Wed Jul 6 13:57:47 2022] DELETE /compute/v2.1/servers/4c0c4bb6-269f-46bc-b460-7d0299277753 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 06 13:57:47.976087 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-ac56f98a-fdc0-4761-a549-3f3d7672b578 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:57:47.976695 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-ac56f98a-fdc0-4761-a549-3f3d7672b578 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] [instance: 4c0c4bb6-269f-46bc-b460-7d0299277753] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:57:47.982721 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-ac56f98a-fdc0-4761-a549-3f3d7672b578 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:57:47.983176 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-ac56f98a-fdc0-4761-a549-3f3d7672b578 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:57:47.983938 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-ac56f98a-fdc0-4761-a549-3f3d7672b578 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:57:47.984372 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-ac56f98a-fdc0-4761-a549-3f3d7672b578 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:57:48.121603 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-ac56f98a-fdc0-4761-a549-3f3d7672b578 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c85251638bc64deca16008b696b11ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3edb8d53184b98b7055ffc145f186d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:57:48.129890 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-ac56f98a-fdc0-4761-a549-3f3d7672b578 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c85251638bc64deca16008b696b11ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3edb8d53184b98b7055ffc145f186d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:57:48.131391 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-ac56f98a-fdc0-4761-a549-3f3d7672b578 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c85251638bc64deca16008b696b11ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3edb8d53184b98b7055ffc145f186d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:57:48.132539 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-ac56f98a-fdc0-4761-a549-3f3d7672b578 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] 10.222.0.20 "GET /compute/v2.1/servers/4c0c4bb6-269f-46bc-b460-7d0299277753" status: 200 len: 1723 microversion: 2.20 time: 0.160408 Jul 06 13:57:48.133120 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 564/1136] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 6 13:57:47 2022] GET /compute/v2.1/servers/4c0c4bb6-269f-46bc-b460-7d0299277753 => generated 1723 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 06 13:57:49.152168 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-b4b64d9c-a03f-408e-96fd-b8b403faa1c1 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Calling method '>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:57:49.152784 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-b4b64d9c-a03f-408e-96fd-b8b403faa1c1 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] [instance: 4c0c4bb6-269f-46bc-b460-7d0299277753] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:57:49.159292 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-b4b64d9c-a03f-408e-96fd-b8b403faa1c1 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:57:49.159737 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-b4b64d9c-a03f-408e-96fd-b8b403faa1c1 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:57:49.160529 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-b4b64d9c-a03f-408e-96fd-b8b403faa1c1 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:57:49.160960 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-b4b64d9c-a03f-408e-96fd-b8b403faa1c1 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:57:49.288734 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-b4b64d9c-a03f-408e-96fd-b8b403faa1c1 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c85251638bc64deca16008b696b11ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3edb8d53184b98b7055ffc145f186d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:57:49.296753 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-b4b64d9c-a03f-408e-96fd-b8b403faa1c1 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c85251638bc64deca16008b696b11ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3edb8d53184b98b7055ffc145f186d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:57:49.298946 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-b4b64d9c-a03f-408e-96fd-b8b403faa1c1 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c85251638bc64deca16008b696b11ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3edb8d53184b98b7055ffc145f186d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:57:49.300111 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-b4b64d9c-a03f-408e-96fd-b8b403faa1c1 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] 10.222.0.20 "GET /compute/v2.1/servers/4c0c4bb6-269f-46bc-b460-7d0299277753" status: 200 len: 1723 microversion: 2.20 time: 0.152310 Jul 06 13:57:49.300663 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 573/1137] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 6 13:57:49 2022] GET /compute/v2.1/servers/4c0c4bb6-269f-46bc-b460-7d0299277753 => generated 1723 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 06 13:57:50.319069 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-8ad7434c-f3f1-4a87-be69-afa796c3e839 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:57:50.319667 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-8ad7434c-f3f1-4a87-be69-afa796c3e839 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] [instance: 4c0c4bb6-269f-46bc-b460-7d0299277753] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:57:50.326171 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-8ad7434c-f3f1-4a87-be69-afa796c3e839 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:57:50.326614 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-8ad7434c-f3f1-4a87-be69-afa796c3e839 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:57:50.327392 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-8ad7434c-f3f1-4a87-be69-afa796c3e839 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:57:50.327824 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-8ad7434c-f3f1-4a87-be69-afa796c3e839 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:57:50.454774 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-8ad7434c-f3f1-4a87-be69-afa796c3e839 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c85251638bc64deca16008b696b11ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3edb8d53184b98b7055ffc145f186d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:57:50.462723 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-8ad7434c-f3f1-4a87-be69-afa796c3e839 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c85251638bc64deca16008b696b11ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3edb8d53184b98b7055ffc145f186d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:57:50.464218 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-8ad7434c-f3f1-4a87-be69-afa796c3e839 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c85251638bc64deca16008b696b11ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3edb8d53184b98b7055ffc145f186d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:57:50.465391 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-8ad7434c-f3f1-4a87-be69-afa796c3e839 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] 10.222.0.20 "GET /compute/v2.1/servers/4c0c4bb6-269f-46bc-b460-7d0299277753" status: 200 len: 1723 microversion: 2.20 time: 0.150223 Jul 06 13:57:50.465949 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 565/1138] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 6 13:57:50 2022] GET /compute/v2.1/servers/4c0c4bb6-269f-46bc-b460-7d0299277753 => generated 1723 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 06 13:57:51.483821 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-314f8cad-8037-48ff-abab-b5fdf59bba46 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Calling method '>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:57:51.484568 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-314f8cad-8037-48ff-abab-b5fdf59bba46 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] [instance: 4c0c4bb6-269f-46bc-b460-7d0299277753] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:57:51.491708 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-314f8cad-8037-48ff-abab-b5fdf59bba46 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:57:51.492163 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-314f8cad-8037-48ff-abab-b5fdf59bba46 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:57:51.492933 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-314f8cad-8037-48ff-abab-b5fdf59bba46 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:57:51.493404 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-314f8cad-8037-48ff-abab-b5fdf59bba46 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:57:51.557294 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-314f8cad-8037-48ff-abab-b5fdf59bba46 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c85251638bc64deca16008b696b11ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3edb8d53184b98b7055ffc145f186d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:57:51.565496 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-314f8cad-8037-48ff-abab-b5fdf59bba46 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c85251638bc64deca16008b696b11ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3edb8d53184b98b7055ffc145f186d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:57:51.567033 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-314f8cad-8037-48ff-abab-b5fdf59bba46 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c85251638bc64deca16008b696b11ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3edb8d53184b98b7055ffc145f186d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:57:51.568182 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-314f8cad-8037-48ff-abab-b5fdf59bba46 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] 10.222.0.20 "GET /compute/v2.1/servers/4c0c4bb6-269f-46bc-b460-7d0299277753" status: 200 len: 1656 microversion: 2.20 time: 0.088366 Jul 06 13:57:51.568738 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 574/1139] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 6 13:57:51 2022] GET /compute/v2.1/servers/4c0c4bb6-269f-46bc-b460-7d0299277753 => generated 1656 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 06 13:57:51.649553 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [req-0d968e66-4909-4b1b-b876-4964a5799d01 req-9667351d-0cc9-46e6-9b8f-6b85772b6055 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4c0c4bb6-269f-46bc-b460-7d0299277753", "name": "network-vif-deleted", "tag": "92164628-0711-4bbe-835d-289c030d699a"}]} {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 06 13:57:51.658554 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [req-0d968e66-4909-4b1b-b876-4964a5799d01 req-9667351d-0cc9-46e6-9b8f-6b85772b6055 service nova] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:57:51.659004 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [req-0d968e66-4909-4b1b-b876-4964a5799d01 req-9667351d-0cc9-46e6-9b8f-6b85772b6055 service nova] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:57:51.670181 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.compute.server_external_events [req-0d968e66-4909-4b1b-b876-4964a5799d01 req-9667351d-0cc9-46e6-9b8f-6b85772b6055 service nova] Creating event network-vif-deleted:92164628-0711-4bbe-835d-289c030d699a for instance 4c0c4bb6-269f-46bc-b460-7d0299277753 on hv-cinder-81914 Jul 06 13:57:51.676783 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [req-0d968e66-4909-4b1b-b876-4964a5799d01 req-9667351d-0cc9-46e6-9b8f-6b85772b6055 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030446 Jul 06 13:57:51.677699 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 566/1140] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 6 13:57:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 06 13:57:52.586415 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-ed9755f4-6e08-4b86-8093-3fb91865d29c tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Calling method '>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:57:52.587026 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-ed9755f4-6e08-4b86-8093-3fb91865d29c tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] [instance: 4c0c4bb6-269f-46bc-b460-7d0299277753] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:57:52.593808 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-ed9755f4-6e08-4b86-8093-3fb91865d29c tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:57:52.594262 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-ed9755f4-6e08-4b86-8093-3fb91865d29c tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:57:52.595036 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-ed9755f4-6e08-4b86-8093-3fb91865d29c tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:57:52.595638 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-ed9755f4-6e08-4b86-8093-3fb91865d29c tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:57:52.611508 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.wsgi [None req-ed9755f4-6e08-4b86-8093-3fb91865d29c tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] HTTP exception thrown: Instance 4c0c4bb6-269f-46bc-b460-7d0299277753 could not be found. Jul 06 13:57:52.613236 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-ed9755f4-6e08-4b86-8093-3fb91865d29c tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Request method failure captured: Jul 06 13:57:52.613236 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: request: GET /compute/v2.1/servers/4c0c4bb6-269f-46bc-b460-7d0299277753 HTTP/1.1 Jul 06 13:57:52.613236 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: Accept: application/json Jul 06 13:57:52.613236 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: Accept-Encoding: identity Jul 06 13:57:52.613236 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: Connection: close Jul 06 13:57:52.613236 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: Content-Length: 0 Jul 06 13:57:52.613236 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: Content-Type: application/json Jul 06 13:57:52.613236 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: Host: 10.222.0.20 Jul 06 13:57:52.613236 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: Openstack-System-Scope: None Jul 06 13:57:52.613236 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: User-Agent: python-urllib3/1.26.9 Jul 06 13:57:52.613236 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Auth-Token: gAAAAABixZPHZzfL86iQ6aiHUdSt9XB68ycnnakbcV9q5EPB3cmHjGD6e8kIzqA1KpjnI9V4rWu7N0dexJrUVmzpN63EITVTlBuvDk09HPF5d7NT79J5QcDjpZ5WthhRJWqNfVyh-iB7RySsnOyxETRcrR2U8zJnwO3LcnAkPJGROSlueh8XhJE Jul 06 13:57:52.613236 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Domain-Id: None Jul 06 13:57:52.613236 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Domain-Name: None Jul 06 13:57:52.613236 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Identity-Status: Confirmed Jul 06 13:57:52.613236 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Is-Admin-Project: True Jul 06 13:57:52.613236 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Openstack-Nova-Api-Version: 2.20 Jul 06 13:57:52.613236 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Project-Domain-Id: default Jul 06 13:57:52.613236 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Project-Domain-Name: Default Jul 06 13:57:52.613236 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Project-Id: 9e3edb8d53184b98b7055ffc145f186d Jul 06 13:57:52.613236 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-667316018 Jul 06 13:57:52.613236 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Role: reader,member Jul 06 13:57:52.613236 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Roles: reader,member Jul 06 13:57:52.615003 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_9e3edb8d53184b98b7055ffc145f186d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/9e3edb8d53184b98b7055ffc145f186d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/9e3edb8d53184b98b7055ffc145f186d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/9e3edb8d53184b98b7055ffc145f186d"}]}] Jul 06 13:57:52.615003 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Tenant: tempest-AttachVolumeShelveTestJSON-667316018 Jul 06 13:57:52.615003 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Tenant-Id: 9e3edb8d53184b98b7055ffc145f186d Jul 06 13:57:52.615003 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-667316018 Jul 06 13:57:52.615003 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-User: tempest-AttachVolumeShelveTestJSON-667316018-project Jul 06 13:57:52.615003 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-User-Domain-Id: default Jul 06 13:57:52.615003 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-User-Domain-Name: Default Jul 06 13:57:52.615003 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-User-Id: c85251638bc64deca16008b696b11ea4 Jul 06 13:57:52.615003 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-User-Name: tempest-AttachVolumeShelveTestJSON-667316018-project Jul 06 13:57:52.615003 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: method: > Jul 06 13:57:52.615003 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: exception: Instance 4c0c4bb6-269f-46bc-b460-7d0299277753 could not be found. Jul 06 13:57:52.615003 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: action_args: {'id': '4c0c4bb6-269f-46bc-b460-7d0299277753'} Jul 06 13:57:52.615895 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 06 13:57:52.615895 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 06 13:57:52.615895 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 06 13:57:52.615895 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 06 13:57:52.615895 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 06 13:57:52.615895 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 06 13:57:52.615895 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 06 13:57:52.615895 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 06 13:57:52.615895 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 06 13:57:52.615895 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 06 13:57:52.615895 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4c0c4bb6-269f-46bc-b460-7d0299277753 could not be found. Jul 06 13:57:52.615895 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi Jul 06 13:57:52.615895 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 06 13:57:52.615895 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi Jul 06 13:57:52.615895 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 06 13:57:52.615895 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 06 13:57:52.615895 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 06 13:57:52.615895 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 06 13:57:52.615895 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 06 13:57:52.615895 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 06 13:57:52.617261 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 06 13:57:52.617261 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 06 13:57:52.617261 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 06 13:57:52.617261 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 06 13:57:52.617261 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 06 13:57:52.617261 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 06 13:57:52.617261 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 06 13:57:52.617261 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4c0c4bb6-269f-46bc-b460-7d0299277753 could not be found. Jul 06 13:57:52.617261 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi Jul 06 13:57:52.617261 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 06 13:57:52.617261 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi Jul 06 13:57:52.617261 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 06 13:57:52.617261 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 06 13:57:52.617261 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 06 13:57:52.617261 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 06 13:57:52.617261 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 06 13:57:52.617261 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4c0c4bb6-269f-46bc-b460-7d0299277753 could not be found. Jul 06 13:57:52.617261 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi Jul 06 13:57:52.618471 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-ed9755f4-6e08-4b86-8093-3fb91865d29c tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Returning 404 to user: Instance 4c0c4bb6-269f-46bc-b460-7d0299277753 could not be found. {{(pid=124368) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 06 13:57:52.618471 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-ed9755f4-6e08-4b86-8093-3fb91865d29c tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] 10.222.0.20 "GET /compute/v2.1/servers/4c0c4bb6-269f-46bc-b460-7d0299277753" status: 404 len: 111 microversion: 2.20 time: 0.032143 Jul 06 13:57:52.618471 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 575/1141] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 6 13:57:52 2022] GET /compute/v2.1/servers/4c0c4bb6-269f-46bc-b460-7d0299277753 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 06 13:57:52.624089 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-299e4d34-d2fe-4afa-bc81-f45c302fc1b4 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Calling method '.version_select at 0x7ffbc418b0d0>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:57:52.642763 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-299e4d34-d2fe-4afa-bc81-f45c302fc1b4 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1604058782" status: 204 len: 0 microversion: 2.20 time: 0.022875 Jul 06 13:57:52.643324 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 567/1142] 10.222.0.20 () {60 vars in 1261 bytes} [Wed Jul 6 13:57:52 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1604058782 => generated 0 bytes in 24 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 06 13:57:53.270763 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-68e94ba9-5f8f-43ad-ad20-8b5f5854cf79 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Action: 'create', calling method: .version_select at 0x7ffbc42b4a60>, body: {"keypair": {"name": "tempest-keypair-189311326", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFfpeFnPP+WQLaX2Y67LdYppPP3zr8gHuJUKvf+O3vfTuP64ybxOUtVOdk83gfB0Xz1yRzUdstzpm3+74s/BO2IPEuqCrm3dsFgihrUP9WGVMIBmJEUf/IKRF5FbH++NBQ=="}} {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 06 13:57:53.284866 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.quota [None req-68e94ba9-5f8f-43ad-ad20-8b5f5854cf79 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Getting quotas for project 9e3edb8d53184b98b7055ffc145f186d. Resources: {'key_pairs'} {{(pid=124368) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 06 13:57:53.288591 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.quota [None req-68e94ba9-5f8f-43ad-ad20-8b5f5854cf79 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Getting quotas for user c85251638bc64deca16008b696b11ea4 and project 9e3edb8d53184b98b7055ffc145f186d. Resources: {'key_pairs'} {{(pid=124368) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 06 13:57:53.301040 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR oslo.messaging._drivers.impl_rabbit [None req-68e94ba9-5f8f-43ad-ad20-8b5f5854cf79 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] [c3594f77-21e9-4888-95d9-1274c3c05cf5] AMQP server on 10.222.0.20:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 06 13:57:54.170666 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-8c5696c8-12da-4c3e-98de-a284ac51a025 tempest-VolumesSnapshotTestJSON-1412015683 tempest-VolumesSnapshotTestJSON-1412015683-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "df808011-0558-4776-b3c1-766f4bbb62cd", "device": "/dev/sdb"}} {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 06 13:57:54.172324 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-8c5696c8-12da-4c3e-98de-a284ac51a025 tempest-VolumesSnapshotTestJSON-1412015683 tempest-VolumesSnapshotTestJSON-1412015683-project] [instance: 66945654-4f75-4375-b4da-9e0ba0cc800f] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:57:54.179933 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-8c5696c8-12da-4c3e-98de-a284ac51a025 tempest-VolumesSnapshotTestJSON-1412015683 tempest-VolumesSnapshotTestJSON-1412015683-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:57:54.180379 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-8c5696c8-12da-4c3e-98de-a284ac51a025 tempest-VolumesSnapshotTestJSON-1412015683 tempest-VolumesSnapshotTestJSON-1412015683-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:57:54.181160 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-8c5696c8-12da-4c3e-98de-a284ac51a025 tempest-VolumesSnapshotTestJSON-1412015683 tempest-VolumesSnapshotTestJSON-1412015683-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:57:54.181592 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-8c5696c8-12da-4c3e-98de-a284ac51a025 tempest-VolumesSnapshotTestJSON-1412015683 tempest-VolumesSnapshotTestJSON-1412015683-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:57:54.309842 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO oslo.messaging._drivers.impl_rabbit [None req-68e94ba9-5f8f-43ad-ad20-8b5f5854cf79 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] [c3594f77-21e9-4888-95d9-1274c3c05cf5] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 55492. Jul 06 13:57:54.327139 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-68e94ba9-5f8f-43ad-ad20-8b5f5854cf79 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 1.060256 Jul 06 13:57:54.327751 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 576/1143] 10.222.0.20 () {62 vars in 1199 bytes} [Wed Jul 6 13:57:53 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 1062 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jul 06 13:57:54.445834 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-8c5696c8-12da-4c3e-98de-a284ac51a025 tempest-VolumesSnapshotTestJSON-1412015683 tempest-VolumesSnapshotTestJSON-1412015683-project] 10.222.0.20 "POST /compute/v2.1/servers/66945654-4f75-4375-b4da-9e0ba0cc800f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.279364 Jul 06 13:57:54.446887 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 568/1144] 10.222.0.20 () {60 vars in 1322 bytes} [Wed Jul 6 13:57:54 2022] POST /compute/v2.1/servers/66945654-4f75-4375-b4da-9e0ba0cc800f/os-volume_attachments => generated 194 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 06 13:57:55.641015 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-0bf8be7f-a916-4378-bbb3-937e4181ee2a tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-277198444", "imageRef": "b08481d9-1e39-41e8-97bd-b05a9c35b377", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "e12e604c-a9aa-4964-89ef-163e19d2e86f"}], "security_groups": [{"name": "tempest-securitygroup--13958867"}], "key_name": "tempest-keypair-189311326", "user_data": "}} {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 06 13:57:55.751871 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.network.neutron [None req-0bf8be7f-a916-4378-bbb3-937e4181ee2a tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] validate_networks() for [('e12e604c-a9aa-4964-89ef-163e19d2e86f', None, None, None, None, None)] {{(pid=124368) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 06 13:57:56.337174 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.virt.hardware [None req-0bf8be7f-a916-4378-bbb3-937e4181ee2a tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Flavor limits 0:0:0 {{(pid=124368) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 06 13:57:56.337923 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.virt.hardware [None req-0bf8be7f-a916-4378-bbb3-937e4181ee2a tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Image limits 0:0:0 {{(pid=124368) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 06 13:57:56.338790 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.virt.hardware [None req-0bf8be7f-a916-4378-bbb3-937e4181ee2a tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Flavor pref 0:0:0 {{(pid=124368) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 06 13:57:56.339233 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.virt.hardware [None req-0bf8be7f-a916-4378-bbb3-937e4181ee2a tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Image pref 0:0:0 {{(pid=124368) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 06 13:57:56.339666 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.virt.hardware [None req-0bf8be7f-a916-4378-bbb3-937e4181ee2a tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124368) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 06 13:57:56.350134 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-0bf8be7f-a916-4378-bbb3-937e4181ee2a tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:57:56.350588 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-0bf8be7f-a916-4378-bbb3-937e4181ee2a tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:57:56.351412 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-0bf8be7f-a916-4378-bbb3-937e4181ee2a tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:57:56.351862 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-0bf8be7f-a916-4378-bbb3-937e4181ee2a tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:57:56.371403 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.quota [None req-0bf8be7f-a916-4378-bbb3-937e4181ee2a tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Getting quotas for project 9e3edb8d53184b98b7055ffc145f186d. Resources: {'instances', 'cores', 'ram'} {{(pid=124368) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 06 13:57:56.374912 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.quota [None req-0bf8be7f-a916-4378-bbb3-937e4181ee2a tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Getting quotas for user c85251638bc64deca16008b696b11ea4 and project 9e3edb8d53184b98b7055ffc145f186d. Resources: {'instances', 'cores', 'ram'} {{(pid=124368) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 06 13:57:56.389312 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-0bf8be7f-a916-4378-bbb3-937e4181ee2a tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Going to run 1 instances... {{(pid=124368) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 06 13:57:56.392385 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-0bf8be7f-a916-4378-bbb3-937e4181ee2a tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] [instance: 3478e8af-1c05-4921-b7ee-e882acb9a65a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b08481d9-1e39-41e8-97bd-b05a9c35b377',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124368) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 06 13:57:56.454784 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-0bf8be7f-a916-4378-bbb3-937e4181ee2a tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.20 time: 0.817936 Jul 06 13:57:56.455755 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 577/1145] 10.222.0.20 () {62 vars in 1187 bytes} [Wed Jul 6 13:57:55 2022] POST /compute/v2.1/servers => generated 400 bytes in 820 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 06 13:57:56.468352 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-961d5b14-5cc8-4d9e-8f4c-f603948fe352 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:57:56.469163 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-961d5b14-5cc8-4d9e-8f4c-f603948fe352 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] [instance: 3478e8af-1c05-4921-b7ee-e882acb9a65a] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:57:56.544800 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-961d5b14-5cc8-4d9e-8f4c-f603948fe352 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c85251638bc64deca16008b696b11ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3edb8d53184b98b7055ffc145f186d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:57:56.554754 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-961d5b14-5cc8-4d9e-8f4c-f603948fe352 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c85251638bc64deca16008b696b11ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3edb8d53184b98b7055ffc145f186d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:57:56.556478 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-961d5b14-5cc8-4d9e-8f4c-f603948fe352 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c85251638bc64deca16008b696b11ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3edb8d53184b98b7055ffc145f186d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:57:56.557614 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-961d5b14-5cc8-4d9e-8f4c-f603948fe352 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] 10.222.0.20 "GET /compute/v2.1/servers/3478e8af-1c05-4921-b7ee-e882acb9a65a" status: 200 len: 1280 microversion: 2.20 time: 0.095228 Jul 06 13:57:56.558178 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 569/1146] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 6 13:57:56 2022] GET /compute/v2.1/servers/3478e8af-1c05-4921-b7ee-e882acb9a65a => generated 1280 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 06 13:57:57.576817 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-1aeab666-d620-401a-b91d-f7097d2eb101 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Calling method '>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:57:57.577500 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-1aeab666-d620-401a-b91d-f7097d2eb101 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] [instance: 3478e8af-1c05-4921-b7ee-e882acb9a65a] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:57:57.587186 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-1aeab666-d620-401a-b91d-f7097d2eb101 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:57:57.587645 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-1aeab666-d620-401a-b91d-f7097d2eb101 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:57:57.588436 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-1aeab666-d620-401a-b91d-f7097d2eb101 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:57:57.588873 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-1aeab666-d620-401a-b91d-f7097d2eb101 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:57:57.659308 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-1aeab666-d620-401a-b91d-f7097d2eb101 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c85251638bc64deca16008b696b11ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3edb8d53184b98b7055ffc145f186d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:57:57.668519 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-1aeab666-d620-401a-b91d-f7097d2eb101 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c85251638bc64deca16008b696b11ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3edb8d53184b98b7055ffc145f186d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:57:57.670227 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-1aeab666-d620-401a-b91d-f7097d2eb101 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c85251638bc64deca16008b696b11ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3edb8d53184b98b7055ffc145f186d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:57:57.671378 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-1aeab666-d620-401a-b91d-f7097d2eb101 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] 10.222.0.20 "GET /compute/v2.1/servers/3478e8af-1c05-4921-b7ee-e882acb9a65a" status: 200 len: 1350 microversion: 2.20 time: 0.099221 Jul 06 13:57:57.671938 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 578/1147] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 6 13:57:57 2022] GET /compute/v2.1/servers/3478e8af-1c05-4921-b7ee-e882acb9a65a => generated 1350 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 06 13:57:58.691088 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-54775527-fa14-4e44-b71d-ec2c87f75178 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:57:58.691750 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-54775527-fa14-4e44-b71d-ec2c87f75178 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] [instance: 3478e8af-1c05-4921-b7ee-e882acb9a65a] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:57:58.700101 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-54775527-fa14-4e44-b71d-ec2c87f75178 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:57:58.700555 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-54775527-fa14-4e44-b71d-ec2c87f75178 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:57:58.701356 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-54775527-fa14-4e44-b71d-ec2c87f75178 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:57:58.701786 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-54775527-fa14-4e44-b71d-ec2c87f75178 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:57:58.905966 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-54775527-fa14-4e44-b71d-ec2c87f75178 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c85251638bc64deca16008b696b11ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3edb8d53184b98b7055ffc145f186d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:57:58.916839 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-54775527-fa14-4e44-b71d-ec2c87f75178 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c85251638bc64deca16008b696b11ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3edb8d53184b98b7055ffc145f186d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:57:58.918360 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-54775527-fa14-4e44-b71d-ec2c87f75178 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c85251638bc64deca16008b696b11ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3edb8d53184b98b7055ffc145f186d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:57:58.919583 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-54775527-fa14-4e44-b71d-ec2c87f75178 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] 10.222.0.20 "GET /compute/v2.1/servers/3478e8af-1c05-4921-b7ee-e882acb9a65a" status: 200 len: 1404 microversion: 2.20 time: 0.232826 Jul 06 13:57:58.920364 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 570/1148] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 6 13:57:58 2022] GET /compute/v2.1/servers/3478e8af-1c05-4921-b7ee-e882acb9a65a => generated 1404 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 06 13:57:59.209557 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [req-bd06529f-3583-41fc-9d3c-58322830e225 req-5c08458b-fac8-490d-9dd3-903d56cfd9f6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3478e8af-1c05-4921-b7ee-e882acb9a65a", "tag": "1b7f73c8-d336-41e4-a894-3c448b223c00"}]} {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 06 13:57:59.224101 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [req-bd06529f-3583-41fc-9d3c-58322830e225 req-5c08458b-fac8-490d-9dd3-903d56cfd9f6 service nova] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:57:59.224582 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [req-bd06529f-3583-41fc-9d3c-58322830e225 req-5c08458b-fac8-490d-9dd3-903d56cfd9f6 service nova] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:57:59.237662 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.compute.server_external_events [req-bd06529f-3583-41fc-9d3c-58322830e225 req-5c08458b-fac8-490d-9dd3-903d56cfd9f6 service nova] Creating event network-changed:1b7f73c8-d336-41e4-a894-3c448b223c00 for instance 3478e8af-1c05-4921-b7ee-e882acb9a65a on hv-cinder-81914 Jul 06 13:57:59.242518 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [req-bd06529f-3583-41fc-9d3c-58322830e225 req-5c08458b-fac8-490d-9dd3-903d56cfd9f6 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039373 Jul 06 13:57:59.243278 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 579/1149] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 6 13:57:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 06 13:57:59.940720 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-99a2c2cf-18f0-4af3-bbc7-c575a1f3d47a tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:57:59.941388 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-99a2c2cf-18f0-4af3-bbc7-c575a1f3d47a tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] [instance: 3478e8af-1c05-4921-b7ee-e882acb9a65a] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:57:59.947876 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-99a2c2cf-18f0-4af3-bbc7-c575a1f3d47a tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:57:59.948322 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-99a2c2cf-18f0-4af3-bbc7-c575a1f3d47a tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:57:59.949142 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-99a2c2cf-18f0-4af3-bbc7-c575a1f3d47a tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:57:59.949578 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-99a2c2cf-18f0-4af3-bbc7-c575a1f3d47a tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:58:00.079369 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-99a2c2cf-18f0-4af3-bbc7-c575a1f3d47a tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c85251638bc64deca16008b696b11ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3edb8d53184b98b7055ffc145f186d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:58:00.087271 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-99a2c2cf-18f0-4af3-bbc7-c575a1f3d47a tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c85251638bc64deca16008b696b11ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3edb8d53184b98b7055ffc145f186d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:58:00.088900 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-99a2c2cf-18f0-4af3-bbc7-c575a1f3d47a tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c85251638bc64deca16008b696b11ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3edb8d53184b98b7055ffc145f186d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:58:00.090150 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-99a2c2cf-18f0-4af3-bbc7-c575a1f3d47a tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] 10.222.0.20 "GET /compute/v2.1/servers/3478e8af-1c05-4921-b7ee-e882acb9a65a" status: 200 len: 1404 microversion: 2.20 time: 0.154898 Jul 06 13:58:00.090705 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 571/1150] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 6 13:57:59 2022] GET /compute/v2.1/servers/3478e8af-1c05-4921-b7ee-e882acb9a65a => generated 1404 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 06 13:58:01.110219 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-536e3eb6-ff2f-4e4c-95d6-cffbe3d3e8ea tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Calling method '>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:58:01.111136 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-536e3eb6-ff2f-4e4c-95d6-cffbe3d3e8ea tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] [instance: 3478e8af-1c05-4921-b7ee-e882acb9a65a] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:58:01.117283 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-536e3eb6-ff2f-4e4c-95d6-cffbe3d3e8ea tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:58:01.117733 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-536e3eb6-ff2f-4e4c-95d6-cffbe3d3e8ea tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:58:01.118492 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-536e3eb6-ff2f-4e4c-95d6-cffbe3d3e8ea tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:58:01.118930 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-536e3eb6-ff2f-4e4c-95d6-cffbe3d3e8ea tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:58:01.253852 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-536e3eb6-ff2f-4e4c-95d6-cffbe3d3e8ea tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c85251638bc64deca16008b696b11ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3edb8d53184b98b7055ffc145f186d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:58:01.261838 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-536e3eb6-ff2f-4e4c-95d6-cffbe3d3e8ea tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c85251638bc64deca16008b696b11ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3edb8d53184b98b7055ffc145f186d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:58:01.263645 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-536e3eb6-ff2f-4e4c-95d6-cffbe3d3e8ea tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c85251638bc64deca16008b696b11ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3edb8d53184b98b7055ffc145f186d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:58:01.264775 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-536e3eb6-ff2f-4e4c-95d6-cffbe3d3e8ea tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] 10.222.0.20 "GET /compute/v2.1/servers/3478e8af-1c05-4921-b7ee-e882acb9a65a" status: 200 len: 1404 microversion: 2.20 time: 0.159915 Jul 06 13:58:01.265435 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 580/1151] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 6 13:58:01 2022] GET /compute/v2.1/servers/3478e8af-1c05-4921-b7ee-e882acb9a65a => generated 1404 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 06 13:58:02.283409 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-00d49653-60bf-49b6-8080-1c584b427604 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:58:02.284036 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-00d49653-60bf-49b6-8080-1c584b427604 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] [instance: 3478e8af-1c05-4921-b7ee-e882acb9a65a] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:58:02.290563 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-00d49653-60bf-49b6-8080-1c584b427604 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:58:02.291008 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-00d49653-60bf-49b6-8080-1c584b427604 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:58:02.291772 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-00d49653-60bf-49b6-8080-1c584b427604 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:58:02.292207 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-00d49653-60bf-49b6-8080-1c584b427604 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:58:02.421193 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-00d49653-60bf-49b6-8080-1c584b427604 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c85251638bc64deca16008b696b11ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3edb8d53184b98b7055ffc145f186d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:58:02.429965 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-00d49653-60bf-49b6-8080-1c584b427604 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c85251638bc64deca16008b696b11ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3edb8d53184b98b7055ffc145f186d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:58:02.431452 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-00d49653-60bf-49b6-8080-1c584b427604 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c85251638bc64deca16008b696b11ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3edb8d53184b98b7055ffc145f186d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:58:02.432540 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-00d49653-60bf-49b6-8080-1c584b427604 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] 10.222.0.20 "GET /compute/v2.1/servers/3478e8af-1c05-4921-b7ee-e882acb9a65a" status: 200 len: 1404 microversion: 2.20 time: 0.153649 Jul 06 13:58:02.433112 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 572/1152] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 6 13:58:02 2022] GET /compute/v2.1/servers/3478e8af-1c05-4921-b7ee-e882acb9a65a => generated 1404 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 06 13:58:03.450573 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-35eda007-0a42-4030-9534-d082f30f7cb8 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Calling method '>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:58:03.451196 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-35eda007-0a42-4030-9534-d082f30f7cb8 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] [instance: 3478e8af-1c05-4921-b7ee-e882acb9a65a] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:58:03.458286 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-35eda007-0a42-4030-9534-d082f30f7cb8 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:58:03.458745 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-35eda007-0a42-4030-9534-d082f30f7cb8 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:58:03.459523 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-35eda007-0a42-4030-9534-d082f30f7cb8 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:58:03.459967 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-35eda007-0a42-4030-9534-d082f30f7cb8 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:58:03.591142 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-35eda007-0a42-4030-9534-d082f30f7cb8 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c85251638bc64deca16008b696b11ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3edb8d53184b98b7055ffc145f186d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:58:03.599561 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-35eda007-0a42-4030-9534-d082f30f7cb8 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c85251638bc64deca16008b696b11ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3edb8d53184b98b7055ffc145f186d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:58:03.601090 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-35eda007-0a42-4030-9534-d082f30f7cb8 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c85251638bc64deca16008b696b11ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3edb8d53184b98b7055ffc145f186d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:58:03.602204 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-35eda007-0a42-4030-9534-d082f30f7cb8 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] 10.222.0.20 "GET /compute/v2.1/servers/3478e8af-1c05-4921-b7ee-e882acb9a65a" status: 200 len: 1404 microversion: 2.20 time: 0.155538 Jul 06 13:58:03.602746 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 581/1153] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 6 13:58:03 2022] GET /compute/v2.1/servers/3478e8af-1c05-4921-b7ee-e882acb9a65a => generated 1404 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 06 13:58:04.619940 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-8fae78c3-cb9e-4cc7-98e9-73e4c935ffab tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:58:04.620481 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-8fae78c3-cb9e-4cc7-98e9-73e4c935ffab tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] [instance: 3478e8af-1c05-4921-b7ee-e882acb9a65a] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:58:04.627263 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-8fae78c3-cb9e-4cc7-98e9-73e4c935ffab tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:58:04.627715 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-8fae78c3-cb9e-4cc7-98e9-73e4c935ffab tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:58:04.628475 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-8fae78c3-cb9e-4cc7-98e9-73e4c935ffab tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:58:04.628907 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-8fae78c3-cb9e-4cc7-98e9-73e4c935ffab tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:58:04.759281 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-8fae78c3-cb9e-4cc7-98e9-73e4c935ffab tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c85251638bc64deca16008b696b11ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3edb8d53184b98b7055ffc145f186d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:58:04.767877 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-8fae78c3-cb9e-4cc7-98e9-73e4c935ffab tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c85251638bc64deca16008b696b11ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3edb8d53184b98b7055ffc145f186d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:58:04.769398 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-8fae78c3-cb9e-4cc7-98e9-73e4c935ffab tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c85251638bc64deca16008b696b11ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3edb8d53184b98b7055ffc145f186d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:58:04.771594 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-8fae78c3-cb9e-4cc7-98e9-73e4c935ffab tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] 10.222.0.20 "GET /compute/v2.1/servers/3478e8af-1c05-4921-b7ee-e882acb9a65a" status: 200 len: 1404 microversion: 2.20 time: 0.154575 Jul 06 13:58:04.772155 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 573/1154] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 6 13:58:04 2022] GET /compute/v2.1/servers/3478e8af-1c05-4921-b7ee-e882acb9a65a => generated 1404 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 06 13:58:05.789464 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-4e035055-6937-46af-a6c5-ed12cca19b81 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Calling method '>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:58:05.790079 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-4e035055-6937-46af-a6c5-ed12cca19b81 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] [instance: 3478e8af-1c05-4921-b7ee-e882acb9a65a] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:58:05.796455 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-4e035055-6937-46af-a6c5-ed12cca19b81 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:58:05.796904 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-4e035055-6937-46af-a6c5-ed12cca19b81 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:58:05.798634 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-4e035055-6937-46af-a6c5-ed12cca19b81 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:58:05.799072 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-4e035055-6937-46af-a6c5-ed12cca19b81 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:58:05.929192 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-4e035055-6937-46af-a6c5-ed12cca19b81 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c85251638bc64deca16008b696b11ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3edb8d53184b98b7055ffc145f186d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:58:05.936938 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-4e035055-6937-46af-a6c5-ed12cca19b81 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c85251638bc64deca16008b696b11ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3edb8d53184b98b7055ffc145f186d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:58:05.938499 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-4e035055-6937-46af-a6c5-ed12cca19b81 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c85251638bc64deca16008b696b11ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3edb8d53184b98b7055ffc145f186d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:58:05.939591 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-4e035055-6937-46af-a6c5-ed12cca19b81 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] 10.222.0.20 "GET /compute/v2.1/servers/3478e8af-1c05-4921-b7ee-e882acb9a65a" status: 200 len: 1404 microversion: 2.20 time: 0.154052 Jul 06 13:58:05.940144 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 582/1155] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 6 13:58:05 2022] GET /compute/v2.1/servers/3478e8af-1c05-4921-b7ee-e882acb9a65a => generated 1404 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 06 13:58:06.957491 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-cc02afa7-4359-460a-8ce6-d59b11d65940 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:58:06.958028 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-cc02afa7-4359-460a-8ce6-d59b11d65940 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] [instance: 3478e8af-1c05-4921-b7ee-e882acb9a65a] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:58:06.960437 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG dbcounter [-] [124367] Writing DB stats nova_cell0:SELECT=2 {{(pid=124367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:58:06.966025 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-cc02afa7-4359-460a-8ce6-d59b11d65940 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:58:06.966594 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-cc02afa7-4359-460a-8ce6-d59b11d65940 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:58:06.967374 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-cc02afa7-4359-460a-8ce6-d59b11d65940 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:58:06.967800 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-cc02afa7-4359-460a-8ce6-d59b11d65940 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:58:07.100611 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-cc02afa7-4359-460a-8ce6-d59b11d65940 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c85251638bc64deca16008b696b11ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3edb8d53184b98b7055ffc145f186d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:58:07.108495 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-cc02afa7-4359-460a-8ce6-d59b11d65940 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c85251638bc64deca16008b696b11ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3edb8d53184b98b7055ffc145f186d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:58:07.110522 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-cc02afa7-4359-460a-8ce6-d59b11d65940 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c85251638bc64deca16008b696b11ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3edb8d53184b98b7055ffc145f186d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:58:07.111896 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-cc02afa7-4359-460a-8ce6-d59b11d65940 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] 10.222.0.20 "GET /compute/v2.1/servers/3478e8af-1c05-4921-b7ee-e882acb9a65a" status: 200 len: 1404 microversion: 2.20 time: 0.158429 Jul 06 13:58:07.112447 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 574/1156] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 6 13:58:06 2022] GET /compute/v2.1/servers/3478e8af-1c05-4921-b7ee-e882acb9a65a => generated 1404 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 06 13:58:08.129915 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-00d87ea9-4e4e-4124-88c9-7567f4c3f589 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Calling method '>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:58:08.130554 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-00d87ea9-4e4e-4124-88c9-7567f4c3f589 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] [instance: 3478e8af-1c05-4921-b7ee-e882acb9a65a] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:58:08.132521 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG dbcounter [-] [124368] Writing DB stats nova_cell0:SELECT=2 {{(pid=124368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:58:08.133230 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG dbcounter [-] [124368] Writing DB stats nova_cell0:SELECT=10 {{(pid=124368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:58:08.139581 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-00d87ea9-4e4e-4124-88c9-7567f4c3f589 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:58:08.140028 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-00d87ea9-4e4e-4124-88c9-7567f4c3f589 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:58:08.140789 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-00d87ea9-4e4e-4124-88c9-7567f4c3f589 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:58:08.141281 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-00d87ea9-4e4e-4124-88c9-7567f4c3f589 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:58:08.272088 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-00d87ea9-4e4e-4124-88c9-7567f4c3f589 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c85251638bc64deca16008b696b11ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3edb8d53184b98b7055ffc145f186d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:58:08.279839 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-00d87ea9-4e4e-4124-88c9-7567f4c3f589 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c85251638bc64deca16008b696b11ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3edb8d53184b98b7055ffc145f186d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:58:08.281366 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-00d87ea9-4e4e-4124-88c9-7567f4c3f589 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c85251638bc64deca16008b696b11ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3edb8d53184b98b7055ffc145f186d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:58:08.283274 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-00d87ea9-4e4e-4124-88c9-7567f4c3f589 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] 10.222.0.20 "GET /compute/v2.1/servers/3478e8af-1c05-4921-b7ee-e882acb9a65a" status: 200 len: 1404 microversion: 2.20 time: 0.157397 Jul 06 13:58:08.283844 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 583/1157] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 6 13:58:08 2022] GET /compute/v2.1/servers/3478e8af-1c05-4921-b7ee-e882acb9a65a => generated 1404 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 06 13:58:09.301506 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-89417336-15f0-4f34-a397-a8a991dc0599 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:58:09.302590 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-89417336-15f0-4f34-a397-a8a991dc0599 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] [instance: 3478e8af-1c05-4921-b7ee-e882acb9a65a] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:58:09.309937 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-89417336-15f0-4f34-a397-a8a991dc0599 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:58:09.310389 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-89417336-15f0-4f34-a397-a8a991dc0599 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:58:09.311208 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-89417336-15f0-4f34-a397-a8a991dc0599 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:58:09.311679 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-89417336-15f0-4f34-a397-a8a991dc0599 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:58:09.447364 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-89417336-15f0-4f34-a397-a8a991dc0599 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c85251638bc64deca16008b696b11ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3edb8d53184b98b7055ffc145f186d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:58:09.455818 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-89417336-15f0-4f34-a397-a8a991dc0599 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c85251638bc64deca16008b696b11ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3edb8d53184b98b7055ffc145f186d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:58:09.457343 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-89417336-15f0-4f34-a397-a8a991dc0599 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c85251638bc64deca16008b696b11ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3edb8d53184b98b7055ffc145f186d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:58:09.458441 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-89417336-15f0-4f34-a397-a8a991dc0599 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] 10.222.0.20 "GET /compute/v2.1/servers/3478e8af-1c05-4921-b7ee-e882acb9a65a" status: 200 len: 1404 microversion: 2.20 time: 0.161414 Jul 06 13:58:09.459022 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 575/1158] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 6 13:58:09 2022] GET /compute/v2.1/servers/3478e8af-1c05-4921-b7ee-e882acb9a65a => generated 1404 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 06 13:58:09.933432 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [req-0ea1bb9b-ed03-473e-a91f-c3a62b4b864e req-3a59e03c-3b6d-452d-8761-a5ccd6cf2b67 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3478e8af-1c05-4921-b7ee-e882acb9a65a", "name": "network-vif-plugged", "status": "completed", "tag": "1b7f73c8-d336-41e4-a894-3c448b223c00"}]} {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 06 13:58:09.942152 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [req-0ea1bb9b-ed03-473e-a91f-c3a62b4b864e req-3a59e03c-3b6d-452d-8761-a5ccd6cf2b67 service nova] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:58:09.942614 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [req-0ea1bb9b-ed03-473e-a91f-c3a62b4b864e req-3a59e03c-3b6d-452d-8761-a5ccd6cf2b67 service nova] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:58:09.954441 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.compute.server_external_events [req-0ea1bb9b-ed03-473e-a91f-c3a62b4b864e req-3a59e03c-3b6d-452d-8761-a5ccd6cf2b67 service nova] Creating event network-vif-plugged:1b7f73c8-d336-41e4-a894-3c448b223c00 for instance 3478e8af-1c05-4921-b7ee-e882acb9a65a on hv-cinder-81914 Jul 06 13:58:09.959247 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [req-0ea1bb9b-ed03-473e-a91f-c3a62b4b864e req-3a59e03c-3b6d-452d-8761-a5ccd6cf2b67 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029548 Jul 06 13:58:09.959925 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 584/1159] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 6 13:58:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 06 13:58:10.476218 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-0a24fa09-0461-45f7-a265-49e98f9ea9b2 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:58:10.476828 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-0a24fa09-0461-45f7-a265-49e98f9ea9b2 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] [instance: 3478e8af-1c05-4921-b7ee-e882acb9a65a] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:58:10.483247 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-0a24fa09-0461-45f7-a265-49e98f9ea9b2 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:58:10.483698 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-0a24fa09-0461-45f7-a265-49e98f9ea9b2 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:58:10.484468 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-0a24fa09-0461-45f7-a265-49e98f9ea9b2 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:58:10.485143 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-0a24fa09-0461-45f7-a265-49e98f9ea9b2 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:58:10.624274 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-0a24fa09-0461-45f7-a265-49e98f9ea9b2 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c85251638bc64deca16008b696b11ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3edb8d53184b98b7055ffc145f186d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:58:10.633025 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-0a24fa09-0461-45f7-a265-49e98f9ea9b2 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c85251638bc64deca16008b696b11ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3edb8d53184b98b7055ffc145f186d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:58:10.634512 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-0a24fa09-0461-45f7-a265-49e98f9ea9b2 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c85251638bc64deca16008b696b11ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3edb8d53184b98b7055ffc145f186d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:58:10.635601 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-0a24fa09-0461-45f7-a265-49e98f9ea9b2 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] 10.222.0.20 "GET /compute/v2.1/servers/3478e8af-1c05-4921-b7ee-e882acb9a65a" status: 200 len: 1404 microversion: 2.20 time: 0.163239 Jul 06 13:58:10.636151 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 576/1160] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 6 13:58:10 2022] GET /compute/v2.1/servers/3478e8af-1c05-4921-b7ee-e882acb9a65a => generated 1404 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 06 13:58:11.787214 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-624b1666-f607-47ea-a38c-857d11070e20 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Calling method '>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:58:11.787922 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-624b1666-f607-47ea-a38c-857d11070e20 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] [instance: 3478e8af-1c05-4921-b7ee-e882acb9a65a] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:58:11.794135 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-624b1666-f607-47ea-a38c-857d11070e20 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:58:11.794591 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-624b1666-f607-47ea-a38c-857d11070e20 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:58:11.795366 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-624b1666-f607-47ea-a38c-857d11070e20 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:58:11.795808 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-624b1666-f607-47ea-a38c-857d11070e20 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:58:11.925217 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-624b1666-f607-47ea-a38c-857d11070e20 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c85251638bc64deca16008b696b11ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3edb8d53184b98b7055ffc145f186d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:58:11.933331 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-624b1666-f607-47ea-a38c-857d11070e20 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c85251638bc64deca16008b696b11ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3edb8d53184b98b7055ffc145f186d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:58:11.934848 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-624b1666-f607-47ea-a38c-857d11070e20 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c85251638bc64deca16008b696b11ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3edb8d53184b98b7055ffc145f186d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:58:11.935953 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-624b1666-f607-47ea-a38c-857d11070e20 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] 10.222.0.20 "GET /compute/v2.1/servers/3478e8af-1c05-4921-b7ee-e882acb9a65a" status: 200 len: 1404 microversion: 2.20 time: 0.285684 Jul 06 13:58:11.936511 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 585/1161] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 6 13:58:11 2022] GET /compute/v2.1/servers/3478e8af-1c05-4921-b7ee-e882acb9a65a => generated 1404 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 06 13:58:12.953848 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-388f1c01-0bab-4ba0-b77b-fc02e8263c1c tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:58:12.954483 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-388f1c01-0bab-4ba0-b77b-fc02e8263c1c tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] [instance: 3478e8af-1c05-4921-b7ee-e882acb9a65a] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:58:12.961331 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-388f1c01-0bab-4ba0-b77b-fc02e8263c1c tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:58:12.961780 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-388f1c01-0bab-4ba0-b77b-fc02e8263c1c tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:58:12.962544 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-388f1c01-0bab-4ba0-b77b-fc02e8263c1c tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:58:12.962969 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-388f1c01-0bab-4ba0-b77b-fc02e8263c1c tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:58:13.093952 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-388f1c01-0bab-4ba0-b77b-fc02e8263c1c tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c85251638bc64deca16008b696b11ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3edb8d53184b98b7055ffc145f186d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:58:13.101922 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-388f1c01-0bab-4ba0-b77b-fc02e8263c1c tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c85251638bc64deca16008b696b11ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3edb8d53184b98b7055ffc145f186d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:58:13.103410 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-388f1c01-0bab-4ba0-b77b-fc02e8263c1c tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c85251638bc64deca16008b696b11ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3edb8d53184b98b7055ffc145f186d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:58:13.104502 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-388f1c01-0bab-4ba0-b77b-fc02e8263c1c tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] 10.222.0.20 "GET /compute/v2.1/servers/3478e8af-1c05-4921-b7ee-e882acb9a65a" status: 200 len: 1404 microversion: 2.20 time: 0.154577 Jul 06 13:58:13.105056 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 577/1162] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 6 13:58:12 2022] GET /compute/v2.1/servers/3478e8af-1c05-4921-b7ee-e882acb9a65a => generated 1404 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 06 13:58:14.124106 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-5aea0b86-8a6d-433b-aa70-1a745267efb7 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Calling method '>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:58:14.124720 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-5aea0b86-8a6d-433b-aa70-1a745267efb7 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] [instance: 3478e8af-1c05-4921-b7ee-e882acb9a65a] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:58:14.131846 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-5aea0b86-8a6d-433b-aa70-1a745267efb7 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:58:14.132296 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-5aea0b86-8a6d-433b-aa70-1a745267efb7 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:58:14.133087 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-5aea0b86-8a6d-433b-aa70-1a745267efb7 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:58:14.133776 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-5aea0b86-8a6d-433b-aa70-1a745267efb7 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:58:14.267373 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-5aea0b86-8a6d-433b-aa70-1a745267efb7 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c85251638bc64deca16008b696b11ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3edb8d53184b98b7055ffc145f186d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:58:14.276331 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-5aea0b86-8a6d-433b-aa70-1a745267efb7 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c85251638bc64deca16008b696b11ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3edb8d53184b98b7055ffc145f186d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:58:14.277867 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-5aea0b86-8a6d-433b-aa70-1a745267efb7 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c85251638bc64deca16008b696b11ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3edb8d53184b98b7055ffc145f186d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:58:14.278993 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-5aea0b86-8a6d-433b-aa70-1a745267efb7 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] 10.222.0.20 "GET /compute/v2.1/servers/3478e8af-1c05-4921-b7ee-e882acb9a65a" status: 200 len: 1404 microversion: 2.20 time: 0.158808 Jul 06 13:58:14.279550 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 586/1163] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 6 13:58:14 2022] GET /compute/v2.1/servers/3478e8af-1c05-4921-b7ee-e882acb9a65a => generated 1404 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 06 13:58:15.297360 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-eaa34350-d549-49a3-8240-a2808d342203 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:58:15.297999 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-eaa34350-d549-49a3-8240-a2808d342203 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] [instance: 3478e8af-1c05-4921-b7ee-e882acb9a65a] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:58:15.304891 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-eaa34350-d549-49a3-8240-a2808d342203 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:58:15.305378 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-eaa34350-d549-49a3-8240-a2808d342203 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:58:15.306148 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-eaa34350-d549-49a3-8240-a2808d342203 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:58:15.306582 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-eaa34350-d549-49a3-8240-a2808d342203 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:58:15.432658 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-eaa34350-d549-49a3-8240-a2808d342203 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c85251638bc64deca16008b696b11ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3edb8d53184b98b7055ffc145f186d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:58:15.434875 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG dbcounter [-] [124367] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:58:15.442101 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-eaa34350-d549-49a3-8240-a2808d342203 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c85251638bc64deca16008b696b11ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3edb8d53184b98b7055ffc145f186d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:58:15.443592 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-eaa34350-d549-49a3-8240-a2808d342203 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c85251638bc64deca16008b696b11ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3edb8d53184b98b7055ffc145f186d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:58:15.444682 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-eaa34350-d549-49a3-8240-a2808d342203 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] 10.222.0.20 "GET /compute/v2.1/servers/3478e8af-1c05-4921-b7ee-e882acb9a65a" status: 200 len: 1404 microversion: 2.20 time: 0.151303 Jul 06 13:58:15.445257 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 578/1164] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 6 13:58:15 2022] GET /compute/v2.1/servers/3478e8af-1c05-4921-b7ee-e882acb9a65a => generated 1404 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 06 13:58:16.462548 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-7d87c756-fa27-4552-b62a-fbfa0b146469 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Calling method '>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:58:16.463085 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-7d87c756-fa27-4552-b62a-fbfa0b146469 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] [instance: 3478e8af-1c05-4921-b7ee-e882acb9a65a] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:58:16.465679 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG dbcounter [-] [124368] Writing DB stats nova_api:SELECT=62,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=124368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:58:16.472032 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-7d87c756-fa27-4552-b62a-fbfa0b146469 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:58:16.472589 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-7d87c756-fa27-4552-b62a-fbfa0b146469 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:58:16.473377 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-7d87c756-fa27-4552-b62a-fbfa0b146469 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:58:16.473813 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-7d87c756-fa27-4552-b62a-fbfa0b146469 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:58:16.478180 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG dbcounter [-] [124368] Writing DB stats nova_cell1:SELECT=92,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=124368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:58:16.611483 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-7d87c756-fa27-4552-b62a-fbfa0b146469 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c85251638bc64deca16008b696b11ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3edb8d53184b98b7055ffc145f186d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:58:16.620091 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-7d87c756-fa27-4552-b62a-fbfa0b146469 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c85251638bc64deca16008b696b11ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3edb8d53184b98b7055ffc145f186d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:58:16.621655 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-7d87c756-fa27-4552-b62a-fbfa0b146469 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c85251638bc64deca16008b696b11ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3edb8d53184b98b7055ffc145f186d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:58:16.622770 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-7d87c756-fa27-4552-b62a-fbfa0b146469 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] 10.222.0.20 "GET /compute/v2.1/servers/3478e8af-1c05-4921-b7ee-e882acb9a65a" status: 200 len: 1404 microversion: 2.20 time: 0.164250 Jul 06 13:58:16.623332 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 587/1165] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 6 13:58:16 2022] GET /compute/v2.1/servers/3478e8af-1c05-4921-b7ee-e882acb9a65a => generated 1404 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 06 13:58:17.641868 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-46179201-4ac4-4074-97f0-fd348e4d7613 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:58:17.642388 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-46179201-4ac4-4074-97f0-fd348e4d7613 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] [instance: 3478e8af-1c05-4921-b7ee-e882acb9a65a] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:58:17.644776 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG dbcounter [-] [124367] Writing DB stats nova_api:SELECT=40,nova_api:DELETE=1 {{(pid=124367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:58:17.651420 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-46179201-4ac4-4074-97f0-fd348e4d7613 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:58:17.651871 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-46179201-4ac4-4074-97f0-fd348e4d7613 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:58:17.652638 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-46179201-4ac4-4074-97f0-fd348e4d7613 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:58:17.653102 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-46179201-4ac4-4074-97f0-fd348e4d7613 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:58:17.781732 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-46179201-4ac4-4074-97f0-fd348e4d7613 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c85251638bc64deca16008b696b11ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3edb8d53184b98b7055ffc145f186d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:58:17.790296 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-46179201-4ac4-4074-97f0-fd348e4d7613 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c85251638bc64deca16008b696b11ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3edb8d53184b98b7055ffc145f186d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:58:17.791821 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-46179201-4ac4-4074-97f0-fd348e4d7613 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c85251638bc64deca16008b696b11ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3edb8d53184b98b7055ffc145f186d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:58:17.792955 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-46179201-4ac4-4074-97f0-fd348e4d7613 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] 10.222.0.20 "GET /compute/v2.1/servers/3478e8af-1c05-4921-b7ee-e882acb9a65a" status: 200 len: 1597 microversion: 2.20 time: 0.155553 Jul 06 13:58:17.793532 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 579/1166] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 6 13:58:17 2022] GET /compute/v2.1/servers/3478e8af-1c05-4921-b7ee-e882acb9a65a => generated 1597 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 06 13:58:17.811242 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-4b86e9ff-9ee3-4250-a9f9-c76a25a75316 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Calling method '>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:58:17.811739 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-4b86e9ff-9ee3-4250-a9f9-c76a25a75316 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] [instance: 3478e8af-1c05-4921-b7ee-e882acb9a65a] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:58:17.818248 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-4b86e9ff-9ee3-4250-a9f9-c76a25a75316 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:58:17.818708 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-4b86e9ff-9ee3-4250-a9f9-c76a25a75316 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:58:17.819507 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-4b86e9ff-9ee3-4250-a9f9-c76a25a75316 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:58:17.819960 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-4b86e9ff-9ee3-4250-a9f9-c76a25a75316 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:58:17.900169 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-4b86e9ff-9ee3-4250-a9f9-c76a25a75316 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] 10.222.0.20 "GET /compute/v2.1/servers/3478e8af-1c05-4921-b7ee-e882acb9a65a/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.092490 Jul 06 13:58:17.901227 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 588/1167] 10.222.0.20 () {60 vars in 1315 bytes} [Wed Jul 6 13:58:17 2022] GET /compute/v2.1/servers/3478e8af-1c05-4921-b7ee-e882acb9a65a/os-interface => generated 285 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 06 13:58:18.810021 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [req-25a49557-1f79-4b77-8923-f84e337e720c req-eeeb2f67-ff08-41da-8cca-3b7d1986d113 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3478e8af-1c05-4921-b7ee-e882acb9a65a", "tag": "1b7f73c8-d336-41e4-a894-3c448b223c00"}]} {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 06 13:58:18.819002 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [req-25a49557-1f79-4b77-8923-f84e337e720c req-eeeb2f67-ff08-41da-8cca-3b7d1986d113 service nova] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:58:18.819443 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [req-25a49557-1f79-4b77-8923-f84e337e720c req-eeeb2f67-ff08-41da-8cca-3b7d1986d113 service nova] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:58:18.830534 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.compute.server_external_events [req-25a49557-1f79-4b77-8923-f84e337e720c req-eeeb2f67-ff08-41da-8cca-3b7d1986d113 service nova] Creating event network-changed:1b7f73c8-d336-41e4-a894-3c448b223c00 for instance 3478e8af-1c05-4921-b7ee-e882acb9a65a on hv-cinder-81914 Jul 06 13:58:18.836742 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [req-25a49557-1f79-4b77-8923-f84e337e720c req-eeeb2f67-ff08-41da-8cca-3b7d1986d113 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030080 Jul 06 13:58:18.837730 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 580/1168] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 6 13:58:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 06 13:58:25.396691 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-17d36436-e3db-4402-b87f-3ea796415011 tempest-VolumesSnapshotTestJSON-1412015683 tempest-VolumesSnapshotTestJSON-1412015683-project] Calling method '>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:58:25.397294 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-17d36436-e3db-4402-b87f-3ea796415011 tempest-VolumesSnapshotTestJSON-1412015683 tempest-VolumesSnapshotTestJSON-1412015683-project] [instance: 66945654-4f75-4375-b4da-9e0ba0cc800f] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:58:25.403185 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-17d36436-e3db-4402-b87f-3ea796415011 tempest-VolumesSnapshotTestJSON-1412015683 tempest-VolumesSnapshotTestJSON-1412015683-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:58:25.403636 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-17d36436-e3db-4402-b87f-3ea796415011 tempest-VolumesSnapshotTestJSON-1412015683 tempest-VolumesSnapshotTestJSON-1412015683-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:58:25.404401 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-17d36436-e3db-4402-b87f-3ea796415011 tempest-VolumesSnapshotTestJSON-1412015683 tempest-VolumesSnapshotTestJSON-1412015683-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:58:25.404845 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-17d36436-e3db-4402-b87f-3ea796415011 tempest-VolumesSnapshotTestJSON-1412015683 tempest-VolumesSnapshotTestJSON-1412015683-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:58:25.484882 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.objects.instance [None req-17d36436-e3db-4402-b87f-3ea796415011 tempest-VolumesSnapshotTestJSON-1412015683 tempest-VolumesSnapshotTestJSON-1412015683-project] Lazy-loading 'services' on Instance uuid 66945654-4f75-4375-b4da-9e0ba0cc800f {{(pid=124368) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 06 13:58:25.553693 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-17d36436-e3db-4402-b87f-3ea796415011 tempest-VolumesSnapshotTestJSON-1412015683 tempest-VolumesSnapshotTestJSON-1412015683-project] 10.222.0.20 "DELETE /compute/v2.1/servers/66945654-4f75-4375-b4da-9e0ba0cc800f/os-volume_attachments/df808011-0558-4776-b3c1-766f4bbb62cd" status: 202 len: 0 microversion: 2.1 time: 0.162817 Jul 06 13:58:25.554304 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 589/1169] 10.222.0.20 () {58 vars in 1415 bytes} [Wed Jul 6 13:58:25 2022] DELETE /compute/v2.1/servers/66945654-4f75-4375-b4da-9e0ba0cc800f/os-volume_attachments/df808011-0558-4776-b3c1-766f4bbb62cd => generated 0 bytes in 164 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 06 13:58:26.674643 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-4dfe5772-1816-4ebb-a035-e91f6ddb1cf3 tempest-VolumesSnapshotTestJSON-1412015683 tempest-VolumesSnapshotTestJSON-1412015683-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:58:26.675245 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-4dfe5772-1816-4ebb-a035-e91f6ddb1cf3 tempest-VolumesSnapshotTestJSON-1412015683 tempest-VolumesSnapshotTestJSON-1412015683-project] [instance: 66945654-4f75-4375-b4da-9e0ba0cc800f] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:58:26.682540 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-4dfe5772-1816-4ebb-a035-e91f6ddb1cf3 tempest-VolumesSnapshotTestJSON-1412015683 tempest-VolumesSnapshotTestJSON-1412015683-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:58:26.682989 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-4dfe5772-1816-4ebb-a035-e91f6ddb1cf3 tempest-VolumesSnapshotTestJSON-1412015683 tempest-VolumesSnapshotTestJSON-1412015683-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:58:26.683752 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-4dfe5772-1816-4ebb-a035-e91f6ddb1cf3 tempest-VolumesSnapshotTestJSON-1412015683 tempest-VolumesSnapshotTestJSON-1412015683-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:58:26.684186 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-4dfe5772-1816-4ebb-a035-e91f6ddb1cf3 tempest-VolumesSnapshotTestJSON-1412015683 tempest-VolumesSnapshotTestJSON-1412015683-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:58:26.709384 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-4dfe5772-1816-4ebb-a035-e91f6ddb1cf3 tempest-VolumesSnapshotTestJSON-1412015683 tempest-VolumesSnapshotTestJSON-1412015683-project] [instance: 66945654-4f75-4375-b4da-9e0ba0cc800f] Going to try to terminate instance {{(pid=124367) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 06 13:58:26.785734 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-4dfe5772-1816-4ebb-a035-e91f6ddb1cf3 tempest-VolumesSnapshotTestJSON-1412015683 tempest-VolumesSnapshotTestJSON-1412015683-project] 10.222.0.20 "DELETE /compute/v2.1/servers/66945654-4f75-4375-b4da-9e0ba0cc800f" status: 204 len: 0 microversion: 2.1 time: 0.115762 Jul 06 13:58:26.786354 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 581/1170] 10.222.0.20 () {58 vars in 1238 bytes} [Wed Jul 6 13:58:26 2022] DELETE /compute/v2.1/servers/66945654-4f75-4375-b4da-9e0ba0cc800f => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 06 13:58:26.795823 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-e5515659-4776-4efa-a087-88bf01b92d4d tempest-VolumesSnapshotTestJSON-1412015683 tempest-VolumesSnapshotTestJSON-1412015683-project] Calling method '>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:58:26.796525 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-e5515659-4776-4efa-a087-88bf01b92d4d tempest-VolumesSnapshotTestJSON-1412015683 tempest-VolumesSnapshotTestJSON-1412015683-project] [instance: 66945654-4f75-4375-b4da-9e0ba0cc800f] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:58:26.803158 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-e5515659-4776-4efa-a087-88bf01b92d4d tempest-VolumesSnapshotTestJSON-1412015683 tempest-VolumesSnapshotTestJSON-1412015683-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:58:26.803605 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-e5515659-4776-4efa-a087-88bf01b92d4d tempest-VolumesSnapshotTestJSON-1412015683 tempest-VolumesSnapshotTestJSON-1412015683-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:58:26.804367 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-e5515659-4776-4efa-a087-88bf01b92d4d tempest-VolumesSnapshotTestJSON-1412015683 tempest-VolumesSnapshotTestJSON-1412015683-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:58:26.804802 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-e5515659-4776-4efa-a087-88bf01b92d4d tempest-VolumesSnapshotTestJSON-1412015683 tempest-VolumesSnapshotTestJSON-1412015683-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:58:26.931430 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-e5515659-4776-4efa-a087-88bf01b92d4d tempest-VolumesSnapshotTestJSON-1412015683 tempest-VolumesSnapshotTestJSON-1412015683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cce90c0e516c4cc0874e43b14182aa61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4349af63ad274dbfad2615fc50446ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:58:26.938877 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-e5515659-4776-4efa-a087-88bf01b92d4d tempest-VolumesSnapshotTestJSON-1412015683 tempest-VolumesSnapshotTestJSON-1412015683-project] 10.222.0.20 "GET /compute/v2.1/servers/66945654-4f75-4375-b4da-9e0ba0cc800f" status: 200 len: 1513 microversion: 2.1 time: 0.147875 Jul 06 13:58:26.939446 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 590/1171] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:58:26 2022] GET /compute/v2.1/servers/66945654-4f75-4375-b4da-9e0ba0cc800f => generated 1513 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:58:27.961220 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-da1f5458-1982-4ffa-9897-f43eac42ee39 tempest-VolumesSnapshotTestJSON-1412015683 tempest-VolumesSnapshotTestJSON-1412015683-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:58:27.961918 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-da1f5458-1982-4ffa-9897-f43eac42ee39 tempest-VolumesSnapshotTestJSON-1412015683 tempest-VolumesSnapshotTestJSON-1412015683-project] [instance: 66945654-4f75-4375-b4da-9e0ba0cc800f] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:58:27.968413 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-da1f5458-1982-4ffa-9897-f43eac42ee39 tempest-VolumesSnapshotTestJSON-1412015683 tempest-VolumesSnapshotTestJSON-1412015683-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:58:27.968865 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-da1f5458-1982-4ffa-9897-f43eac42ee39 tempest-VolumesSnapshotTestJSON-1412015683 tempest-VolumesSnapshotTestJSON-1412015683-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:58:27.969669 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-da1f5458-1982-4ffa-9897-f43eac42ee39 tempest-VolumesSnapshotTestJSON-1412015683 tempest-VolumesSnapshotTestJSON-1412015683-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:58:27.970102 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-da1f5458-1982-4ffa-9897-f43eac42ee39 tempest-VolumesSnapshotTestJSON-1412015683 tempest-VolumesSnapshotTestJSON-1412015683-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:58:28.107086 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-da1f5458-1982-4ffa-9897-f43eac42ee39 tempest-VolumesSnapshotTestJSON-1412015683 tempest-VolumesSnapshotTestJSON-1412015683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cce90c0e516c4cc0874e43b14182aa61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4349af63ad274dbfad2615fc50446ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:58:28.114586 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-da1f5458-1982-4ffa-9897-f43eac42ee39 tempest-VolumesSnapshotTestJSON-1412015683 tempest-VolumesSnapshotTestJSON-1412015683-project] 10.222.0.20 "GET /compute/v2.1/servers/66945654-4f75-4375-b4da-9e0ba0cc800f" status: 200 len: 1513 microversion: 2.1 time: 0.158812 Jul 06 13:58:28.115147 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 582/1172] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:58:27 2022] GET /compute/v2.1/servers/66945654-4f75-4375-b4da-9e0ba0cc800f => generated 1513 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:58:29.131877 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-46d82f94-b376-4372-9977-af8ce708bf1b tempest-VolumesSnapshotTestJSON-1412015683 tempest-VolumesSnapshotTestJSON-1412015683-project] Calling method '>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:58:29.132499 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-46d82f94-b376-4372-9977-af8ce708bf1b tempest-VolumesSnapshotTestJSON-1412015683 tempest-VolumesSnapshotTestJSON-1412015683-project] [instance: 66945654-4f75-4375-b4da-9e0ba0cc800f] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:58:29.138902 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-46d82f94-b376-4372-9977-af8ce708bf1b tempest-VolumesSnapshotTestJSON-1412015683 tempest-VolumesSnapshotTestJSON-1412015683-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:58:29.139357 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-46d82f94-b376-4372-9977-af8ce708bf1b tempest-VolumesSnapshotTestJSON-1412015683 tempest-VolumesSnapshotTestJSON-1412015683-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:58:29.140151 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-46d82f94-b376-4372-9977-af8ce708bf1b tempest-VolumesSnapshotTestJSON-1412015683 tempest-VolumesSnapshotTestJSON-1412015683-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:58:29.140574 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-46d82f94-b376-4372-9977-af8ce708bf1b tempest-VolumesSnapshotTestJSON-1412015683 tempest-VolumesSnapshotTestJSON-1412015683-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:58:29.272839 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-46d82f94-b376-4372-9977-af8ce708bf1b tempest-VolumesSnapshotTestJSON-1412015683 tempest-VolumesSnapshotTestJSON-1412015683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cce90c0e516c4cc0874e43b14182aa61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4349af63ad274dbfad2615fc50446ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:58:29.280367 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-46d82f94-b376-4372-9977-af8ce708bf1b tempest-VolumesSnapshotTestJSON-1412015683 tempest-VolumesSnapshotTestJSON-1412015683-project] 10.222.0.20 "GET /compute/v2.1/servers/66945654-4f75-4375-b4da-9e0ba0cc800f" status: 200 len: 1513 microversion: 2.1 time: 0.152633 Jul 06 13:58:29.280936 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 591/1173] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:58:29 2022] GET /compute/v2.1/servers/66945654-4f75-4375-b4da-9e0ba0cc800f => generated 1513 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:58:29.486317 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [req-dea1aef0-075b-47b5-907b-15991112c0de req-2047f692-a7ec-4641-b94a-45238faa4123 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "66945654-4f75-4375-b4da-9e0ba0cc800f", "name": "network-vif-deleted", "tag": "657b6f46-df3f-4117-bf08-21cc29ec657b"}]} {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 06 13:58:29.496132 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [req-dea1aef0-075b-47b5-907b-15991112c0de req-2047f692-a7ec-4641-b94a-45238faa4123 service nova] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:58:29.496581 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [req-dea1aef0-075b-47b5-907b-15991112c0de req-2047f692-a7ec-4641-b94a-45238faa4123 service nova] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:58:29.508548 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.compute.server_external_events [req-dea1aef0-075b-47b5-907b-15991112c0de req-2047f692-a7ec-4641-b94a-45238faa4123 service nova] Creating event network-vif-deleted:657b6f46-df3f-4117-bf08-21cc29ec657b for instance 66945654-4f75-4375-b4da-9e0ba0cc800f on hv-cinder-81914 Jul 06 13:58:29.513582 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [req-dea1aef0-075b-47b5-907b-15991112c0de req-2047f692-a7ec-4641-b94a-45238faa4123 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030905 Jul 06 13:58:29.514148 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 583/1174] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 6 13:58:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 06 13:58:30.298051 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-7727e429-755d-4e20-a5dc-853350b1b416 tempest-VolumesSnapshotTestJSON-1412015683 tempest-VolumesSnapshotTestJSON-1412015683-project] Calling method '>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:58:30.298678 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-7727e429-755d-4e20-a5dc-853350b1b416 tempest-VolumesSnapshotTestJSON-1412015683 tempest-VolumesSnapshotTestJSON-1412015683-project] [instance: 66945654-4f75-4375-b4da-9e0ba0cc800f] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:58:30.306324 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-7727e429-755d-4e20-a5dc-853350b1b416 tempest-VolumesSnapshotTestJSON-1412015683 tempest-VolumesSnapshotTestJSON-1412015683-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:58:30.306782 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-7727e429-755d-4e20-a5dc-853350b1b416 tempest-VolumesSnapshotTestJSON-1412015683 tempest-VolumesSnapshotTestJSON-1412015683-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:58:30.307562 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-7727e429-755d-4e20-a5dc-853350b1b416 tempest-VolumesSnapshotTestJSON-1412015683 tempest-VolumesSnapshotTestJSON-1412015683-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:58:30.308002 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-7727e429-755d-4e20-a5dc-853350b1b416 tempest-VolumesSnapshotTestJSON-1412015683 tempest-VolumesSnapshotTestJSON-1412015683-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:58:30.322758 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.wsgi [None req-7727e429-755d-4e20-a5dc-853350b1b416 tempest-VolumesSnapshotTestJSON-1412015683 tempest-VolumesSnapshotTestJSON-1412015683-project] HTTP exception thrown: Instance 66945654-4f75-4375-b4da-9e0ba0cc800f could not be found. Jul 06 13:58:30.324426 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-7727e429-755d-4e20-a5dc-853350b1b416 tempest-VolumesSnapshotTestJSON-1412015683 tempest-VolumesSnapshotTestJSON-1412015683-project] Request method failure captured: Jul 06 13:58:30.324426 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: request: GET /compute/v2.1/servers/66945654-4f75-4375-b4da-9e0ba0cc800f HTTP/1.1 Jul 06 13:58:30.324426 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: Accept: application/json Jul 06 13:58:30.324426 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: Accept-Encoding: identity Jul 06 13:58:30.324426 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: Connection: close Jul 06 13:58:30.324426 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: Content-Length: 0 Jul 06 13:58:30.324426 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: Content-Type: application/json Jul 06 13:58:30.324426 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: Host: 10.222.0.20 Jul 06 13:58:30.324426 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: Openstack-System-Scope: None Jul 06 13:58:30.324426 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: User-Agent: python-urllib3/1.26.9 Jul 06 13:58:30.324426 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Auth-Token: gAAAAABixZS3WZMz7M4GnhWE-ze1zRXfAVgc9bsBcQ2urQ4lsZFgIggCQ2CfmYy8PABazDFaRC43LGpIJCIy6AuYvZn2PmhteEg8RpA0o35CrwEO3RPOB5CLhm6hhiiqqtwitrUHXzQ55Fpajb7JK8Uh159u2IkiaMdmObyd_BBngPPIbQrLDNg Jul 06 13:58:30.324426 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Domain-Id: None Jul 06 13:58:30.324426 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Domain-Name: None Jul 06 13:58:30.324426 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Identity-Status: Confirmed Jul 06 13:58:30.324426 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Is-Admin-Project: True Jul 06 13:58:30.324426 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Project-Domain-Id: default Jul 06 13:58:30.324426 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Project-Domain-Name: Default Jul 06 13:58:30.324426 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Project-Id: 4349af63ad274dbfad2615fc50446ded Jul 06 13:58:30.324426 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1412015683 Jul 06 13:58:30.324426 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Role: reader,member Jul 06 13:58:30.324426 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Roles: reader,member Jul 06 13:58:30.326224 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_4349af63ad274dbfad2615fc50446ded"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/4349af63ad274dbfad2615fc50446ded"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/4349af63ad274dbfad2615fc50446ded"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/4349af63ad274dbfad2615fc50446ded"}]}] Jul 06 13:58:30.326224 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Tenant: tempest-VolumesSnapshotTestJSON-1412015683 Jul 06 13:58:30.326224 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Tenant-Id: 4349af63ad274dbfad2615fc50446ded Jul 06 13:58:30.326224 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1412015683 Jul 06 13:58:30.326224 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-User: tempest-VolumesSnapshotTestJSON-1412015683-project Jul 06 13:58:30.326224 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-User-Domain-Id: default Jul 06 13:58:30.326224 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-User-Domain-Name: Default Jul 06 13:58:30.326224 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-User-Id: cce90c0e516c4cc0874e43b14182aa61 Jul 06 13:58:30.326224 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-User-Name: tempest-VolumesSnapshotTestJSON-1412015683-project Jul 06 13:58:30.326224 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: method: > Jul 06 13:58:30.326224 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: exception: Instance 66945654-4f75-4375-b4da-9e0ba0cc800f could not be found. Jul 06 13:58:30.326224 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: action_args: {'id': '66945654-4f75-4375-b4da-9e0ba0cc800f'} Jul 06 13:58:30.327093 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 06 13:58:30.327093 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 06 13:58:30.327093 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 06 13:58:30.327093 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 06 13:58:30.327093 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 06 13:58:30.327093 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 06 13:58:30.327093 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 06 13:58:30.327093 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 06 13:58:30.327093 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 06 13:58:30.327093 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 06 13:58:30.327093 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 66945654-4f75-4375-b4da-9e0ba0cc800f could not be found. Jul 06 13:58:30.327093 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi Jul 06 13:58:30.327093 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 06 13:58:30.327093 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi Jul 06 13:58:30.327093 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 06 13:58:30.327093 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 06 13:58:30.327093 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 06 13:58:30.327093 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 06 13:58:30.327093 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 06 13:58:30.327093 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 06 13:58:30.328451 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 06 13:58:30.328451 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 06 13:58:30.328451 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 06 13:58:30.328451 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 06 13:58:30.328451 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 06 13:58:30.328451 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 06 13:58:30.328451 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 06 13:58:30.328451 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 66945654-4f75-4375-b4da-9e0ba0cc800f could not be found. Jul 06 13:58:30.328451 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi Jul 06 13:58:30.328451 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 06 13:58:30.328451 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi Jul 06 13:58:30.328451 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 06 13:58:30.328451 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 06 13:58:30.328451 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 06 13:58:30.328451 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 06 13:58:30.328451 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 06 13:58:30.328451 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 66945654-4f75-4375-b4da-9e0ba0cc800f could not be found. Jul 06 13:58:30.328451 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi Jul 06 13:58:30.329641 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-7727e429-755d-4e20-a5dc-853350b1b416 tempest-VolumesSnapshotTestJSON-1412015683 tempest-VolumesSnapshotTestJSON-1412015683-project] Returning 404 to user: Instance 66945654-4f75-4375-b4da-9e0ba0cc800f could not be found. {{(pid=124368) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 06 13:58:30.329641 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-7727e429-755d-4e20-a5dc-853350b1b416 tempest-VolumesSnapshotTestJSON-1412015683 tempest-VolumesSnapshotTestJSON-1412015683-project] 10.222.0.20 "GET /compute/v2.1/servers/66945654-4f75-4375-b4da-9e0ba0cc800f" status: 404 len: 111 microversion: 2.1 time: 0.031717 Jul 06 13:58:30.329641 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 592/1175] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:58:30 2022] GET /compute/v2.1/servers/66945654-4f75-4375-b4da-9e0ba0cc800f => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 06 13:58:43.263552 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-b2673e5e-edb3-4a44-a66d-379e1eb8bdb1 tempest-VolumesSnapshotTestJSON-1412015683 tempest-VolumesSnapshotTestJSON-1412015683-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1680327583", "imageRef": "b08481d9-1e39-41e8-97bd-b05a9c35b377", "flavorRef": "452", "networks": [{"uuid": "995c8901-b276-4dfb-8ce7-5546a81a4d42"}]}} {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 06 13:58:43.270749 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG dbcounter [-] [124367] Writing DB stats nova_api:SELECT=14,nova_api:UPDATE=1 {{(pid=124367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:58:43.271387 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG dbcounter [-] [124367] Writing DB stats nova_cell1:SELECT=31,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:58:43.318426 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.network.neutron [None req-b2673e5e-edb3-4a44-a66d-379e1eb8bdb1 tempest-VolumesSnapshotTestJSON-1412015683 tempest-VolumesSnapshotTestJSON-1412015683-project] validate_networks() for [('995c8901-b276-4dfb-8ce7-5546a81a4d42', None, None, None, None, None)] {{(pid=124367) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 06 13:58:43.966153 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.virt.hardware [None req-b2673e5e-edb3-4a44-a66d-379e1eb8bdb1 tempest-VolumesSnapshotTestJSON-1412015683 tempest-VolumesSnapshotTestJSON-1412015683-project] Flavor limits 0:0:0 {{(pid=124367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 06 13:58:43.966571 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.virt.hardware [None req-b2673e5e-edb3-4a44-a66d-379e1eb8bdb1 tempest-VolumesSnapshotTestJSON-1412015683 tempest-VolumesSnapshotTestJSON-1412015683-project] Image limits 0:0:0 {{(pid=124367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 06 13:58:43.967070 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.virt.hardware [None req-b2673e5e-edb3-4a44-a66d-379e1eb8bdb1 tempest-VolumesSnapshotTestJSON-1412015683 tempest-VolumesSnapshotTestJSON-1412015683-project] Flavor pref 0:0:0 {{(pid=124367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 06 13:58:43.967474 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.virt.hardware [None req-b2673e5e-edb3-4a44-a66d-379e1eb8bdb1 tempest-VolumesSnapshotTestJSON-1412015683 tempest-VolumesSnapshotTestJSON-1412015683-project] Image pref 0:0:0 {{(pid=124367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 06 13:58:43.967882 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.virt.hardware [None req-b2673e5e-edb3-4a44-a66d-379e1eb8bdb1 tempest-VolumesSnapshotTestJSON-1412015683 tempest-VolumesSnapshotTestJSON-1412015683-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 06 13:58:43.976598 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-b2673e5e-edb3-4a44-a66d-379e1eb8bdb1 tempest-VolumesSnapshotTestJSON-1412015683 tempest-VolumesSnapshotTestJSON-1412015683-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:58:43.977100 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-b2673e5e-edb3-4a44-a66d-379e1eb8bdb1 tempest-VolumesSnapshotTestJSON-1412015683 tempest-VolumesSnapshotTestJSON-1412015683-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:58:43.977991 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-b2673e5e-edb3-4a44-a66d-379e1eb8bdb1 tempest-VolumesSnapshotTestJSON-1412015683 tempest-VolumesSnapshotTestJSON-1412015683-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:58:43.978420 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-b2673e5e-edb3-4a44-a66d-379e1eb8bdb1 tempest-VolumesSnapshotTestJSON-1412015683 tempest-VolumesSnapshotTestJSON-1412015683-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:58:43.995428 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.quota [None req-b2673e5e-edb3-4a44-a66d-379e1eb8bdb1 tempest-VolumesSnapshotTestJSON-1412015683 tempest-VolumesSnapshotTestJSON-1412015683-project] Getting quotas for project 4349af63ad274dbfad2615fc50446ded. Resources: {'instances', 'cores', 'ram'} {{(pid=124367) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 06 13:58:43.999259 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.quota [None req-b2673e5e-edb3-4a44-a66d-379e1eb8bdb1 tempest-VolumesSnapshotTestJSON-1412015683 tempest-VolumesSnapshotTestJSON-1412015683-project] Getting quotas for user cce90c0e516c4cc0874e43b14182aa61 and project 4349af63ad274dbfad2615fc50446ded. Resources: {'instances', 'cores', 'ram'} {{(pid=124367) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 06 13:58:44.010802 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-b2673e5e-edb3-4a44-a66d-379e1eb8bdb1 tempest-VolumesSnapshotTestJSON-1412015683 tempest-VolumesSnapshotTestJSON-1412015683-project] Going to run 1 instances... {{(pid=124367) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 06 13:58:44.013178 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-b2673e5e-edb3-4a44-a66d-379e1eb8bdb1 tempest-VolumesSnapshotTestJSON-1412015683 tempest-VolumesSnapshotTestJSON-1412015683-project] [instance: 42320716-ffec-4aef-90f8-d1f7aa6b9226] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b08481d9-1e39-41e8-97bd-b05a9c35b377',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124367) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 06 13:58:44.057424 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-b2673e5e-edb3-4a44-a66d-379e1eb8bdb1 tempest-VolumesSnapshotTestJSON-1412015683 tempest-VolumesSnapshotTestJSON-1412015683-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.797996 Jul 06 13:58:44.058077 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 584/1176] 10.222.0.20 () {60 vars in 1146 bytes} [Wed Jul 6 13:58:43 2022] POST /compute/v2.1/servers => generated 380 bytes in 800 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 06 13:58:44.067979 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-9e30f870-ef9f-414b-b220-20c561907a03 tempest-VolumesSnapshotTestJSON-1412015683 tempest-VolumesSnapshotTestJSON-1412015683-project] Calling method '>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:58:44.068726 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-9e30f870-ef9f-414b-b220-20c561907a03 tempest-VolumesSnapshotTestJSON-1412015683 tempest-VolumesSnapshotTestJSON-1412015683-project] [instance: 42320716-ffec-4aef-90f8-d1f7aa6b9226] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:58:44.071871 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG dbcounter [-] [124368] Writing DB stats nova_api:SELECT=11 {{(pid=124368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:58:44.072622 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG dbcounter [-] [124368] Writing DB stats nova_cell1:SELECT=32,nova_cell1:INSERT=1 {{(pid=124368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:58:44.129972 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-9e30f870-ef9f-414b-b220-20c561907a03 tempest-VolumesSnapshotTestJSON-1412015683 tempest-VolumesSnapshotTestJSON-1412015683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cce90c0e516c4cc0874e43b14182aa61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4349af63ad274dbfad2615fc50446ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:58:44.137672 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-9e30f870-ef9f-414b-b220-20c561907a03 tempest-VolumesSnapshotTestJSON-1412015683 tempest-VolumesSnapshotTestJSON-1412015683-project] 10.222.0.20 "GET /compute/v2.1/servers/42320716-ffec-4aef-90f8-d1f7aa6b9226" status: 200 len: 1219 microversion: 2.1 time: 0.073587 Jul 06 13:58:44.138604 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 593/1177] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:58:44 2022] GET /compute/v2.1/servers/42320716-ffec-4aef-90f8-d1f7aa6b9226 => generated 1219 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:58:45.155209 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-40ece37a-e44b-44e4-ae08-7a981a6faef1 tempest-VolumesSnapshotTestJSON-1412015683 tempest-VolumesSnapshotTestJSON-1412015683-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:58:45.156920 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-40ece37a-e44b-44e4-ae08-7a981a6faef1 tempest-VolumesSnapshotTestJSON-1412015683 tempest-VolumesSnapshotTestJSON-1412015683-project] [instance: 42320716-ffec-4aef-90f8-d1f7aa6b9226] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:58:45.164017 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-40ece37a-e44b-44e4-ae08-7a981a6faef1 tempest-VolumesSnapshotTestJSON-1412015683 tempest-VolumesSnapshotTestJSON-1412015683-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:58:45.164581 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-40ece37a-e44b-44e4-ae08-7a981a6faef1 tempest-VolumesSnapshotTestJSON-1412015683 tempest-VolumesSnapshotTestJSON-1412015683-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:58:45.165693 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-40ece37a-e44b-44e4-ae08-7a981a6faef1 tempest-VolumesSnapshotTestJSON-1412015683 tempest-VolumesSnapshotTestJSON-1412015683-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:58:45.166355 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-40ece37a-e44b-44e4-ae08-7a981a6faef1 tempest-VolumesSnapshotTestJSON-1412015683 tempest-VolumesSnapshotTestJSON-1412015683-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:58:45.236633 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-40ece37a-e44b-44e4-ae08-7a981a6faef1 tempest-VolumesSnapshotTestJSON-1412015683 tempest-VolumesSnapshotTestJSON-1412015683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cce90c0e516c4cc0874e43b14182aa61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4349af63ad274dbfad2615fc50446ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:58:45.244725 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-40ece37a-e44b-44e4-ae08-7a981a6faef1 tempest-VolumesSnapshotTestJSON-1412015683 tempest-VolumesSnapshotTestJSON-1412015683-project] 10.222.0.20 "GET /compute/v2.1/servers/42320716-ffec-4aef-90f8-d1f7aa6b9226" status: 200 len: 1289 microversion: 2.1 time: 0.093846 Jul 06 13:58:45.245318 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 585/1178] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:58:45 2022] GET /compute/v2.1/servers/42320716-ffec-4aef-90f8-d1f7aa6b9226 => generated 1289 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:58:46.262808 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-cb4aa0af-a6e3-4fe8-85b8-c09b70c6312e tempest-VolumesSnapshotTestJSON-1412015683 tempest-VolumesSnapshotTestJSON-1412015683-project] Calling method '>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:58:46.263449 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-cb4aa0af-a6e3-4fe8-85b8-c09b70c6312e tempest-VolumesSnapshotTestJSON-1412015683 tempest-VolumesSnapshotTestJSON-1412015683-project] [instance: 42320716-ffec-4aef-90f8-d1f7aa6b9226] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:58:46.270926 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-cb4aa0af-a6e3-4fe8-85b8-c09b70c6312e tempest-VolumesSnapshotTestJSON-1412015683 tempest-VolumesSnapshotTestJSON-1412015683-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:58:46.271379 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-cb4aa0af-a6e3-4fe8-85b8-c09b70c6312e tempest-VolumesSnapshotTestJSON-1412015683 tempest-VolumesSnapshotTestJSON-1412015683-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:58:46.272151 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-cb4aa0af-a6e3-4fe8-85b8-c09b70c6312e tempest-VolumesSnapshotTestJSON-1412015683 tempest-VolumesSnapshotTestJSON-1412015683-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:58:46.272587 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-cb4aa0af-a6e3-4fe8-85b8-c09b70c6312e tempest-VolumesSnapshotTestJSON-1412015683 tempest-VolumesSnapshotTestJSON-1412015683-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:58:46.403835 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-cb4aa0af-a6e3-4fe8-85b8-c09b70c6312e tempest-VolumesSnapshotTestJSON-1412015683 tempest-VolumesSnapshotTestJSON-1412015683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cce90c0e516c4cc0874e43b14182aa61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4349af63ad274dbfad2615fc50446ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:58:46.419003 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-cb4aa0af-a6e3-4fe8-85b8-c09b70c6312e tempest-VolumesSnapshotTestJSON-1412015683 tempest-VolumesSnapshotTestJSON-1412015683-project] 10.222.0.20 "GET /compute/v2.1/servers/42320716-ffec-4aef-90f8-d1f7aa6b9226" status: 200 len: 1319 microversion: 2.1 time: 0.160466 Jul 06 13:58:46.431601 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [req-65f97ce9-d421-4921-81ef-0d73b0f57b0f req-996b65b5-c147-4ea5-b6e2-cc81a106f970 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "42320716-ffec-4aef-90f8-d1f7aa6b9226", "tag": "eb27fc79-4855-4e13-94e0-9dca82037666"}]} {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 06 13:58:46.432950 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 594/1179] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:58:46 2022] GET /compute/v2.1/servers/42320716-ffec-4aef-90f8-d1f7aa6b9226 => generated 1319 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:58:46.435740 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [req-65f97ce9-d421-4921-81ef-0d73b0f57b0f req-996b65b5-c147-4ea5-b6e2-cc81a106f970 service nova] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:58:46.436539 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [req-65f97ce9-d421-4921-81ef-0d73b0f57b0f req-996b65b5-c147-4ea5-b6e2-cc81a106f970 service nova] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:58:46.449039 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.compute.server_external_events [req-65f97ce9-d421-4921-81ef-0d73b0f57b0f req-996b65b5-c147-4ea5-b6e2-cc81a106f970 service nova] Creating event network-changed:eb27fc79-4855-4e13-94e0-9dca82037666 for instance 42320716-ffec-4aef-90f8-d1f7aa6b9226 on hv-cinder-81914 Jul 06 13:58:46.453774 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [req-65f97ce9-d421-4921-81ef-0d73b0f57b0f req-996b65b5-c147-4ea5-b6e2-cc81a106f970 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035653 Jul 06 13:58:46.454380 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 586/1180] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 6 13:58:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 06 13:58:47.438822 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-74b97732-a2d9-4c81-8877-0a6b60e70c06 tempest-VolumesSnapshotTestJSON-1412015683 tempest-VolumesSnapshotTestJSON-1412015683-project] Calling method '>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:58:47.439435 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-74b97732-a2d9-4c81-8877-0a6b60e70c06 tempest-VolumesSnapshotTestJSON-1412015683 tempest-VolumesSnapshotTestJSON-1412015683-project] [instance: 42320716-ffec-4aef-90f8-d1f7aa6b9226] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:58:47.446584 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-74b97732-a2d9-4c81-8877-0a6b60e70c06 tempest-VolumesSnapshotTestJSON-1412015683 tempest-VolumesSnapshotTestJSON-1412015683-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:58:47.447181 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-74b97732-a2d9-4c81-8877-0a6b60e70c06 tempest-VolumesSnapshotTestJSON-1412015683 tempest-VolumesSnapshotTestJSON-1412015683-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:58:47.447953 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-74b97732-a2d9-4c81-8877-0a6b60e70c06 tempest-VolumesSnapshotTestJSON-1412015683 tempest-VolumesSnapshotTestJSON-1412015683-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:58:47.448395 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-74b97732-a2d9-4c81-8877-0a6b60e70c06 tempest-VolumesSnapshotTestJSON-1412015683 tempest-VolumesSnapshotTestJSON-1412015683-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:58:47.573815 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-74b97732-a2d9-4c81-8877-0a6b60e70c06 tempest-VolumesSnapshotTestJSON-1412015683 tempest-VolumesSnapshotTestJSON-1412015683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cce90c0e516c4cc0874e43b14182aa61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4349af63ad274dbfad2615fc50446ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:58:47.581223 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-74b97732-a2d9-4c81-8877-0a6b60e70c06 tempest-VolumesSnapshotTestJSON-1412015683 tempest-VolumesSnapshotTestJSON-1412015683-project] 10.222.0.20 "GET /compute/v2.1/servers/42320716-ffec-4aef-90f8-d1f7aa6b9226" status: 200 len: 1319 microversion: 2.1 time: 0.146361 Jul 06 13:58:47.581790 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 595/1181] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:58:47 2022] GET /compute/v2.1/servers/42320716-ffec-4aef-90f8-d1f7aa6b9226 => generated 1319 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:58:48.599632 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-2cddb584-deb4-4587-b0c1-f9be067d89ff tempest-VolumesSnapshotTestJSON-1412015683 tempest-VolumesSnapshotTestJSON-1412015683-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:58:48.600237 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-2cddb584-deb4-4587-b0c1-f9be067d89ff tempest-VolumesSnapshotTestJSON-1412015683 tempest-VolumesSnapshotTestJSON-1412015683-project] [instance: 42320716-ffec-4aef-90f8-d1f7aa6b9226] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:58:48.607515 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-2cddb584-deb4-4587-b0c1-f9be067d89ff tempest-VolumesSnapshotTestJSON-1412015683 tempest-VolumesSnapshotTestJSON-1412015683-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:58:48.607964 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-2cddb584-deb4-4587-b0c1-f9be067d89ff tempest-VolumesSnapshotTestJSON-1412015683 tempest-VolumesSnapshotTestJSON-1412015683-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:58:48.608724 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-2cddb584-deb4-4587-b0c1-f9be067d89ff tempest-VolumesSnapshotTestJSON-1412015683 tempest-VolumesSnapshotTestJSON-1412015683-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:58:48.609186 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-2cddb584-deb4-4587-b0c1-f9be067d89ff tempest-VolumesSnapshotTestJSON-1412015683 tempest-VolumesSnapshotTestJSON-1412015683-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:58:48.739517 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-2cddb584-deb4-4587-b0c1-f9be067d89ff tempest-VolumesSnapshotTestJSON-1412015683 tempest-VolumesSnapshotTestJSON-1412015683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cce90c0e516c4cc0874e43b14182aa61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4349af63ad274dbfad2615fc50446ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:58:48.746877 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-2cddb584-deb4-4587-b0c1-f9be067d89ff tempest-VolumesSnapshotTestJSON-1412015683 tempest-VolumesSnapshotTestJSON-1412015683-project] 10.222.0.20 "GET /compute/v2.1/servers/42320716-ffec-4aef-90f8-d1f7aa6b9226" status: 200 len: 1319 microversion: 2.1 time: 0.152026 Jul 06 13:58:48.747441 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 587/1182] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:58:48 2022] GET /compute/v2.1/servers/42320716-ffec-4aef-90f8-d1f7aa6b9226 => generated 1319 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:58:49.764214 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-8ca19789-166d-4d56-a6d4-5097b076934d tempest-VolumesSnapshotTestJSON-1412015683 tempest-VolumesSnapshotTestJSON-1412015683-project] Calling method '>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:58:49.764839 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-8ca19789-166d-4d56-a6d4-5097b076934d tempest-VolumesSnapshotTestJSON-1412015683 tempest-VolumesSnapshotTestJSON-1412015683-project] [instance: 42320716-ffec-4aef-90f8-d1f7aa6b9226] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:58:49.771814 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-8ca19789-166d-4d56-a6d4-5097b076934d tempest-VolumesSnapshotTestJSON-1412015683 tempest-VolumesSnapshotTestJSON-1412015683-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:58:49.772267 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-8ca19789-166d-4d56-a6d4-5097b076934d tempest-VolumesSnapshotTestJSON-1412015683 tempest-VolumesSnapshotTestJSON-1412015683-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:58:49.773064 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-8ca19789-166d-4d56-a6d4-5097b076934d tempest-VolumesSnapshotTestJSON-1412015683 tempest-VolumesSnapshotTestJSON-1412015683-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:58:49.773506 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-8ca19789-166d-4d56-a6d4-5097b076934d tempest-VolumesSnapshotTestJSON-1412015683 tempest-VolumesSnapshotTestJSON-1412015683-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:58:49.905171 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-8ca19789-166d-4d56-a6d4-5097b076934d tempest-VolumesSnapshotTestJSON-1412015683 tempest-VolumesSnapshotTestJSON-1412015683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cce90c0e516c4cc0874e43b14182aa61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4349af63ad274dbfad2615fc50446ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:58:49.912702 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-8ca19789-166d-4d56-a6d4-5097b076934d tempest-VolumesSnapshotTestJSON-1412015683 tempest-VolumesSnapshotTestJSON-1412015683-project] 10.222.0.20 "GET /compute/v2.1/servers/42320716-ffec-4aef-90f8-d1f7aa6b9226" status: 200 len: 1319 microversion: 2.1 time: 0.152310 Jul 06 13:58:49.913321 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 596/1183] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:58:49 2022] GET /compute/v2.1/servers/42320716-ffec-4aef-90f8-d1f7aa6b9226 => generated 1319 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:58:50.931173 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-0e20c78d-9547-4659-a4f3-cce594033218 tempest-VolumesSnapshotTestJSON-1412015683 tempest-VolumesSnapshotTestJSON-1412015683-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:58:50.931784 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-0e20c78d-9547-4659-a4f3-cce594033218 tempest-VolumesSnapshotTestJSON-1412015683 tempest-VolumesSnapshotTestJSON-1412015683-project] [instance: 42320716-ffec-4aef-90f8-d1f7aa6b9226] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:58:50.938300 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-0e20c78d-9547-4659-a4f3-cce594033218 tempest-VolumesSnapshotTestJSON-1412015683 tempest-VolumesSnapshotTestJSON-1412015683-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:58:50.938752 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-0e20c78d-9547-4659-a4f3-cce594033218 tempest-VolumesSnapshotTestJSON-1412015683 tempest-VolumesSnapshotTestJSON-1412015683-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:58:50.939522 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-0e20c78d-9547-4659-a4f3-cce594033218 tempest-VolumesSnapshotTestJSON-1412015683 tempest-VolumesSnapshotTestJSON-1412015683-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:58:50.939960 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-0e20c78d-9547-4659-a4f3-cce594033218 tempest-VolumesSnapshotTestJSON-1412015683 tempest-VolumesSnapshotTestJSON-1412015683-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:58:51.072723 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-0e20c78d-9547-4659-a4f3-cce594033218 tempest-VolumesSnapshotTestJSON-1412015683 tempest-VolumesSnapshotTestJSON-1412015683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cce90c0e516c4cc0874e43b14182aa61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4349af63ad274dbfad2615fc50446ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:58:51.080133 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-0e20c78d-9547-4659-a4f3-cce594033218 tempest-VolumesSnapshotTestJSON-1412015683 tempest-VolumesSnapshotTestJSON-1412015683-project] 10.222.0.20 "GET /compute/v2.1/servers/42320716-ffec-4aef-90f8-d1f7aa6b9226" status: 200 len: 1319 microversion: 2.1 time: 0.153643 Jul 06 13:58:51.080707 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 588/1184] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:58:50 2022] GET /compute/v2.1/servers/42320716-ffec-4aef-90f8-d1f7aa6b9226 => generated 1319 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:58:52.097220 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-3d1c1911-f050-4745-8557-1720d7f57827 tempest-VolumesSnapshotTestJSON-1412015683 tempest-VolumesSnapshotTestJSON-1412015683-project] Calling method '>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:58:52.097827 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-3d1c1911-f050-4745-8557-1720d7f57827 tempest-VolumesSnapshotTestJSON-1412015683 tempest-VolumesSnapshotTestJSON-1412015683-project] [instance: 42320716-ffec-4aef-90f8-d1f7aa6b9226] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:58:52.104275 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-3d1c1911-f050-4745-8557-1720d7f57827 tempest-VolumesSnapshotTestJSON-1412015683 tempest-VolumesSnapshotTestJSON-1412015683-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:58:52.104722 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-3d1c1911-f050-4745-8557-1720d7f57827 tempest-VolumesSnapshotTestJSON-1412015683 tempest-VolumesSnapshotTestJSON-1412015683-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:58:52.105501 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-3d1c1911-f050-4745-8557-1720d7f57827 tempest-VolumesSnapshotTestJSON-1412015683 tempest-VolumesSnapshotTestJSON-1412015683-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:58:52.105937 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-3d1c1911-f050-4745-8557-1720d7f57827 tempest-VolumesSnapshotTestJSON-1412015683 tempest-VolumesSnapshotTestJSON-1412015683-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:58:52.235192 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-3d1c1911-f050-4745-8557-1720d7f57827 tempest-VolumesSnapshotTestJSON-1412015683 tempest-VolumesSnapshotTestJSON-1412015683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cce90c0e516c4cc0874e43b14182aa61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4349af63ad274dbfad2615fc50446ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:58:52.242500 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-3d1c1911-f050-4745-8557-1720d7f57827 tempest-VolumesSnapshotTestJSON-1412015683 tempest-VolumesSnapshotTestJSON-1412015683-project] 10.222.0.20 "GET /compute/v2.1/servers/42320716-ffec-4aef-90f8-d1f7aa6b9226" status: 200 len: 1319 microversion: 2.1 time: 0.149084 Jul 06 13:58:52.243063 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 597/1185] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:58:52 2022] GET /compute/v2.1/servers/42320716-ffec-4aef-90f8-d1f7aa6b9226 => generated 1319 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 06 13:58:52.745049 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [req-88050ae9-4d61-4e3f-bc38-3bf6280d5cdb req-3503dc68-d960-4e50-87bc-4adafcd7a8b9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "42320716-ffec-4aef-90f8-d1f7aa6b9226", "name": "network-vif-plugged", "status": "completed", "tag": "eb27fc79-4855-4e13-94e0-9dca82037666"}]} {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 06 13:58:52.755273 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [req-88050ae9-4d61-4e3f-bc38-3bf6280d5cdb req-3503dc68-d960-4e50-87bc-4adafcd7a8b9 service nova] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:58:52.755718 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [req-88050ae9-4d61-4e3f-bc38-3bf6280d5cdb req-3503dc68-d960-4e50-87bc-4adafcd7a8b9 service nova] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:58:52.773237 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.compute.server_external_events [req-88050ae9-4d61-4e3f-bc38-3bf6280d5cdb req-3503dc68-d960-4e50-87bc-4adafcd7a8b9 service nova] Creating event network-vif-plugged:eb27fc79-4855-4e13-94e0-9dca82037666 for instance 42320716-ffec-4aef-90f8-d1f7aa6b9226 on hv-cinder-81914 Jul 06 13:58:52.780619 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [req-88050ae9-4d61-4e3f-bc38-3bf6280d5cdb req-3503dc68-d960-4e50-87bc-4adafcd7a8b9 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040903 Jul 06 13:58:52.781271 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 589/1186] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 6 13:58:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 06 13:58:53.259308 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-23d6cea8-668f-49b1-84bf-36dde88071f2 tempest-VolumesSnapshotTestJSON-1412015683 tempest-VolumesSnapshotTestJSON-1412015683-project] Calling method '>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:58:53.259890 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-23d6cea8-668f-49b1-84bf-36dde88071f2 tempest-VolumesSnapshotTestJSON-1412015683 tempest-VolumesSnapshotTestJSON-1412015683-project] [instance: 42320716-ffec-4aef-90f8-d1f7aa6b9226] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:58:53.266296 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-23d6cea8-668f-49b1-84bf-36dde88071f2 tempest-VolumesSnapshotTestJSON-1412015683 tempest-VolumesSnapshotTestJSON-1412015683-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:58:53.266739 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-23d6cea8-668f-49b1-84bf-36dde88071f2 tempest-VolumesSnapshotTestJSON-1412015683 tempest-VolumesSnapshotTestJSON-1412015683-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:58:53.267498 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-23d6cea8-668f-49b1-84bf-36dde88071f2 tempest-VolumesSnapshotTestJSON-1412015683 tempest-VolumesSnapshotTestJSON-1412015683-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:58:53.267931 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-23d6cea8-668f-49b1-84bf-36dde88071f2 tempest-VolumesSnapshotTestJSON-1412015683 tempest-VolumesSnapshotTestJSON-1412015683-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:58:53.398182 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-23d6cea8-668f-49b1-84bf-36dde88071f2 tempest-VolumesSnapshotTestJSON-1412015683 tempest-VolumesSnapshotTestJSON-1412015683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cce90c0e516c4cc0874e43b14182aa61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4349af63ad274dbfad2615fc50446ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:58:53.405675 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-23d6cea8-668f-49b1-84bf-36dde88071f2 tempest-VolumesSnapshotTestJSON-1412015683 tempest-VolumesSnapshotTestJSON-1412015683-project] 10.222.0.20 "GET /compute/v2.1/servers/42320716-ffec-4aef-90f8-d1f7aa6b9226" status: 200 len: 1319 microversion: 2.1 time: 0.150875 Jul 06 13:58:53.406248 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 598/1187] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:58:53 2022] GET /compute/v2.1/servers/42320716-ffec-4aef-90f8-d1f7aa6b9226 => generated 1319 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:58:54.423311 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-e7078cad-5154-42df-8cac-b1613b9ac33d tempest-VolumesSnapshotTestJSON-1412015683 tempest-VolumesSnapshotTestJSON-1412015683-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:58:54.423970 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-e7078cad-5154-42df-8cac-b1613b9ac33d tempest-VolumesSnapshotTestJSON-1412015683 tempest-VolumesSnapshotTestJSON-1412015683-project] [instance: 42320716-ffec-4aef-90f8-d1f7aa6b9226] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:58:54.426622 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG dbcounter [-] [124367] Writing DB stats nova_cell0:SELECT=2 {{(pid=124367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:58:54.427603 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG dbcounter [-] [124367] Writing DB stats nova_cell0:SELECT=6 {{(pid=124367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:58:54.434023 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-e7078cad-5154-42df-8cac-b1613b9ac33d tempest-VolumesSnapshotTestJSON-1412015683 tempest-VolumesSnapshotTestJSON-1412015683-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:58:54.434468 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-e7078cad-5154-42df-8cac-b1613b9ac33d tempest-VolumesSnapshotTestJSON-1412015683 tempest-VolumesSnapshotTestJSON-1412015683-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:58:54.435225 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-e7078cad-5154-42df-8cac-b1613b9ac33d tempest-VolumesSnapshotTestJSON-1412015683 tempest-VolumesSnapshotTestJSON-1412015683-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:58:54.435658 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-e7078cad-5154-42df-8cac-b1613b9ac33d tempest-VolumesSnapshotTestJSON-1412015683 tempest-VolumesSnapshotTestJSON-1412015683-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:58:54.564993 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-e7078cad-5154-42df-8cac-b1613b9ac33d tempest-VolumesSnapshotTestJSON-1412015683 tempest-VolumesSnapshotTestJSON-1412015683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cce90c0e516c4cc0874e43b14182aa61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4349af63ad274dbfad2615fc50446ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:58:54.573210 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-e7078cad-5154-42df-8cac-b1613b9ac33d tempest-VolumesSnapshotTestJSON-1412015683 tempest-VolumesSnapshotTestJSON-1412015683-project] 10.222.0.20 "GET /compute/v2.1/servers/42320716-ffec-4aef-90f8-d1f7aa6b9226" status: 200 len: 1319 microversion: 2.1 time: 0.154071 Jul 06 13:58:54.573778 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 590/1188] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:58:54 2022] GET /compute/v2.1/servers/42320716-ffec-4aef-90f8-d1f7aa6b9226 => generated 1319 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:58:55.589576 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-d1aaead9-16a9-4b51-af84-7122938fd27a tempest-VolumesSnapshotTestJSON-1412015683 tempest-VolumesSnapshotTestJSON-1412015683-project] Calling method '>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:58:55.590190 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-d1aaead9-16a9-4b51-af84-7122938fd27a tempest-VolumesSnapshotTestJSON-1412015683 tempest-VolumesSnapshotTestJSON-1412015683-project] [instance: 42320716-ffec-4aef-90f8-d1f7aa6b9226] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:58:55.592236 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG dbcounter [-] [124368] Writing DB stats nova_cell0:SELECT=2 {{(pid=124368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:58:55.597544 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-d1aaead9-16a9-4b51-af84-7122938fd27a tempest-VolumesSnapshotTestJSON-1412015683 tempest-VolumesSnapshotTestJSON-1412015683-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:58:55.597990 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-d1aaead9-16a9-4b51-af84-7122938fd27a tempest-VolumesSnapshotTestJSON-1412015683 tempest-VolumesSnapshotTestJSON-1412015683-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:58:55.598748 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-d1aaead9-16a9-4b51-af84-7122938fd27a tempest-VolumesSnapshotTestJSON-1412015683 tempest-VolumesSnapshotTestJSON-1412015683-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:58:55.599184 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-d1aaead9-16a9-4b51-af84-7122938fd27a tempest-VolumesSnapshotTestJSON-1412015683 tempest-VolumesSnapshotTestJSON-1412015683-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:58:55.728985 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-d1aaead9-16a9-4b51-af84-7122938fd27a tempest-VolumesSnapshotTestJSON-1412015683 tempest-VolumesSnapshotTestJSON-1412015683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cce90c0e516c4cc0874e43b14182aa61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4349af63ad274dbfad2615fc50446ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:58:55.736339 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-d1aaead9-16a9-4b51-af84-7122938fd27a tempest-VolumesSnapshotTestJSON-1412015683 tempest-VolumesSnapshotTestJSON-1412015683-project] 10.222.0.20 "GET /compute/v2.1/servers/42320716-ffec-4aef-90f8-d1f7aa6b9226" status: 200 len: 1509 microversion: 2.1 time: 0.151324 Jul 06 13:58:55.736936 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 599/1189] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:58:55 2022] GET /compute/v2.1/servers/42320716-ffec-4aef-90f8-d1f7aa6b9226 => generated 1509 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:58:55.754171 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-1253c8ba-1d55-449b-b220-48ab64424d9f tempest-VolumesSnapshotTestJSON-1412015683 tempest-VolumesSnapshotTestJSON-1412015683-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2b607fb7-1139-4c65-b39c-1ec4d9dd9dda", "device": "/dev/sdb"}} {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 06 13:58:55.755252 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-1253c8ba-1d55-449b-b220-48ab64424d9f tempest-VolumesSnapshotTestJSON-1412015683 tempest-VolumesSnapshotTestJSON-1412015683-project] [instance: 42320716-ffec-4aef-90f8-d1f7aa6b9226] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:58:55.762228 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-1253c8ba-1d55-449b-b220-48ab64424d9f tempest-VolumesSnapshotTestJSON-1412015683 tempest-VolumesSnapshotTestJSON-1412015683-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:58:55.762674 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-1253c8ba-1d55-449b-b220-48ab64424d9f tempest-VolumesSnapshotTestJSON-1412015683 tempest-VolumesSnapshotTestJSON-1412015683-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:58:55.763441 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-1253c8ba-1d55-449b-b220-48ab64424d9f tempest-VolumesSnapshotTestJSON-1412015683 tempest-VolumesSnapshotTestJSON-1412015683-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:58:55.763915 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-1253c8ba-1d55-449b-b220-48ab64424d9f tempest-VolumesSnapshotTestJSON-1412015683 tempest-VolumesSnapshotTestJSON-1412015683-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:58:56.033627 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-1253c8ba-1d55-449b-b220-48ab64424d9f tempest-VolumesSnapshotTestJSON-1412015683 tempest-VolumesSnapshotTestJSON-1412015683-project] 10.222.0.20 "POST /compute/v2.1/servers/42320716-ffec-4aef-90f8-d1f7aa6b9226/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.283205 Jul 06 13:58:56.034305 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 591/1190] 10.222.0.20 () {60 vars in 1322 bytes} [Wed Jul 6 13:58:55 2022] POST /compute/v2.1/servers/42320716-ffec-4aef-90f8-d1f7aa6b9226/os-volume_attachments => generated 194 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 06 13:59:17.444329 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-a86aff6f-51fe-43a7-b26a-6821263b18f0 tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Calling method '>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:59:17.444939 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-a86aff6f-51fe-43a7-b26a-6821263b18f0 tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] [instance: 74abce3a-f884-4edd-906c-b7ea211c3b5a] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:59:17.445328 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG dbcounter [-] [124367] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=3 {{(pid=124367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:59:17.446598 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG dbcounter [-] [124367] Writing DB stats nova_cell1:SELECT=41,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:59:17.449563 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG dbcounter [-] [124368] Writing DB stats nova_api:SELECT=16 {{(pid=124368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:59:17.450469 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG dbcounter [-] [124368] Writing DB stats nova_cell1:SELECT=36 {{(pid=124368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:59:17.455623 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [req-d5bd5260-6610-4a4c-96aa-92cf0c30d1ee req-8fa8dff2-bb73-409c-b4ac-75bddb6e54f9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "74abce3a-f884-4edd-906c-b7ea211c3b5a", "tag": "424688a9-34bc-4310-80b7-d8344dc05c86"}]} {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 06 13:59:17.456084 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-a86aff6f-51fe-43a7-b26a-6821263b18f0 tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:59:17.456543 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-a86aff6f-51fe-43a7-b26a-6821263b18f0 tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:59:17.457568 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-a86aff6f-51fe-43a7-b26a-6821263b18f0 tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:59:17.458004 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-a86aff6f-51fe-43a7-b26a-6821263b18f0 tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:59:17.468647 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [req-d5bd5260-6610-4a4c-96aa-92cf0c30d1ee req-8fa8dff2-bb73-409c-b4ac-75bddb6e54f9 service nova] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:59:17.469511 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [req-d5bd5260-6610-4a4c-96aa-92cf0c30d1ee req-8fa8dff2-bb73-409c-b4ac-75bddb6e54f9 service nova] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:59:17.486103 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-a86aff6f-51fe-43a7-b26a-6821263b18f0 tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] [instance: 74abce3a-f884-4edd-906c-b7ea211c3b5a] Going to try to terminate instance {{(pid=124368) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 06 13:59:17.487561 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.compute.server_external_events [req-d5bd5260-6610-4a4c-96aa-92cf0c30d1ee req-8fa8dff2-bb73-409c-b4ac-75bddb6e54f9 service nova] Creating event network-changed:424688a9-34bc-4310-80b7-d8344dc05c86 for instance 74abce3a-f884-4edd-906c-b7ea211c3b5a on hv-cinder-81914 Jul 06 13:59:17.494253 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [req-d5bd5260-6610-4a4c-96aa-92cf0c30d1ee req-8fa8dff2-bb73-409c-b4ac-75bddb6e54f9 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051146 Jul 06 13:59:17.495113 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 592/1191] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 6 13:59:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 06 13:59:17.573810 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-a86aff6f-51fe-43a7-b26a-6821263b18f0 tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] 10.222.0.20 "DELETE /compute/v2.1/servers/74abce3a-f884-4edd-906c-b7ea211c3b5a" status: 204 len: 0 microversion: 2.1 time: 0.133896 Jul 06 13:59:17.574958 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 600/1192] 10.222.0.20 () {58 vars in 1238 bytes} [Wed Jul 6 13:59:17 2022] DELETE /compute/v2.1/servers/74abce3a-f884-4edd-906c-b7ea211c3b5a => generated 0 bytes in 136 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 06 13:59:17.584804 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-37572c48-1ec5-4ee7-ae1e-bc26f247e098 tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:59:17.587376 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-37572c48-1ec5-4ee7-ae1e-bc26f247e098 tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] [instance: 74abce3a-f884-4edd-906c-b7ea211c3b5a] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:59:17.594231 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-37572c48-1ec5-4ee7-ae1e-bc26f247e098 tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:59:17.594846 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-37572c48-1ec5-4ee7-ae1e-bc26f247e098 tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:59:17.595798 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-37572c48-1ec5-4ee7-ae1e-bc26f247e098 tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:59:17.596239 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-37572c48-1ec5-4ee7-ae1e-bc26f247e098 tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:59:17.730920 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-37572c48-1ec5-4ee7-ae1e-bc26f247e098 tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32a8191b1c184c75b428579ace2da61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bf864bb1764452e8e3a6f0d5929da9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:59:17.738699 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-37572c48-1ec5-4ee7-ae1e-bc26f247e098 tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] 10.222.0.20 "GET /compute/v2.1/servers/74abce3a-f884-4edd-906c-b7ea211c3b5a" status: 200 len: 1578 microversion: 2.1 time: 0.158844 Jul 06 13:59:17.739508 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 593/1193] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:59:17 2022] GET /compute/v2.1/servers/74abce3a-f884-4edd-906c-b7ea211c3b5a => generated 1578 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:59:18.404921 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-4530c36c-f81e-4776-8bac-a3ee4718d58b tempest-VolumesSnapshotTestJSON-1412015683 tempest-VolumesSnapshotTestJSON-1412015683-project] Calling method '>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:59:18.405547 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-4530c36c-f81e-4776-8bac-a3ee4718d58b tempest-VolumesSnapshotTestJSON-1412015683 tempest-VolumesSnapshotTestJSON-1412015683-project] [instance: 42320716-ffec-4aef-90f8-d1f7aa6b9226] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:59:18.411415 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-4530c36c-f81e-4776-8bac-a3ee4718d58b tempest-VolumesSnapshotTestJSON-1412015683 tempest-VolumesSnapshotTestJSON-1412015683-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:59:18.411860 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-4530c36c-f81e-4776-8bac-a3ee4718d58b tempest-VolumesSnapshotTestJSON-1412015683 tempest-VolumesSnapshotTestJSON-1412015683-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:59:18.412619 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-4530c36c-f81e-4776-8bac-a3ee4718d58b tempest-VolumesSnapshotTestJSON-1412015683 tempest-VolumesSnapshotTestJSON-1412015683-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:59:18.413111 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-4530c36c-f81e-4776-8bac-a3ee4718d58b tempest-VolumesSnapshotTestJSON-1412015683 tempest-VolumesSnapshotTestJSON-1412015683-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:59:18.497681 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.objects.instance [None req-4530c36c-f81e-4776-8bac-a3ee4718d58b tempest-VolumesSnapshotTestJSON-1412015683 tempest-VolumesSnapshotTestJSON-1412015683-project] Lazy-loading 'services' on Instance uuid 42320716-ffec-4aef-90f8-d1f7aa6b9226 {{(pid=124368) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 06 13:59:18.575411 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-4530c36c-f81e-4776-8bac-a3ee4718d58b tempest-VolumesSnapshotTestJSON-1412015683 tempest-VolumesSnapshotTestJSON-1412015683-project] 10.222.0.20 "DELETE /compute/v2.1/servers/42320716-ffec-4aef-90f8-d1f7aa6b9226/os-volume_attachments/2b607fb7-1139-4c65-b39c-1ec4d9dd9dda" status: 202 len: 0 microversion: 2.1 time: 0.174565 Jul 06 13:59:18.575999 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 601/1194] 10.222.0.20 () {58 vars in 1415 bytes} [Wed Jul 6 13:59:18 2022] DELETE /compute/v2.1/servers/42320716-ffec-4aef-90f8-d1f7aa6b9226/os-volume_attachments/2b607fb7-1139-4c65-b39c-1ec4d9dd9dda => generated 0 bytes in 176 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 06 13:59:18.758466 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-8d48cb1e-bf66-4107-81a6-8d3fc5f75167 tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:59:18.759098 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-8d48cb1e-bf66-4107-81a6-8d3fc5f75167 tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] [instance: 74abce3a-f884-4edd-906c-b7ea211c3b5a] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:59:18.765605 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-8d48cb1e-bf66-4107-81a6-8d3fc5f75167 tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:59:18.766043 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-8d48cb1e-bf66-4107-81a6-8d3fc5f75167 tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:59:18.766789 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-8d48cb1e-bf66-4107-81a6-8d3fc5f75167 tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:59:18.767221 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-8d48cb1e-bf66-4107-81a6-8d3fc5f75167 tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:59:18.899068 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-8d48cb1e-bf66-4107-81a6-8d3fc5f75167 tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32a8191b1c184c75b428579ace2da61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bf864bb1764452e8e3a6f0d5929da9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:59:18.906882 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-8d48cb1e-bf66-4107-81a6-8d3fc5f75167 tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] 10.222.0.20 "GET /compute/v2.1/servers/74abce3a-f884-4edd-906c-b7ea211c3b5a" status: 200 len: 1578 microversion: 2.1 time: 0.152418 Jul 06 13:59:18.907646 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 594/1195] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:59:18 2022] GET /compute/v2.1/servers/74abce3a-f884-4edd-906c-b7ea211c3b5a => generated 1578 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:59:19.925565 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-f6e410b8-723f-440f-8860-86482bfd4158 tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Calling method '>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:59:19.926183 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-f6e410b8-723f-440f-8860-86482bfd4158 tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] [instance: 74abce3a-f884-4edd-906c-b7ea211c3b5a] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:59:19.933335 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-f6e410b8-723f-440f-8860-86482bfd4158 tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:59:19.933783 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-f6e410b8-723f-440f-8860-86482bfd4158 tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:59:19.934543 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-f6e410b8-723f-440f-8860-86482bfd4158 tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:59:19.934979 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-f6e410b8-723f-440f-8860-86482bfd4158 tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:59:20.068221 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-f6e410b8-723f-440f-8860-86482bfd4158 tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32a8191b1c184c75b428579ace2da61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bf864bb1764452e8e3a6f0d5929da9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:59:20.076553 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-f6e410b8-723f-440f-8860-86482bfd4158 tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] 10.222.0.20 "GET /compute/v2.1/servers/74abce3a-f884-4edd-906c-b7ea211c3b5a" status: 200 len: 1578 microversion: 2.1 time: 0.155240 Jul 06 13:59:20.077151 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 602/1196] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:59:19 2022] GET /compute/v2.1/servers/74abce3a-f884-4edd-906c-b7ea211c3b5a => generated 1578 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:59:20.743552 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-b9bc2126-4792-4336-a200-99ab618678a8 tempest-VolumesSnapshotTestJSON-1412015683 tempest-VolumesSnapshotTestJSON-1412015683-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:59:20.744213 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-b9bc2126-4792-4336-a200-99ab618678a8 tempest-VolumesSnapshotTestJSON-1412015683 tempest-VolumesSnapshotTestJSON-1412015683-project] [instance: 42320716-ffec-4aef-90f8-d1f7aa6b9226] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:59:20.750796 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-b9bc2126-4792-4336-a200-99ab618678a8 tempest-VolumesSnapshotTestJSON-1412015683 tempest-VolumesSnapshotTestJSON-1412015683-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:59:20.751256 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-b9bc2126-4792-4336-a200-99ab618678a8 tempest-VolumesSnapshotTestJSON-1412015683 tempest-VolumesSnapshotTestJSON-1412015683-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:59:20.752019 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-b9bc2126-4792-4336-a200-99ab618678a8 tempest-VolumesSnapshotTestJSON-1412015683 tempest-VolumesSnapshotTestJSON-1412015683-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:59:20.752453 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-b9bc2126-4792-4336-a200-99ab618678a8 tempest-VolumesSnapshotTestJSON-1412015683 tempest-VolumesSnapshotTestJSON-1412015683-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:59:20.778655 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-b9bc2126-4792-4336-a200-99ab618678a8 tempest-VolumesSnapshotTestJSON-1412015683 tempest-VolumesSnapshotTestJSON-1412015683-project] [instance: 42320716-ffec-4aef-90f8-d1f7aa6b9226] Going to try to terminate instance {{(pid=124367) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 06 13:59:20.823950 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [req-8c285eab-31d2-4868-91cf-e263d75a2478 req-af4d07ed-efe2-472f-b3b1-04aedad6bce6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "74abce3a-f884-4edd-906c-b7ea211c3b5a", "name": "network-vif-deleted", "tag": "424688a9-34bc-4310-80b7-d8344dc05c86"}]} {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 06 13:59:20.832554 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [req-8c285eab-31d2-4868-91cf-e263d75a2478 req-af4d07ed-efe2-472f-b3b1-04aedad6bce6 service nova] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:59:20.833028 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [req-8c285eab-31d2-4868-91cf-e263d75a2478 req-af4d07ed-efe2-472f-b3b1-04aedad6bce6 service nova] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:59:20.844396 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.compute.server_external_events [req-8c285eab-31d2-4868-91cf-e263d75a2478 req-af4d07ed-efe2-472f-b3b1-04aedad6bce6 service nova] Creating event network-vif-deleted:424688a9-34bc-4310-80b7-d8344dc05c86 for instance 74abce3a-f884-4edd-906c-b7ea211c3b5a on hv-cinder-81914 Jul 06 13:59:20.849108 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [req-8c285eab-31d2-4868-91cf-e263d75a2478 req-af4d07ed-efe2-472f-b3b1-04aedad6bce6 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028689 Jul 06 13:59:20.850288 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 603/1197] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 6 13:59:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 06 13:59:20.864541 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-b9bc2126-4792-4336-a200-99ab618678a8 tempest-VolumesSnapshotTestJSON-1412015683 tempest-VolumesSnapshotTestJSON-1412015683-project] 10.222.0.20 "DELETE /compute/v2.1/servers/42320716-ffec-4aef-90f8-d1f7aa6b9226" status: 204 len: 0 microversion: 2.1 time: 0.125371 Jul 06 13:59:20.865141 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 595/1198] 10.222.0.20 () {58 vars in 1238 bytes} [Wed Jul 6 13:59:20 2022] DELETE /compute/v2.1/servers/42320716-ffec-4aef-90f8-d1f7aa6b9226 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 06 13:59:20.874850 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-a4938b53-8ec6-4cae-845f-9aabe6477e6f tempest-VolumesSnapshotTestJSON-1412015683 tempest-VolumesSnapshotTestJSON-1412015683-project] Calling method '>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:59:20.875547 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-a4938b53-8ec6-4cae-845f-9aabe6477e6f tempest-VolumesSnapshotTestJSON-1412015683 tempest-VolumesSnapshotTestJSON-1412015683-project] [instance: 42320716-ffec-4aef-90f8-d1f7aa6b9226] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:59:20.881756 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-a4938b53-8ec6-4cae-845f-9aabe6477e6f tempest-VolumesSnapshotTestJSON-1412015683 tempest-VolumesSnapshotTestJSON-1412015683-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:59:20.882362 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-a4938b53-8ec6-4cae-845f-9aabe6477e6f tempest-VolumesSnapshotTestJSON-1412015683 tempest-VolumesSnapshotTestJSON-1412015683-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:59:20.883267 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-a4938b53-8ec6-4cae-845f-9aabe6477e6f tempest-VolumesSnapshotTestJSON-1412015683 tempest-VolumesSnapshotTestJSON-1412015683-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:59:20.883705 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-a4938b53-8ec6-4cae-845f-9aabe6477e6f tempest-VolumesSnapshotTestJSON-1412015683 tempest-VolumesSnapshotTestJSON-1412015683-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:59:21.012618 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-a4938b53-8ec6-4cae-845f-9aabe6477e6f tempest-VolumesSnapshotTestJSON-1412015683 tempest-VolumesSnapshotTestJSON-1412015683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cce90c0e516c4cc0874e43b14182aa61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4349af63ad274dbfad2615fc50446ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:59:21.019988 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-a4938b53-8ec6-4cae-845f-9aabe6477e6f tempest-VolumesSnapshotTestJSON-1412015683 tempest-VolumesSnapshotTestJSON-1412015683-project] 10.222.0.20 "GET /compute/v2.1/servers/42320716-ffec-4aef-90f8-d1f7aa6b9226" status: 200 len: 1515 microversion: 2.1 time: 0.149424 Jul 06 13:59:21.020553 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 604/1199] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:59:20 2022] GET /compute/v2.1/servers/42320716-ffec-4aef-90f8-d1f7aa6b9226 => generated 1515 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:59:21.095316 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-c920d7d5-ab6b-4392-9238-6e8e2eb80070 tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:59:21.096101 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-c920d7d5-ab6b-4392-9238-6e8e2eb80070 tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] [instance: 74abce3a-f884-4edd-906c-b7ea211c3b5a] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:59:21.103437 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-c920d7d5-ab6b-4392-9238-6e8e2eb80070 tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:59:21.103896 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-c920d7d5-ab6b-4392-9238-6e8e2eb80070 tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:59:21.104692 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-c920d7d5-ab6b-4392-9238-6e8e2eb80070 tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:59:21.105169 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-c920d7d5-ab6b-4392-9238-6e8e2eb80070 tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:59:21.170352 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-c920d7d5-ab6b-4392-9238-6e8e2eb80070 tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32a8191b1c184c75b428579ace2da61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bf864bb1764452e8e3a6f0d5929da9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:59:21.178325 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-c920d7d5-ab6b-4392-9238-6e8e2eb80070 tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] 10.222.0.20 "GET /compute/v2.1/servers/74abce3a-f884-4edd-906c-b7ea211c3b5a" status: 200 len: 1226 microversion: 2.1 time: 0.087445 Jul 06 13:59:21.178900 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 596/1200] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:59:21 2022] GET /compute/v2.1/servers/74abce3a-f884-4edd-906c-b7ea211c3b5a => generated 1226 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:59:22.037974 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-2a773403-74e0-40b2-a43b-b83929238cca tempest-VolumesSnapshotTestJSON-1412015683 tempest-VolumesSnapshotTestJSON-1412015683-project] Calling method '>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:59:22.039105 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-2a773403-74e0-40b2-a43b-b83929238cca tempest-VolumesSnapshotTestJSON-1412015683 tempest-VolumesSnapshotTestJSON-1412015683-project] [instance: 42320716-ffec-4aef-90f8-d1f7aa6b9226] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:59:22.045691 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-2a773403-74e0-40b2-a43b-b83929238cca tempest-VolumesSnapshotTestJSON-1412015683 tempest-VolumesSnapshotTestJSON-1412015683-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:59:22.046148 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-2a773403-74e0-40b2-a43b-b83929238cca tempest-VolumesSnapshotTestJSON-1412015683 tempest-VolumesSnapshotTestJSON-1412015683-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:59:22.046945 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-2a773403-74e0-40b2-a43b-b83929238cca tempest-VolumesSnapshotTestJSON-1412015683 tempest-VolumesSnapshotTestJSON-1412015683-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:59:22.047388 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-2a773403-74e0-40b2-a43b-b83929238cca tempest-VolumesSnapshotTestJSON-1412015683 tempest-VolumesSnapshotTestJSON-1412015683-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:59:22.176437 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-2a773403-74e0-40b2-a43b-b83929238cca tempest-VolumesSnapshotTestJSON-1412015683 tempest-VolumesSnapshotTestJSON-1412015683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cce90c0e516c4cc0874e43b14182aa61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4349af63ad274dbfad2615fc50446ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:59:22.184739 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-2a773403-74e0-40b2-a43b-b83929238cca tempest-VolumesSnapshotTestJSON-1412015683 tempest-VolumesSnapshotTestJSON-1412015683-project] 10.222.0.20 "GET /compute/v2.1/servers/42320716-ffec-4aef-90f8-d1f7aa6b9226" status: 200 len: 1515 microversion: 2.1 time: 0.150711 Jul 06 13:59:22.185338 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 605/1201] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:59:22 2022] GET /compute/v2.1/servers/42320716-ffec-4aef-90f8-d1f7aa6b9226 => generated 1515 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:59:22.195395 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-4b7b245d-1df2-4d35-b0d6-6eb1b1d1ec58 tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:59:22.196005 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-4b7b245d-1df2-4d35-b0d6-6eb1b1d1ec58 tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] [instance: 74abce3a-f884-4edd-906c-b7ea211c3b5a] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:59:22.202557 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-4b7b245d-1df2-4d35-b0d6-6eb1b1d1ec58 tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:59:22.203002 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-4b7b245d-1df2-4d35-b0d6-6eb1b1d1ec58 tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:59:22.203762 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-4b7b245d-1df2-4d35-b0d6-6eb1b1d1ec58 tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:59:22.204193 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-4b7b245d-1df2-4d35-b0d6-6eb1b1d1ec58 tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:59:22.264368 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-4b7b245d-1df2-4d35-b0d6-6eb1b1d1ec58 tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32a8191b1c184c75b428579ace2da61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bf864bb1764452e8e3a6f0d5929da9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:59:22.271926 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-4b7b245d-1df2-4d35-b0d6-6eb1b1d1ec58 tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] 10.222.0.20 "GET /compute/v2.1/servers/74abce3a-f884-4edd-906c-b7ea211c3b5a" status: 200 len: 1226 microversion: 2.1 time: 0.080761 Jul 06 13:59:22.272477 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 597/1202] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:59:22 2022] GET /compute/v2.1/servers/74abce3a-f884-4edd-906c-b7ea211c3b5a => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:59:23.201882 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-2f209468-bf28-46f6-a843-a9bbf2d93284 tempest-VolumesSnapshotTestJSON-1412015683 tempest-VolumesSnapshotTestJSON-1412015683-project] Calling method '>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:59:23.202530 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-2f209468-bf28-46f6-a843-a9bbf2d93284 tempest-VolumesSnapshotTestJSON-1412015683 tempest-VolumesSnapshotTestJSON-1412015683-project] [instance: 42320716-ffec-4aef-90f8-d1f7aa6b9226] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:59:23.208927 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-2f209468-bf28-46f6-a843-a9bbf2d93284 tempest-VolumesSnapshotTestJSON-1412015683 tempest-VolumesSnapshotTestJSON-1412015683-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:59:23.209413 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-2f209468-bf28-46f6-a843-a9bbf2d93284 tempest-VolumesSnapshotTestJSON-1412015683 tempest-VolumesSnapshotTestJSON-1412015683-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:59:23.210325 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-2f209468-bf28-46f6-a843-a9bbf2d93284 tempest-VolumesSnapshotTestJSON-1412015683 tempest-VolumesSnapshotTestJSON-1412015683-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:59:23.211058 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-2f209468-bf28-46f6-a843-a9bbf2d93284 tempest-VolumesSnapshotTestJSON-1412015683 tempest-VolumesSnapshotTestJSON-1412015683-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:59:23.287741 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-1e0f0e2b-3f74-4b18-b0d9-d986f722a239 tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:59:23.288476 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-1e0f0e2b-3f74-4b18-b0d9-d986f722a239 tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] [instance: 74abce3a-f884-4edd-906c-b7ea211c3b5a] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:59:23.295309 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-1e0f0e2b-3f74-4b18-b0d9-d986f722a239 tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:59:23.297561 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-1e0f0e2b-3f74-4b18-b0d9-d986f722a239 tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:59:23.298373 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-1e0f0e2b-3f74-4b18-b0d9-d986f722a239 tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:59:23.298816 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-1e0f0e2b-3f74-4b18-b0d9-d986f722a239 tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:59:23.331771 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-1e0f0e2b-3f74-4b18-b0d9-d986f722a239 tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:59:23.332212 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-1e0f0e2b-3f74-4b18-b0d9-d986f722a239 tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:59:23.332654 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.objects.instance [None req-1e0f0e2b-3f74-4b18-b0d9-d986f722a239 tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Lazy-loading 'fault' on Instance uuid 74abce3a-f884-4edd-906c-b7ea211c3b5a {{(pid=124367) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 06 13:59:23.348440 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-2f209468-bf28-46f6-a843-a9bbf2d93284 tempest-VolumesSnapshotTestJSON-1412015683 tempest-VolumesSnapshotTestJSON-1412015683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cce90c0e516c4cc0874e43b14182aa61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4349af63ad274dbfad2615fc50446ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:59:23.356403 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-2f209468-bf28-46f6-a843-a9bbf2d93284 tempest-VolumesSnapshotTestJSON-1412015683 tempest-VolumesSnapshotTestJSON-1412015683-project] 10.222.0.20 "GET /compute/v2.1/servers/42320716-ffec-4aef-90f8-d1f7aa6b9226" status: 200 len: 1515 microversion: 2.1 time: 0.158400 Jul 06 13:59:23.357100 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 606/1203] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:59:23 2022] GET /compute/v2.1/servers/42320716-ffec-4aef-90f8-d1f7aa6b9226 => generated 1515 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:59:23.372763 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-1e0f0e2b-3f74-4b18-b0d9-d986f722a239 tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32a8191b1c184c75b428579ace2da61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bf864bb1764452e8e3a6f0d5929da9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:59:23.380225 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-1e0f0e2b-3f74-4b18-b0d9-d986f722a239 tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] 10.222.0.20 "GET /compute/v2.1/servers/74abce3a-f884-4edd-906c-b7ea211c3b5a" status: 200 len: 1231 microversion: 2.1 time: 0.096437 Jul 06 13:59:23.380775 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 598/1204] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:59:23 2022] GET /compute/v2.1/servers/74abce3a-f884-4edd-906c-b7ea211c3b5a => generated 1231 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 06 13:59:24.006686 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [req-7f77c650-836c-42a5-a942-5d636620603d req-ad9bab38-ffad-4ee8-b438-531bb3d978d7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "42320716-ffec-4aef-90f8-d1f7aa6b9226", "name": "network-vif-deleted", "tag": "eb27fc79-4855-4e13-94e0-9dca82037666"}]} {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 06 13:59:24.015416 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [req-7f77c650-836c-42a5-a942-5d636620603d req-ad9bab38-ffad-4ee8-b438-531bb3d978d7 service nova] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:59:24.015865 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [req-7f77c650-836c-42a5-a942-5d636620603d req-ad9bab38-ffad-4ee8-b438-531bb3d978d7 service nova] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:59:24.027772 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.compute.server_external_events [req-7f77c650-836c-42a5-a942-5d636620603d req-ad9bab38-ffad-4ee8-b438-531bb3d978d7 service nova] Creating event network-vif-deleted:eb27fc79-4855-4e13-94e0-9dca82037666 for instance 42320716-ffec-4aef-90f8-d1f7aa6b9226 on hv-cinder-81914 Jul 06 13:59:24.032531 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [req-7f77c650-836c-42a5-a942-5d636620603d req-ad9bab38-ffad-4ee8-b438-531bb3d978d7 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029351 Jul 06 13:59:24.033412 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 607/1205] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 6 13:59:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 06 13:59:24.373511 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-c277bd9e-bc45-40b4-95f8-7223b4b494b1 tempest-VolumesSnapshotTestJSON-1412015683 tempest-VolumesSnapshotTestJSON-1412015683-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:59:24.374119 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-c277bd9e-bc45-40b4-95f8-7223b4b494b1 tempest-VolumesSnapshotTestJSON-1412015683 tempest-VolumesSnapshotTestJSON-1412015683-project] [instance: 42320716-ffec-4aef-90f8-d1f7aa6b9226] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:59:24.380543 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-c277bd9e-bc45-40b4-95f8-7223b4b494b1 tempest-VolumesSnapshotTestJSON-1412015683 tempest-VolumesSnapshotTestJSON-1412015683-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:59:24.380993 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-c277bd9e-bc45-40b4-95f8-7223b4b494b1 tempest-VolumesSnapshotTestJSON-1412015683 tempest-VolumesSnapshotTestJSON-1412015683-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:59:24.381854 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-c277bd9e-bc45-40b4-95f8-7223b4b494b1 tempest-VolumesSnapshotTestJSON-1412015683 tempest-VolumesSnapshotTestJSON-1412015683-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:59:24.383387 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-c277bd9e-bc45-40b4-95f8-7223b4b494b1 tempest-VolumesSnapshotTestJSON-1412015683 tempest-VolumesSnapshotTestJSON-1412015683-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:59:24.399508 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-124fab69-19b3-48ce-9c9f-43c03980da1c tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Calling method '>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:59:24.400314 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-124fab69-19b3-48ce-9c9f-43c03980da1c tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] [instance: 74abce3a-f884-4edd-906c-b7ea211c3b5a] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:59:24.406663 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-124fab69-19b3-48ce-9c9f-43c03980da1c tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:59:24.407113 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-124fab69-19b3-48ce-9c9f-43c03980da1c tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:59:24.407887 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-124fab69-19b3-48ce-9c9f-43c03980da1c tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:59:24.408323 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-124fab69-19b3-48ce-9c9f-43c03980da1c tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:59:24.416649 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-c277bd9e-bc45-40b4-95f8-7223b4b494b1 tempest-VolumesSnapshotTestJSON-1412015683 tempest-VolumesSnapshotTestJSON-1412015683-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:59:24.417122 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-c277bd9e-bc45-40b4-95f8-7223b4b494b1 tempest-VolumesSnapshotTestJSON-1412015683 tempest-VolumesSnapshotTestJSON-1412015683-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:59:24.417573 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.objects.instance [None req-c277bd9e-bc45-40b4-95f8-7223b4b494b1 tempest-VolumesSnapshotTestJSON-1412015683 tempest-VolumesSnapshotTestJSON-1412015683-project] Lazy-loading 'fault' on Instance uuid 42320716-ffec-4aef-90f8-d1f7aa6b9226 {{(pid=124367) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 06 13:59:24.422833 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.wsgi [None req-124fab69-19b3-48ce-9c9f-43c03980da1c tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] HTTP exception thrown: Instance 74abce3a-f884-4edd-906c-b7ea211c3b5a could not be found. Jul 06 13:59:24.424480 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-124fab69-19b3-48ce-9c9f-43c03980da1c tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Request method failure captured: Jul 06 13:59:24.424480 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: request: GET /compute/v2.1/servers/74abce3a-f884-4edd-906c-b7ea211c3b5a HTTP/1.1 Jul 06 13:59:24.424480 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: Accept: application/json Jul 06 13:59:24.424480 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: Accept-Encoding: identity Jul 06 13:59:24.424480 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: Connection: close Jul 06 13:59:24.424480 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: Content-Length: 0 Jul 06 13:59:24.424480 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: Content-Type: application/json Jul 06 13:59:24.424480 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: Host: 10.222.0.20 Jul 06 13:59:24.424480 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: Openstack-System-Scope: None Jul 06 13:59:24.424480 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: User-Agent: python-urllib3/1.26.9 Jul 06 13:59:24.424480 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Auth-Token: gAAAAABixZMbzmQPuLb9eh7_wXbVtplKuSudXuDoBzcGG0h6H9K75eus4_iB1ZFKy4bESIau_fZym9tMOHqvZk7NQzyFwFdJ9Jwex7NZc4b081tafcq6ScHtYips0bVDv_wr4GybhPEVGesDE24fRD-oc850BV4RrzVUwtUsD3NO364nPnk60A8 Jul 06 13:59:24.424480 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Domain-Id: None Jul 06 13:59:24.424480 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Domain-Name: None Jul 06 13:59:24.424480 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Identity-Status: Confirmed Jul 06 13:59:24.424480 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Is-Admin-Project: True Jul 06 13:59:24.424480 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Project-Domain-Id: default Jul 06 13:59:24.424480 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Project-Domain-Name: Default Jul 06 13:59:24.424480 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Project-Id: 7bf864bb1764452e8e3a6f0d5929da9f Jul 06 13:59:24.424480 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Project-Name: tempest-TestVolumeBootPattern-1396741004 Jul 06 13:59:24.424480 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Role: reader,member Jul 06 13:59:24.424480 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Roles: reader,member Jul 06 13:59:24.426207 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_7bf864bb1764452e8e3a6f0d5929da9f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/7bf864bb1764452e8e3a6f0d5929da9f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/7bf864bb1764452e8e3a6f0d5929da9f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/7bf864bb1764452e8e3a6f0d5929da9f"}]}] Jul 06 13:59:24.426207 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Tenant: tempest-TestVolumeBootPattern-1396741004 Jul 06 13:59:24.426207 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Tenant-Id: 7bf864bb1764452e8e3a6f0d5929da9f Jul 06 13:59:24.426207 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Tenant-Name: tempest-TestVolumeBootPattern-1396741004 Jul 06 13:59:24.426207 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-User: tempest-TestVolumeBootPattern-1396741004-project Jul 06 13:59:24.426207 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-User-Domain-Id: default Jul 06 13:59:24.426207 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-User-Domain-Name: Default Jul 06 13:59:24.426207 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-User-Id: 32a8191b1c184c75b428579ace2da61c Jul 06 13:59:24.426207 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-User-Name: tempest-TestVolumeBootPattern-1396741004-project Jul 06 13:59:24.426207 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: method: > Jul 06 13:59:24.426207 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: exception: Instance 74abce3a-f884-4edd-906c-b7ea211c3b5a could not be found. Jul 06 13:59:24.426207 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: action_args: {'id': '74abce3a-f884-4edd-906c-b7ea211c3b5a'} Jul 06 13:59:24.427049 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 06 13:59:24.427049 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 06 13:59:24.427049 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 06 13:59:24.427049 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 06 13:59:24.427049 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 06 13:59:24.427049 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 06 13:59:24.427049 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 06 13:59:24.427049 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 06 13:59:24.427049 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 06 13:59:24.427049 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 06 13:59:24.427049 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 74abce3a-f884-4edd-906c-b7ea211c3b5a could not be found. Jul 06 13:59:24.427049 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi Jul 06 13:59:24.427049 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 06 13:59:24.427049 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi Jul 06 13:59:24.427049 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 06 13:59:24.427049 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 06 13:59:24.427049 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 06 13:59:24.427049 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 06 13:59:24.427049 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 06 13:59:24.427049 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 06 13:59:24.428695 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 06 13:59:24.428695 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 06 13:59:24.428695 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 06 13:59:24.428695 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 06 13:59:24.428695 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 06 13:59:24.428695 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 06 13:59:24.428695 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 06 13:59:24.428695 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 74abce3a-f884-4edd-906c-b7ea211c3b5a could not be found. Jul 06 13:59:24.428695 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi Jul 06 13:59:24.428695 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 06 13:59:24.428695 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi Jul 06 13:59:24.428695 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 06 13:59:24.428695 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 06 13:59:24.428695 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 06 13:59:24.428695 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 06 13:59:24.428695 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 06 13:59:24.428695 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 74abce3a-f884-4edd-906c-b7ea211c3b5a could not be found. Jul 06 13:59:24.428695 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi Jul 06 13:59:24.430058 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-124fab69-19b3-48ce-9c9f-43c03980da1c tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Returning 404 to user: Instance 74abce3a-f884-4edd-906c-b7ea211c3b5a could not be found. {{(pid=124368) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 06 13:59:24.430058 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-124fab69-19b3-48ce-9c9f-43c03980da1c tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] 10.222.0.20 "GET /compute/v2.1/servers/74abce3a-f884-4edd-906c-b7ea211c3b5a" status: 404 len: 111 microversion: 2.1 time: 0.031925 Jul 06 13:59:24.430058 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 608/1206] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:59:24 2022] GET /compute/v2.1/servers/74abce3a-f884-4edd-906c-b7ea211c3b5a => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 06 13:59:24.470417 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-c277bd9e-bc45-40b4-95f8-7223b4b494b1 tempest-VolumesSnapshotTestJSON-1412015683 tempest-VolumesSnapshotTestJSON-1412015683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cce90c0e516c4cc0874e43b14182aa61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4349af63ad274dbfad2615fc50446ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:59:24.478363 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-c277bd9e-bc45-40b4-95f8-7223b4b494b1 tempest-VolumesSnapshotTestJSON-1412015683 tempest-VolumesSnapshotTestJSON-1412015683-project] 10.222.0.20 "GET /compute/v2.1/servers/42320716-ffec-4aef-90f8-d1f7aa6b9226" status: 200 len: 1309 microversion: 2.1 time: 0.108684 Jul 06 13:59:24.478961 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 599/1207] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:59:24 2022] GET /compute/v2.1/servers/42320716-ffec-4aef-90f8-d1f7aa6b9226 => generated 1309 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:59:25.495867 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-0d529042-5507-4b4c-a2b5-07c46faa8094 tempest-VolumesSnapshotTestJSON-1412015683 tempest-VolumesSnapshotTestJSON-1412015683-project] Calling method '>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:59:25.496481 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-0d529042-5507-4b4c-a2b5-07c46faa8094 tempest-VolumesSnapshotTestJSON-1412015683 tempest-VolumesSnapshotTestJSON-1412015683-project] [instance: 42320716-ffec-4aef-90f8-d1f7aa6b9226] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:59:25.502698 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-0d529042-5507-4b4c-a2b5-07c46faa8094 tempest-VolumesSnapshotTestJSON-1412015683 tempest-VolumesSnapshotTestJSON-1412015683-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:59:25.503148 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-0d529042-5507-4b4c-a2b5-07c46faa8094 tempest-VolumesSnapshotTestJSON-1412015683 tempest-VolumesSnapshotTestJSON-1412015683-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:59:25.503914 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-0d529042-5507-4b4c-a2b5-07c46faa8094 tempest-VolumesSnapshotTestJSON-1412015683 tempest-VolumesSnapshotTestJSON-1412015683-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:59:25.504347 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-0d529042-5507-4b4c-a2b5-07c46faa8094 tempest-VolumesSnapshotTestJSON-1412015683 tempest-VolumesSnapshotTestJSON-1412015683-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:59:25.517401 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.wsgi [None req-0d529042-5507-4b4c-a2b5-07c46faa8094 tempest-VolumesSnapshotTestJSON-1412015683 tempest-VolumesSnapshotTestJSON-1412015683-project] HTTP exception thrown: Instance 42320716-ffec-4aef-90f8-d1f7aa6b9226 could not be found. Jul 06 13:59:25.518933 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-0d529042-5507-4b4c-a2b5-07c46faa8094 tempest-VolumesSnapshotTestJSON-1412015683 tempest-VolumesSnapshotTestJSON-1412015683-project] Request method failure captured: Jul 06 13:59:25.518933 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: request: GET /compute/v2.1/servers/42320716-ffec-4aef-90f8-d1f7aa6b9226 HTTP/1.1 Jul 06 13:59:25.518933 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: Accept: application/json Jul 06 13:59:25.518933 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: Accept-Encoding: identity Jul 06 13:59:25.518933 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: Connection: close Jul 06 13:59:25.518933 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: Content-Length: 0 Jul 06 13:59:25.518933 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: Content-Type: application/json Jul 06 13:59:25.518933 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: Host: 10.222.0.20 Jul 06 13:59:25.518933 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: Openstack-System-Scope: None Jul 06 13:59:25.518933 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: User-Agent: python-urllib3/1.26.9 Jul 06 13:59:25.518933 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Auth-Token: gAAAAABixZS3WZMz7M4GnhWE-ze1zRXfAVgc9bsBcQ2urQ4lsZFgIggCQ2CfmYy8PABazDFaRC43LGpIJCIy6AuYvZn2PmhteEg8RpA0o35CrwEO3RPOB5CLhm6hhiiqqtwitrUHXzQ55Fpajb7JK8Uh159u2IkiaMdmObyd_BBngPPIbQrLDNg Jul 06 13:59:25.518933 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Domain-Id: None Jul 06 13:59:25.518933 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Domain-Name: None Jul 06 13:59:25.518933 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Identity-Status: Confirmed Jul 06 13:59:25.518933 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Is-Admin-Project: True Jul 06 13:59:25.518933 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Project-Domain-Id: default Jul 06 13:59:25.518933 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Project-Domain-Name: Default Jul 06 13:59:25.518933 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Project-Id: 4349af63ad274dbfad2615fc50446ded Jul 06 13:59:25.518933 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1412015683 Jul 06 13:59:25.518933 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Role: reader,member Jul 06 13:59:25.518933 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Roles: reader,member Jul 06 13:59:25.520538 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_4349af63ad274dbfad2615fc50446ded"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/4349af63ad274dbfad2615fc50446ded"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/4349af63ad274dbfad2615fc50446ded"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/4349af63ad274dbfad2615fc50446ded"}]}] Jul 06 13:59:25.520538 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Tenant: tempest-VolumesSnapshotTestJSON-1412015683 Jul 06 13:59:25.520538 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Tenant-Id: 4349af63ad274dbfad2615fc50446ded Jul 06 13:59:25.520538 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1412015683 Jul 06 13:59:25.520538 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-User: tempest-VolumesSnapshotTestJSON-1412015683-project Jul 06 13:59:25.520538 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-User-Domain-Id: default Jul 06 13:59:25.520538 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-User-Domain-Name: Default Jul 06 13:59:25.520538 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-User-Id: cce90c0e516c4cc0874e43b14182aa61 Jul 06 13:59:25.520538 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-User-Name: tempest-VolumesSnapshotTestJSON-1412015683-project Jul 06 13:59:25.520538 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: method: > Jul 06 13:59:25.520538 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: exception: Instance 42320716-ffec-4aef-90f8-d1f7aa6b9226 could not be found. Jul 06 13:59:25.520538 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: action_args: {'id': '42320716-ffec-4aef-90f8-d1f7aa6b9226'} Jul 06 13:59:25.521525 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 06 13:59:25.521525 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 06 13:59:25.521525 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 06 13:59:25.521525 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 06 13:59:25.521525 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 06 13:59:25.521525 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 06 13:59:25.521525 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 06 13:59:25.521525 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 06 13:59:25.521525 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 06 13:59:25.521525 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 06 13:59:25.521525 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 42320716-ffec-4aef-90f8-d1f7aa6b9226 could not be found. Jul 06 13:59:25.521525 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi Jul 06 13:59:25.521525 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 06 13:59:25.521525 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi Jul 06 13:59:25.521525 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 06 13:59:25.521525 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 06 13:59:25.521525 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 06 13:59:25.521525 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 06 13:59:25.521525 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 06 13:59:25.521525 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 06 13:59:25.523964 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 06 13:59:25.523964 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 06 13:59:25.523964 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 06 13:59:25.523964 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 06 13:59:25.523964 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 06 13:59:25.523964 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 06 13:59:25.523964 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 06 13:59:25.523964 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 42320716-ffec-4aef-90f8-d1f7aa6b9226 could not be found. Jul 06 13:59:25.523964 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi Jul 06 13:59:25.523964 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 06 13:59:25.523964 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi Jul 06 13:59:25.523964 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 06 13:59:25.523964 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 06 13:59:25.523964 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 06 13:59:25.523964 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 06 13:59:25.523964 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 06 13:59:25.523964 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 42320716-ffec-4aef-90f8-d1f7aa6b9226 could not be found. Jul 06 13:59:25.523964 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi Jul 06 13:59:25.525454 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-0d529042-5507-4b4c-a2b5-07c46faa8094 tempest-VolumesSnapshotTestJSON-1412015683 tempest-VolumesSnapshotTestJSON-1412015683-project] Returning 404 to user: Instance 42320716-ffec-4aef-90f8-d1f7aa6b9226 could not be found. {{(pid=124368) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 06 13:59:25.525454 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-0d529042-5507-4b4c-a2b5-07c46faa8094 tempest-VolumesSnapshotTestJSON-1412015683 tempest-VolumesSnapshotTestJSON-1412015683-project] 10.222.0.20 "GET /compute/v2.1/servers/42320716-ffec-4aef-90f8-d1f7aa6b9226" status: 404 len: 111 microversion: 2.1 time: 0.028274 Jul 06 13:59:25.525454 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 609/1208] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:59:25 2022] GET /compute/v2.1/servers/42320716-ffec-4aef-90f8-d1f7aa6b9226 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 06 13:59:27.778462 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-90ac900e-52df-40f4-87b2-7749b62d8395 tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:59:27.779092 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-90ac900e-52df-40f4-87b2-7749b62d8395 tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] [instance: 9875fc3c-1cca-43d0-8856-2bc17d3f6eb7] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:59:27.780768 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [req-8c5320fe-8851-4fb5-98c9-979ec965da53 req-d904f977-1cb5-49e7-b8fa-b707cc10a953 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9875fc3c-1cca-43d0-8856-2bc17d3f6eb7", "tag": "e4a21c4c-d429-4422-94d4-fcf1670202ed"}]} {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 06 13:59:27.786302 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-90ac900e-52df-40f4-87b2-7749b62d8395 tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:59:27.786884 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-90ac900e-52df-40f4-87b2-7749b62d8395 tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:59:27.787880 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-90ac900e-52df-40f4-87b2-7749b62d8395 tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:59:27.788527 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-90ac900e-52df-40f4-87b2-7749b62d8395 tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:59:27.790775 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [req-8c5320fe-8851-4fb5-98c9-979ec965da53 req-d904f977-1cb5-49e7-b8fa-b707cc10a953 service nova] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:59:27.791233 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [req-8c5320fe-8851-4fb5-98c9-979ec965da53 req-d904f977-1cb5-49e7-b8fa-b707cc10a953 service nova] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:59:27.804299 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.compute.server_external_events [req-8c5320fe-8851-4fb5-98c9-979ec965da53 req-d904f977-1cb5-49e7-b8fa-b707cc10a953 service nova] Creating event network-changed:e4a21c4c-d429-4422-94d4-fcf1670202ed for instance 9875fc3c-1cca-43d0-8856-2bc17d3f6eb7 on hv-cinder-81914 Jul 06 13:59:27.809609 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [req-8c5320fe-8851-4fb5-98c9-979ec965da53 req-d904f977-1cb5-49e7-b8fa-b707cc10a953 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032601 Jul 06 13:59:27.810414 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 610/1209] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 6 13:59:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 06 13:59:27.815754 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-90ac900e-52df-40f4-87b2-7749b62d8395 tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] [instance: 9875fc3c-1cca-43d0-8856-2bc17d3f6eb7] Going to try to terminate instance {{(pid=124367) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 06 13:59:27.904069 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-90ac900e-52df-40f4-87b2-7749b62d8395 tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] 10.222.0.20 "DELETE /compute/v2.1/servers/9875fc3c-1cca-43d0-8856-2bc17d3f6eb7" status: 204 len: 0 microversion: 2.1 time: 0.128948 Jul 06 13:59:27.904971 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 600/1210] 10.222.0.20 () {58 vars in 1238 bytes} [Wed Jul 6 13:59:27 2022] DELETE /compute/v2.1/servers/9875fc3c-1cca-43d0-8856-2bc17d3f6eb7 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 06 13:59:27.916436 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-d7b18eb5-1724-422a-a15f-28c87ac92f82 tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Calling method '>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:59:27.917295 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-d7b18eb5-1724-422a-a15f-28c87ac92f82 tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] [instance: 9875fc3c-1cca-43d0-8856-2bc17d3f6eb7] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:59:27.924951 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-d7b18eb5-1724-422a-a15f-28c87ac92f82 tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:59:27.925755 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-d7b18eb5-1724-422a-a15f-28c87ac92f82 tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:59:27.926650 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-d7b18eb5-1724-422a-a15f-28c87ac92f82 tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:59:27.927197 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-d7b18eb5-1724-422a-a15f-28c87ac92f82 tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:59:28.070821 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-d7b18eb5-1724-422a-a15f-28c87ac92f82 tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32a8191b1c184c75b428579ace2da61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bf864bb1764452e8e3a6f0d5929da9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:59:28.078483 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-d7b18eb5-1724-422a-a15f-28c87ac92f82 tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] 10.222.0.20 "GET /compute/v2.1/servers/9875fc3c-1cca-43d0-8856-2bc17d3f6eb7" status: 200 len: 1578 microversion: 2.1 time: 0.167947 Jul 06 13:59:28.079057 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 611/1211] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:59:27 2022] GET /compute/v2.1/servers/9875fc3c-1cca-43d0-8856-2bc17d3f6eb7 => generated 1578 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:59:29.097385 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-1dee9fd2-fb18-4871-8813-a83e324a75cb tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:59:29.098113 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-1dee9fd2-fb18-4871-8813-a83e324a75cb tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] [instance: 9875fc3c-1cca-43d0-8856-2bc17d3f6eb7] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:59:29.104675 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-1dee9fd2-fb18-4871-8813-a83e324a75cb tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:59:29.105157 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-1dee9fd2-fb18-4871-8813-a83e324a75cb tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:59:29.105923 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-1dee9fd2-fb18-4871-8813-a83e324a75cb tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:59:29.106356 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-1dee9fd2-fb18-4871-8813-a83e324a75cb tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:59:29.243888 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-1dee9fd2-fb18-4871-8813-a83e324a75cb tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32a8191b1c184c75b428579ace2da61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bf864bb1764452e8e3a6f0d5929da9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:59:29.251656 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-1dee9fd2-fb18-4871-8813-a83e324a75cb tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] 10.222.0.20 "GET /compute/v2.1/servers/9875fc3c-1cca-43d0-8856-2bc17d3f6eb7" status: 200 len: 1578 microversion: 2.1 time: 0.159099 Jul 06 13:59:29.252231 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 601/1212] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:59:29 2022] GET /compute/v2.1/servers/9875fc3c-1cca-43d0-8856-2bc17d3f6eb7 => generated 1578 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:59:30.268784 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-f159f88a-4003-4508-b9e7-cdcb73426c43 tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Calling method '>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:59:30.269416 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-f159f88a-4003-4508-b9e7-cdcb73426c43 tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] [instance: 9875fc3c-1cca-43d0-8856-2bc17d3f6eb7] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:59:30.276451 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-f159f88a-4003-4508-b9e7-cdcb73426c43 tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:59:30.276900 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-f159f88a-4003-4508-b9e7-cdcb73426c43 tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:59:30.277751 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-f159f88a-4003-4508-b9e7-cdcb73426c43 tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:59:30.278189 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-f159f88a-4003-4508-b9e7-cdcb73426c43 tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:59:30.409976 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-f159f88a-4003-4508-b9e7-cdcb73426c43 tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32a8191b1c184c75b428579ace2da61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bf864bb1764452e8e3a6f0d5929da9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:59:30.417654 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-f159f88a-4003-4508-b9e7-cdcb73426c43 tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] 10.222.0.20 "GET /compute/v2.1/servers/9875fc3c-1cca-43d0-8856-2bc17d3f6eb7" status: 200 len: 1578 microversion: 2.1 time: 0.152761 Jul 06 13:59:30.418217 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 612/1213] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:59:30 2022] GET /compute/v2.1/servers/9875fc3c-1cca-43d0-8856-2bc17d3f6eb7 => generated 1578 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:59:31.435013 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-54ea238e-833b-4473-bbac-e3c36868f761 tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:59:31.435649 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-54ea238e-833b-4473-bbac-e3c36868f761 tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] [instance: 9875fc3c-1cca-43d0-8856-2bc17d3f6eb7] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:59:31.442143 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-54ea238e-833b-4473-bbac-e3c36868f761 tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:59:31.442592 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-54ea238e-833b-4473-bbac-e3c36868f761 tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:59:31.443350 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-54ea238e-833b-4473-bbac-e3c36868f761 tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:59:31.443782 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-54ea238e-833b-4473-bbac-e3c36868f761 tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:59:31.635507 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-54ea238e-833b-4473-bbac-e3c36868f761 tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32a8191b1c184c75b428579ace2da61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bf864bb1764452e8e3a6f0d5929da9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:59:31.643034 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-54ea238e-833b-4473-bbac-e3c36868f761 tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] 10.222.0.20 "GET /compute/v2.1/servers/9875fc3c-1cca-43d0-8856-2bc17d3f6eb7" status: 200 len: 1578 microversion: 2.1 time: 0.211878 Jul 06 13:59:31.643529 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 602/1214] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:59:31 2022] GET /compute/v2.1/servers/9875fc3c-1cca-43d0-8856-2bc17d3f6eb7 => generated 1578 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:59:32.661064 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-fbedcd09-c49a-4d9e-a36b-1104830e491e tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Calling method '>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:59:32.661798 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-fbedcd09-c49a-4d9e-a36b-1104830e491e tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] [instance: 9875fc3c-1cca-43d0-8856-2bc17d3f6eb7] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:59:32.668363 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-fbedcd09-c49a-4d9e-a36b-1104830e491e tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:59:32.668917 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-fbedcd09-c49a-4d9e-a36b-1104830e491e tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:59:32.669728 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-fbedcd09-c49a-4d9e-a36b-1104830e491e tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:59:32.670172 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-fbedcd09-c49a-4d9e-a36b-1104830e491e tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:59:32.802627 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-fbedcd09-c49a-4d9e-a36b-1104830e491e tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32a8191b1c184c75b428579ace2da61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bf864bb1764452e8e3a6f0d5929da9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 13:59:32.810587 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-fbedcd09-c49a-4d9e-a36b-1104830e491e tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] 10.222.0.20 "GET /compute/v2.1/servers/9875fc3c-1cca-43d0-8856-2bc17d3f6eb7" status: 200 len: 1460 microversion: 2.1 time: 0.153527 Jul 06 13:59:32.811162 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 613/1215] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:59:32 2022] GET /compute/v2.1/servers/9875fc3c-1cca-43d0-8856-2bc17d3f6eb7 => generated 1460 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 13:59:32.982547 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [req-ca8554b3-6f4d-42d1-a22d-c512bb8d0aea req-d50488a7-2820-48c9-8e61-08a14794c68b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9875fc3c-1cca-43d0-8856-2bc17d3f6eb7", "name": "network-vif-deleted", "tag": "e4a21c4c-d429-4422-94d4-fcf1670202ed"}]} {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 06 13:59:32.992106 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [req-ca8554b3-6f4d-42d1-a22d-c512bb8d0aea req-d50488a7-2820-48c9-8e61-08a14794c68b service nova] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:59:32.992576 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [req-ca8554b3-6f4d-42d1-a22d-c512bb8d0aea req-d50488a7-2820-48c9-8e61-08a14794c68b service nova] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:59:33.003375 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.compute.server_external_events [req-ca8554b3-6f4d-42d1-a22d-c512bb8d0aea req-d50488a7-2820-48c9-8e61-08a14794c68b service nova] Creating event network-vif-deleted:e4a21c4c-d429-4422-94d4-fcf1670202ed for instance 9875fc3c-1cca-43d0-8856-2bc17d3f6eb7 on hv-cinder-81914 Jul 06 13:59:33.008113 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [req-ca8554b3-6f4d-42d1-a22d-c512bb8d0aea req-d50488a7-2820-48c9-8e61-08a14794c68b service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029239 Jul 06 13:59:33.008667 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 603/1216] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 6 13:59:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 06 13:59:33.827887 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-b0b9fd02-af91-4f49-bccd-50c926be087b tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Calling method '>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:59:33.828411 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-b0b9fd02-af91-4f49-bccd-50c926be087b tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] [instance: 9875fc3c-1cca-43d0-8856-2bc17d3f6eb7] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:59:33.834784 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-b0b9fd02-af91-4f49-bccd-50c926be087b tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:59:33.835275 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-b0b9fd02-af91-4f49-bccd-50c926be087b tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:59:33.836590 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-b0b9fd02-af91-4f49-bccd-50c926be087b tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:59:33.837234 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-b0b9fd02-af91-4f49-bccd-50c926be087b tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:59:33.852374 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.wsgi [None req-b0b9fd02-af91-4f49-bccd-50c926be087b tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] HTTP exception thrown: Instance 9875fc3c-1cca-43d0-8856-2bc17d3f6eb7 could not be found. Jul 06 13:59:33.854306 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-b0b9fd02-af91-4f49-bccd-50c926be087b tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Request method failure captured: Jul 06 13:59:33.854306 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: request: GET /compute/v2.1/servers/9875fc3c-1cca-43d0-8856-2bc17d3f6eb7 HTTP/1.1 Jul 06 13:59:33.854306 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: Accept: application/json Jul 06 13:59:33.854306 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: Accept-Encoding: identity Jul 06 13:59:33.854306 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: Connection: close Jul 06 13:59:33.854306 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: Content-Length: 0 Jul 06 13:59:33.854306 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: Content-Type: application/json Jul 06 13:59:33.854306 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: Host: 10.222.0.20 Jul 06 13:59:33.854306 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: Openstack-System-Scope: None Jul 06 13:59:33.854306 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: User-Agent: python-urllib3/1.26.9 Jul 06 13:59:33.854306 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Auth-Token: gAAAAABixZMbzmQPuLb9eh7_wXbVtplKuSudXuDoBzcGG0h6H9K75eus4_iB1ZFKy4bESIau_fZym9tMOHqvZk7NQzyFwFdJ9Jwex7NZc4b081tafcq6ScHtYips0bVDv_wr4GybhPEVGesDE24fRD-oc850BV4RrzVUwtUsD3NO364nPnk60A8 Jul 06 13:59:33.854306 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Domain-Id: None Jul 06 13:59:33.854306 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Domain-Name: None Jul 06 13:59:33.854306 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Identity-Status: Confirmed Jul 06 13:59:33.854306 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Is-Admin-Project: True Jul 06 13:59:33.854306 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Project-Domain-Id: default Jul 06 13:59:33.854306 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Project-Domain-Name: Default Jul 06 13:59:33.854306 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Project-Id: 7bf864bb1764452e8e3a6f0d5929da9f Jul 06 13:59:33.854306 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Project-Name: tempest-TestVolumeBootPattern-1396741004 Jul 06 13:59:33.854306 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Role: reader,member Jul 06 13:59:33.854306 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Roles: reader,member Jul 06 13:59:33.856680 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_7bf864bb1764452e8e3a6f0d5929da9f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/7bf864bb1764452e8e3a6f0d5929da9f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/7bf864bb1764452e8e3a6f0d5929da9f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/7bf864bb1764452e8e3a6f0d5929da9f"}]}] Jul 06 13:59:33.856680 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Tenant: tempest-TestVolumeBootPattern-1396741004 Jul 06 13:59:33.856680 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Tenant-Id: 7bf864bb1764452e8e3a6f0d5929da9f Jul 06 13:59:33.856680 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Tenant-Name: tempest-TestVolumeBootPattern-1396741004 Jul 06 13:59:33.856680 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-User: tempest-TestVolumeBootPattern-1396741004-project Jul 06 13:59:33.856680 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-User-Domain-Id: default Jul 06 13:59:33.856680 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-User-Domain-Name: Default Jul 06 13:59:33.856680 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-User-Id: 32a8191b1c184c75b428579ace2da61c Jul 06 13:59:33.856680 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-User-Name: tempest-TestVolumeBootPattern-1396741004-project Jul 06 13:59:33.856680 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: method: > Jul 06 13:59:33.856680 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: exception: Instance 9875fc3c-1cca-43d0-8856-2bc17d3f6eb7 could not be found. Jul 06 13:59:33.856680 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: action_args: {'id': '9875fc3c-1cca-43d0-8856-2bc17d3f6eb7'} Jul 06 13:59:33.857673 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 06 13:59:33.857673 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 06 13:59:33.857673 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 06 13:59:33.857673 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 06 13:59:33.857673 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 06 13:59:33.857673 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 06 13:59:33.857673 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 06 13:59:33.857673 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 06 13:59:33.857673 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 06 13:59:33.857673 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 06 13:59:33.857673 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9875fc3c-1cca-43d0-8856-2bc17d3f6eb7 could not be found. Jul 06 13:59:33.857673 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi Jul 06 13:59:33.857673 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 06 13:59:33.857673 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi Jul 06 13:59:33.857673 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 06 13:59:33.857673 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 06 13:59:33.857673 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 06 13:59:33.857673 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 06 13:59:33.857673 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 06 13:59:33.857673 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 06 13:59:33.859211 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 06 13:59:33.859211 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 06 13:59:33.859211 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 06 13:59:33.859211 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 06 13:59:33.859211 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 06 13:59:33.859211 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 06 13:59:33.859211 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 06 13:59:33.859211 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9875fc3c-1cca-43d0-8856-2bc17d3f6eb7 could not be found. Jul 06 13:59:33.859211 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi Jul 06 13:59:33.859211 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 06 13:59:33.859211 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi Jul 06 13:59:33.859211 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 06 13:59:33.859211 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 06 13:59:33.859211 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 06 13:59:33.859211 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 06 13:59:33.859211 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 06 13:59:33.859211 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9875fc3c-1cca-43d0-8856-2bc17d3f6eb7 could not be found. Jul 06 13:59:33.859211 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi Jul 06 13:59:33.860603 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-b0b9fd02-af91-4f49-bccd-50c926be087b tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Returning 404 to user: Instance 9875fc3c-1cca-43d0-8856-2bc17d3f6eb7 could not be found. {{(pid=124368) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 06 13:59:33.860603 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-b0b9fd02-af91-4f49-bccd-50c926be087b tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] 10.222.0.20 "GET /compute/v2.1/servers/9875fc3c-1cca-43d0-8856-2bc17d3f6eb7" status: 404 len: 111 microversion: 2.1 time: 0.032068 Jul 06 13:59:33.860603 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 614/1217] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:59:33 2022] GET /compute/v2.1/servers/9875fc3c-1cca-43d0-8856-2bc17d3f6eb7 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 06 13:59:34.315470 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-d923ad21-3567-4bfc-b0f3-96ad31766f3c tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:59:34.316047 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-d923ad21-3567-4bfc-b0f3-96ad31766f3c tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] [instance: ee2271a7-8fab-4455-9c3b-32159f33ad03] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:59:34.322858 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-d923ad21-3567-4bfc-b0f3-96ad31766f3c tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:59:34.323303 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-d923ad21-3567-4bfc-b0f3-96ad31766f3c tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:59:34.324053 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-d923ad21-3567-4bfc-b0f3-96ad31766f3c tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:59:34.324484 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-d923ad21-3567-4bfc-b0f3-96ad31766f3c tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:59:34.338291 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.wsgi [None req-d923ad21-3567-4bfc-b0f3-96ad31766f3c tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] HTTP exception thrown: Instance ee2271a7-8fab-4455-9c3b-32159f33ad03 could not be found. Jul 06 13:59:34.339933 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-d923ad21-3567-4bfc-b0f3-96ad31766f3c tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Request method failure captured: Jul 06 13:59:34.339933 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: request: DELETE /compute/v2.1/servers/ee2271a7-8fab-4455-9c3b-32159f33ad03 HTTP/1.1 Jul 06 13:59:34.339933 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: Accept: application/json Jul 06 13:59:34.339933 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: Accept-Encoding: identity Jul 06 13:59:34.339933 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: Connection: close Jul 06 13:59:34.339933 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: Content-Length: 0 Jul 06 13:59:34.339933 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: Content-Type: application/json Jul 06 13:59:34.339933 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: Host: 10.222.0.20 Jul 06 13:59:34.339933 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: Openstack-System-Scope: None Jul 06 13:59:34.339933 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: User-Agent: python-urllib3/1.26.9 Jul 06 13:59:34.339933 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: X-Auth-Token: gAAAAABixZMbzmQPuLb9eh7_wXbVtplKuSudXuDoBzcGG0h6H9K75eus4_iB1ZFKy4bESIau_fZym9tMOHqvZk7NQzyFwFdJ9Jwex7NZc4b081tafcq6ScHtYips0bVDv_wr4GybhPEVGesDE24fRD-oc850BV4RrzVUwtUsD3NO364nPnk60A8 Jul 06 13:59:34.339933 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: X-Domain-Id: None Jul 06 13:59:34.339933 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: X-Domain-Name: None Jul 06 13:59:34.339933 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: X-Identity-Status: Confirmed Jul 06 13:59:34.339933 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: X-Is-Admin-Project: True Jul 06 13:59:34.339933 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: X-Project-Domain-Id: default Jul 06 13:59:34.339933 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: X-Project-Domain-Name: Default Jul 06 13:59:34.339933 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: X-Project-Id: 7bf864bb1764452e8e3a6f0d5929da9f Jul 06 13:59:34.339933 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: X-Project-Name: tempest-TestVolumeBootPattern-1396741004 Jul 06 13:59:34.339933 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: X-Role: reader,member Jul 06 13:59:34.339933 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: X-Roles: reader,member Jul 06 13:59:34.341577 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_7bf864bb1764452e8e3a6f0d5929da9f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/7bf864bb1764452e8e3a6f0d5929da9f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/7bf864bb1764452e8e3a6f0d5929da9f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/7bf864bb1764452e8e3a6f0d5929da9f"}]}] Jul 06 13:59:34.341577 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: X-Tenant: tempest-TestVolumeBootPattern-1396741004 Jul 06 13:59:34.341577 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: X-Tenant-Id: 7bf864bb1764452e8e3a6f0d5929da9f Jul 06 13:59:34.341577 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: X-Tenant-Name: tempest-TestVolumeBootPattern-1396741004 Jul 06 13:59:34.341577 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: X-User: tempest-TestVolumeBootPattern-1396741004-project Jul 06 13:59:34.341577 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: X-User-Domain-Id: default Jul 06 13:59:34.341577 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: X-User-Domain-Name: Default Jul 06 13:59:34.341577 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: X-User-Id: 32a8191b1c184c75b428579ace2da61c Jul 06 13:59:34.341577 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: X-User-Name: tempest-TestVolumeBootPattern-1396741004-project Jul 06 13:59:34.341577 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: method: > Jul 06 13:59:34.341577 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: exception: Instance ee2271a7-8fab-4455-9c3b-32159f33ad03 could not be found. Jul 06 13:59:34.341577 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: action_args: {'id': 'ee2271a7-8fab-4455-9c3b-32159f33ad03'} Jul 06 13:59:34.342415 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 06 13:59:34.342415 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 06 13:59:34.342415 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 06 13:59:34.342415 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 06 13:59:34.342415 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 06 13:59:34.342415 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 06 13:59:34.342415 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 06 13:59:34.342415 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 06 13:59:34.342415 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 06 13:59:34.342415 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 06 13:59:34.342415 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ee2271a7-8fab-4455-9c3b-32159f33ad03 could not be found. Jul 06 13:59:34.342415 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi Jul 06 13:59:34.342415 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 06 13:59:34.342415 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi Jul 06 13:59:34.342415 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 06 13:59:34.342415 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 06 13:59:34.342415 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 06 13:59:34.342415 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 06 13:59:34.342415 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 06 13:59:34.342415 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 06 13:59:34.343676 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 06 13:59:34.343676 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 06 13:59:34.343676 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 06 13:59:34.343676 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 06 13:59:34.343676 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 06 13:59:34.343676 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 06 13:59:34.343676 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 06 13:59:34.343676 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 06 13:59:34.343676 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 06 13:59:34.343676 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ee2271a7-8fab-4455-9c3b-32159f33ad03 could not be found. Jul 06 13:59:34.343676 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi Jul 06 13:59:34.343676 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 06 13:59:34.343676 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi Jul 06 13:59:34.343676 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 06 13:59:34.343676 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 06 13:59:34.343676 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 06 13:59:34.343676 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 06 13:59:34.343676 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 06 13:59:34.343676 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ee2271a7-8fab-4455-9c3b-32159f33ad03 could not be found. Jul 06 13:59:34.343676 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi Jul 06 13:59:34.344931 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-d923ad21-3567-4bfc-b0f3-96ad31766f3c tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Returning 404 to user: Instance ee2271a7-8fab-4455-9c3b-32159f33ad03 could not be found. {{(pid=124367) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 06 13:59:34.344931 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-d923ad21-3567-4bfc-b0f3-96ad31766f3c tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] 10.222.0.20 "DELETE /compute/v2.1/servers/ee2271a7-8fab-4455-9c3b-32159f33ad03" status: 404 len: 111 microversion: 2.1 time: 0.030511 Jul 06 13:59:34.344931 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 604/1218] 10.222.0.20 () {58 vars in 1238 bytes} [Wed Jul 6 13:59:34 2022] DELETE /compute/v2.1/servers/ee2271a7-8fab-4455-9c3b-32159f33ad03 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 06 13:59:34.349755 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-73e3678c-700a-4fa7-a664-0d68f1ede13f tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Calling method '>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:59:34.350366 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-73e3678c-700a-4fa7-a664-0d68f1ede13f tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] [instance: ee2271a7-8fab-4455-9c3b-32159f33ad03] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 13:59:34.356376 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-73e3678c-700a-4fa7-a664-0d68f1ede13f tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:59:34.356827 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-73e3678c-700a-4fa7-a664-0d68f1ede13f tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:59:34.357619 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-73e3678c-700a-4fa7-a664-0d68f1ede13f tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 13:59:34.358058 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-73e3678c-700a-4fa7-a664-0d68f1ede13f tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 13:59:34.373231 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.wsgi [None req-73e3678c-700a-4fa7-a664-0d68f1ede13f tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] HTTP exception thrown: Instance ee2271a7-8fab-4455-9c3b-32159f33ad03 could not be found. Jul 06 13:59:34.374737 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-73e3678c-700a-4fa7-a664-0d68f1ede13f tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Request method failure captured: Jul 06 13:59:34.374737 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: request: GET /compute/v2.1/servers/ee2271a7-8fab-4455-9c3b-32159f33ad03 HTTP/1.1 Jul 06 13:59:34.374737 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: Accept: application/json Jul 06 13:59:34.374737 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: Accept-Encoding: identity Jul 06 13:59:34.374737 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: Connection: close Jul 06 13:59:34.374737 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: Content-Length: 0 Jul 06 13:59:34.374737 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: Content-Type: application/json Jul 06 13:59:34.374737 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: Host: 10.222.0.20 Jul 06 13:59:34.374737 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: Openstack-System-Scope: None Jul 06 13:59:34.374737 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: User-Agent: python-urllib3/1.26.9 Jul 06 13:59:34.374737 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Auth-Token: gAAAAABixZMbzmQPuLb9eh7_wXbVtplKuSudXuDoBzcGG0h6H9K75eus4_iB1ZFKy4bESIau_fZym9tMOHqvZk7NQzyFwFdJ9Jwex7NZc4b081tafcq6ScHtYips0bVDv_wr4GybhPEVGesDE24fRD-oc850BV4RrzVUwtUsD3NO364nPnk60A8 Jul 06 13:59:34.374737 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Domain-Id: None Jul 06 13:59:34.374737 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Domain-Name: None Jul 06 13:59:34.374737 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Identity-Status: Confirmed Jul 06 13:59:34.374737 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Is-Admin-Project: True Jul 06 13:59:34.374737 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Project-Domain-Id: default Jul 06 13:59:34.374737 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Project-Domain-Name: Default Jul 06 13:59:34.374737 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Project-Id: 7bf864bb1764452e8e3a6f0d5929da9f Jul 06 13:59:34.374737 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Project-Name: tempest-TestVolumeBootPattern-1396741004 Jul 06 13:59:34.374737 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Role: reader,member Jul 06 13:59:34.374737 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Roles: reader,member Jul 06 13:59:34.376318 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_7bf864bb1764452e8e3a6f0d5929da9f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/7bf864bb1764452e8e3a6f0d5929da9f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/7bf864bb1764452e8e3a6f0d5929da9f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/7bf864bb1764452e8e3a6f0d5929da9f"}]}] Jul 06 13:59:34.376318 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Tenant: tempest-TestVolumeBootPattern-1396741004 Jul 06 13:59:34.376318 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Tenant-Id: 7bf864bb1764452e8e3a6f0d5929da9f Jul 06 13:59:34.376318 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Tenant-Name: tempest-TestVolumeBootPattern-1396741004 Jul 06 13:59:34.376318 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-User: tempest-TestVolumeBootPattern-1396741004-project Jul 06 13:59:34.376318 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-User-Domain-Id: default Jul 06 13:59:34.376318 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-User-Domain-Name: Default Jul 06 13:59:34.376318 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-User-Id: 32a8191b1c184c75b428579ace2da61c Jul 06 13:59:34.376318 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-User-Name: tempest-TestVolumeBootPattern-1396741004-project Jul 06 13:59:34.376318 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: method: > Jul 06 13:59:34.376318 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: exception: Instance ee2271a7-8fab-4455-9c3b-32159f33ad03 could not be found. Jul 06 13:59:34.376318 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: action_args: {'id': 'ee2271a7-8fab-4455-9c3b-32159f33ad03'} Jul 06 13:59:34.377253 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 06 13:59:34.377253 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 06 13:59:34.377253 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 06 13:59:34.377253 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 06 13:59:34.377253 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 06 13:59:34.377253 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 06 13:59:34.377253 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 06 13:59:34.377253 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 06 13:59:34.377253 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 06 13:59:34.377253 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 06 13:59:34.377253 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ee2271a7-8fab-4455-9c3b-32159f33ad03 could not be found. Jul 06 13:59:34.377253 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi Jul 06 13:59:34.377253 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 06 13:59:34.377253 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi Jul 06 13:59:34.377253 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 06 13:59:34.377253 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 06 13:59:34.377253 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 06 13:59:34.377253 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 06 13:59:34.377253 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 06 13:59:34.377253 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 06 13:59:34.378795 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 06 13:59:34.378795 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 06 13:59:34.378795 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 06 13:59:34.378795 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 06 13:59:34.378795 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 06 13:59:34.378795 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 06 13:59:34.378795 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 06 13:59:34.378795 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ee2271a7-8fab-4455-9c3b-32159f33ad03 could not be found. Jul 06 13:59:34.378795 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi Jul 06 13:59:34.378795 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 06 13:59:34.378795 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi Jul 06 13:59:34.378795 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 06 13:59:34.378795 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 06 13:59:34.378795 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 06 13:59:34.378795 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 06 13:59:34.378795 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 06 13:59:34.378795 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ee2271a7-8fab-4455-9c3b-32159f33ad03 could not be found. Jul 06 13:59:34.378795 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi Jul 06 13:59:34.380400 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-73e3678c-700a-4fa7-a664-0d68f1ede13f tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Returning 404 to user: Instance ee2271a7-8fab-4455-9c3b-32159f33ad03 could not be found. {{(pid=124368) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 06 13:59:34.380400 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-73e3678c-700a-4fa7-a664-0d68f1ede13f tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] 10.222.0.20 "GET /compute/v2.1/servers/ee2271a7-8fab-4455-9c3b-32159f33ad03" status: 404 len: 111 microversion: 2.1 time: 0.030131 Jul 06 13:59:34.380400 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 615/1219] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 6 13:59:34 2022] GET /compute/v2.1/servers/ee2271a7-8fab-4455-9c3b-32159f33ad03 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 06 13:59:35.666925 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-2310945c-e85c-4e71-adae-95f1d75911a0 tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] Calling method '.version_select at 0x7ffbc42ef0d0>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 13:59:35.685384 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-2310945c-e85c-4e71-adae-95f1d75911a0 tempest-TestVolumeBootPattern-1396741004 tempest-TestVolumeBootPattern-1396741004-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1950493681" status: 202 len: 0 microversion: 2.1 time: 0.022303 Jul 06 13:59:35.685956 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 605/1220] 10.222.0.20 () {58 vars in 1262 bytes} [Wed Jul 6 13:59:35 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1950493681 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 06 14:00:01.148120 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-b95b1f39-b8c0-4bc9-971d-b43c63b1a35f tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Calling method '>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 14:00:01.148698 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-b95b1f39-b8c0-4bc9-971d-b43c63b1a35f tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] [instance: 3478e8af-1c05-4921-b7ee-e882acb9a65a] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 14:00:01.150755 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG dbcounter [-] [124368] Writing DB stats nova_api:SELECT=37,nova_api:UPDATE=1 {{(pid=124368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 14:00:01.151407 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG dbcounter [-] [124368] Writing DB stats nova_cell1:SELECT=79,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=124368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 14:00:01.157097 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-b95b1f39-b8c0-4bc9-971d-b43c63b1a35f tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 14:00:01.157546 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-b95b1f39-b8c0-4bc9-971d-b43c63b1a35f tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 14:00:01.158311 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-b95b1f39-b8c0-4bc9-971d-b43c63b1a35f tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 14:00:01.158746 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-b95b1f39-b8c0-4bc9-971d-b43c63b1a35f tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 14:00:01.184684 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-b95b1f39-b8c0-4bc9-971d-b43c63b1a35f tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] 10.222.0.20 "GET /compute/v2.1/servers/3478e8af-1c05-4921-b7ee-e882acb9a65a/ips" status: 200 len: 153 microversion: 2.20 time: 0.040632 Jul 06 14:00:01.185348 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 616/1221] 10.222.0.20 () {60 vars in 1288 bytes} [Wed Jul 6 14:00:01 2022] GET /compute/v2.1/servers/3478e8af-1c05-4921-b7ee-e882acb9a65a/ips => generated 153 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 06 14:00:03.282546 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG dbcounter [-] [124367] Writing DB stats nova_cell1:SELECT=86,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=124367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 14:00:03.283286 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG dbcounter [-] [124367] Writing DB stats nova_api:SELECT=43,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=124367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 14:00:03.287855 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-a5312f87-c97e-49dc-9999-d658c3017713 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 06 14:00:03.288625 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-a5312f87-c97e-49dc-9999-d658c3017713 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] [instance: 3478e8af-1c05-4921-b7ee-e882acb9a65a] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 14:00:03.298030 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-a5312f87-c97e-49dc-9999-d658c3017713 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 14:00:03.298476 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-a5312f87-c97e-49dc-9999-d658c3017713 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 14:00:03.299254 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-a5312f87-c97e-49dc-9999-d658c3017713 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 14:00:03.299684 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-a5312f87-c97e-49dc-9999-d658c3017713 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 14:00:03.326581 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.objects.instance [None req-a5312f87-c97e-49dc-9999-d658c3017713 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lazy-loading 'flavor' on Instance uuid 3478e8af-1c05-4921-b7ee-e882acb9a65a {{(pid=124367) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 06 14:00:03.619686 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-a5312f87-c97e-49dc-9999-d658c3017713 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] 10.222.0.20 "POST /compute/v2.1/servers/3478e8af-1c05-4921-b7ee-e882acb9a65a/action" status: 202 len: 0 microversion: 2.20 time: 0.338490 Jul 06 14:00:03.620423 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 606/1222] 10.222.0.20 () {62 vars in 1318 bytes} [Wed Jul 6 14:00:03 2022] POST /compute/v2.1/servers/3478e8af-1c05-4921-b7ee-e882acb9a65a/action => generated 0 bytes in 340 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 06 14:00:03.628489 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-0d766e19-d35f-469d-a4fb-6332e95bdb83 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Calling method '>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 14:00:03.629166 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-0d766e19-d35f-469d-a4fb-6332e95bdb83 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] [instance: 3478e8af-1c05-4921-b7ee-e882acb9a65a] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 14:00:03.635774 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-0d766e19-d35f-469d-a4fb-6332e95bdb83 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 14:00:03.636236 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-0d766e19-d35f-469d-a4fb-6332e95bdb83 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 14:00:03.637047 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-0d766e19-d35f-469d-a4fb-6332e95bdb83 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 14:00:03.637508 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-0d766e19-d35f-469d-a4fb-6332e95bdb83 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 14:00:03.769584 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-0d766e19-d35f-469d-a4fb-6332e95bdb83 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c85251638bc64deca16008b696b11ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3edb8d53184b98b7055ffc145f186d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 14:00:03.778022 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-0d766e19-d35f-469d-a4fb-6332e95bdb83 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c85251638bc64deca16008b696b11ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3edb8d53184b98b7055ffc145f186d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 14:00:03.779517 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-0d766e19-d35f-469d-a4fb-6332e95bdb83 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c85251638bc64deca16008b696b11ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3edb8d53184b98b7055ffc145f186d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 14:00:03.780670 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-0d766e19-d35f-469d-a4fb-6332e95bdb83 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] 10.222.0.20 "GET /compute/v2.1/servers/3478e8af-1c05-4921-b7ee-e882acb9a65a" status: 200 len: 1722 microversion: 2.20 time: 0.156110 Jul 06 14:00:03.781260 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 617/1223] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 6 14:00:03 2022] GET /compute/v2.1/servers/3478e8af-1c05-4921-b7ee-e882acb9a65a => generated 1722 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 06 14:00:04.800903 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-ffd8bde1-08f0-411a-a117-fcefbcffd0ad tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 14:00:04.801628 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-ffd8bde1-08f0-411a-a117-fcefbcffd0ad tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] [instance: 3478e8af-1c05-4921-b7ee-e882acb9a65a] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 14:00:04.808898 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-ffd8bde1-08f0-411a-a117-fcefbcffd0ad tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 14:00:04.809384 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-ffd8bde1-08f0-411a-a117-fcefbcffd0ad tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 14:00:04.810150 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-ffd8bde1-08f0-411a-a117-fcefbcffd0ad tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 14:00:04.810588 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-ffd8bde1-08f0-411a-a117-fcefbcffd0ad tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 14:00:04.941106 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-ffd8bde1-08f0-411a-a117-fcefbcffd0ad tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c85251638bc64deca16008b696b11ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3edb8d53184b98b7055ffc145f186d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 14:00:04.949709 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-ffd8bde1-08f0-411a-a117-fcefbcffd0ad tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c85251638bc64deca16008b696b11ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3edb8d53184b98b7055ffc145f186d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 14:00:04.951224 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-ffd8bde1-08f0-411a-a117-fcefbcffd0ad tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c85251638bc64deca16008b696b11ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3edb8d53184b98b7055ffc145f186d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 14:00:04.952391 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-ffd8bde1-08f0-411a-a117-fcefbcffd0ad tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] 10.222.0.20 "GET /compute/v2.1/servers/3478e8af-1c05-4921-b7ee-e882acb9a65a" status: 200 len: 1722 microversion: 2.20 time: 0.156351 Jul 06 14:00:04.952949 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 607/1224] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 6 14:00:04 2022] GET /compute/v2.1/servers/3478e8af-1c05-4921-b7ee-e882acb9a65a => generated 1722 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 06 14:00:05.971310 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-6a83012d-9f80-4af8-af65-2d4d6ce6ffdf tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Calling method '>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 14:00:05.971930 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-6a83012d-9f80-4af8-af65-2d4d6ce6ffdf tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] [instance: 3478e8af-1c05-4921-b7ee-e882acb9a65a] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 14:00:05.979673 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-6a83012d-9f80-4af8-af65-2d4d6ce6ffdf tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 14:00:05.980127 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-6a83012d-9f80-4af8-af65-2d4d6ce6ffdf tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 14:00:05.980900 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-6a83012d-9f80-4af8-af65-2d4d6ce6ffdf tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 14:00:05.981365 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-6a83012d-9f80-4af8-af65-2d4d6ce6ffdf tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 14:00:06.112216 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-6a83012d-9f80-4af8-af65-2d4d6ce6ffdf tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c85251638bc64deca16008b696b11ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3edb8d53184b98b7055ffc145f186d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 14:00:06.120408 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-6a83012d-9f80-4af8-af65-2d4d6ce6ffdf tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c85251638bc64deca16008b696b11ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3edb8d53184b98b7055ffc145f186d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 14:00:06.121955 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-6a83012d-9f80-4af8-af65-2d4d6ce6ffdf tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c85251638bc64deca16008b696b11ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3edb8d53184b98b7055ffc145f186d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 14:00:06.123116 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-6a83012d-9f80-4af8-af65-2d4d6ce6ffdf tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] 10.222.0.20 "GET /compute/v2.1/servers/3478e8af-1c05-4921-b7ee-e882acb9a65a" status: 200 len: 1722 microversion: 2.20 time: 0.155715 Jul 06 14:00:06.123672 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 618/1225] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 6 14:00:05 2022] GET /compute/v2.1/servers/3478e8af-1c05-4921-b7ee-e882acb9a65a => generated 1722 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 06 14:00:07.141264 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-cd0a798b-8a71-4f42-87bd-36fcaa9aefc5 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 14:00:07.141848 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-cd0a798b-8a71-4f42-87bd-36fcaa9aefc5 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] [instance: 3478e8af-1c05-4921-b7ee-e882acb9a65a] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 14:00:07.148952 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-cd0a798b-8a71-4f42-87bd-36fcaa9aefc5 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 14:00:07.149416 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-cd0a798b-8a71-4f42-87bd-36fcaa9aefc5 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 14:00:07.150168 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-cd0a798b-8a71-4f42-87bd-36fcaa9aefc5 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 14:00:07.150597 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-cd0a798b-8a71-4f42-87bd-36fcaa9aefc5 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 14:00:07.278718 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-cd0a798b-8a71-4f42-87bd-36fcaa9aefc5 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c85251638bc64deca16008b696b11ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3edb8d53184b98b7055ffc145f186d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 14:00:07.286505 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-cd0a798b-8a71-4f42-87bd-36fcaa9aefc5 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c85251638bc64deca16008b696b11ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3edb8d53184b98b7055ffc145f186d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 14:00:07.287994 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-cd0a798b-8a71-4f42-87bd-36fcaa9aefc5 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c85251638bc64deca16008b696b11ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3edb8d53184b98b7055ffc145f186d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 14:00:07.289672 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-cd0a798b-8a71-4f42-87bd-36fcaa9aefc5 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] 10.222.0.20 "GET /compute/v2.1/servers/3478e8af-1c05-4921-b7ee-e882acb9a65a" status: 200 len: 1722 microversion: 2.20 time: 0.152348 Jul 06 14:00:07.290218 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 608/1226] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 6 14:00:07 2022] GET /compute/v2.1/servers/3478e8af-1c05-4921-b7ee-e882acb9a65a => generated 1722 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 06 14:00:08.308089 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-fa408cc8-4c1f-40bc-b98f-3113095e9bee tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Calling method '>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 14:00:08.308764 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-fa408cc8-4c1f-40bc-b98f-3113095e9bee tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] [instance: 3478e8af-1c05-4921-b7ee-e882acb9a65a] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 14:00:08.315249 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-fa408cc8-4c1f-40bc-b98f-3113095e9bee tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 14:00:08.315704 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-fa408cc8-4c1f-40bc-b98f-3113095e9bee tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 14:00:08.316467 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-fa408cc8-4c1f-40bc-b98f-3113095e9bee tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 14:00:08.316905 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-fa408cc8-4c1f-40bc-b98f-3113095e9bee tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 14:00:08.446714 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-fa408cc8-4c1f-40bc-b98f-3113095e9bee tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c85251638bc64deca16008b696b11ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3edb8d53184b98b7055ffc145f186d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 14:00:08.454862 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-fa408cc8-4c1f-40bc-b98f-3113095e9bee tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c85251638bc64deca16008b696b11ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3edb8d53184b98b7055ffc145f186d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 14:00:08.456407 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-fa408cc8-4c1f-40bc-b98f-3113095e9bee tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c85251638bc64deca16008b696b11ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3edb8d53184b98b7055ffc145f186d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 14:00:08.457609 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-fa408cc8-4c1f-40bc-b98f-3113095e9bee tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] 10.222.0.20 "GET /compute/v2.1/servers/3478e8af-1c05-4921-b7ee-e882acb9a65a" status: 200 len: 1722 microversion: 2.20 time: 0.153603 Jul 06 14:00:08.458170 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 619/1227] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 6 14:00:08 2022] GET /compute/v2.1/servers/3478e8af-1c05-4921-b7ee-e882acb9a65a => generated 1722 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 06 14:00:09.476704 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-03d9ece6-d207-4096-a341-66f3f3cbe527 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 14:00:09.477333 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-03d9ece6-d207-4096-a341-66f3f3cbe527 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] [instance: 3478e8af-1c05-4921-b7ee-e882acb9a65a] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 14:00:09.483874 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-03d9ece6-d207-4096-a341-66f3f3cbe527 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 14:00:09.484327 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-03d9ece6-d207-4096-a341-66f3f3cbe527 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 14:00:09.485116 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-03d9ece6-d207-4096-a341-66f3f3cbe527 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 14:00:09.485553 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-03d9ece6-d207-4096-a341-66f3f3cbe527 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 14:00:09.613949 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-03d9ece6-d207-4096-a341-66f3f3cbe527 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c85251638bc64deca16008b696b11ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3edb8d53184b98b7055ffc145f186d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 14:00:09.621859 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-03d9ece6-d207-4096-a341-66f3f3cbe527 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c85251638bc64deca16008b696b11ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3edb8d53184b98b7055ffc145f186d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 14:00:09.623341 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-03d9ece6-d207-4096-a341-66f3f3cbe527 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c85251638bc64deca16008b696b11ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3edb8d53184b98b7055ffc145f186d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 14:00:09.624488 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-03d9ece6-d207-4096-a341-66f3f3cbe527 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] 10.222.0.20 "GET /compute/v2.1/servers/3478e8af-1c05-4921-b7ee-e882acb9a65a" status: 200 len: 1722 microversion: 2.20 time: 0.151765 Jul 06 14:00:09.625065 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 609/1228] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 6 14:00:09 2022] GET /compute/v2.1/servers/3478e8af-1c05-4921-b7ee-e882acb9a65a => generated 1722 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 06 14:00:10.643204 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-7a7403ec-e4e1-4f54-8916-b005b160f63e tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Calling method '>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 14:00:10.643742 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-7a7403ec-e4e1-4f54-8916-b005b160f63e tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] [instance: 3478e8af-1c05-4921-b7ee-e882acb9a65a] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 14:00:10.651322 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-7a7403ec-e4e1-4f54-8916-b005b160f63e tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 14:00:10.651776 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-7a7403ec-e4e1-4f54-8916-b005b160f63e tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 14:00:10.652545 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-7a7403ec-e4e1-4f54-8916-b005b160f63e tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 14:00:10.652982 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-7a7403ec-e4e1-4f54-8916-b005b160f63e tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 14:00:10.782948 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-7a7403ec-e4e1-4f54-8916-b005b160f63e tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c85251638bc64deca16008b696b11ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3edb8d53184b98b7055ffc145f186d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 14:00:10.791202 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-7a7403ec-e4e1-4f54-8916-b005b160f63e tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c85251638bc64deca16008b696b11ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3edb8d53184b98b7055ffc145f186d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 14:00:10.792725 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-7a7403ec-e4e1-4f54-8916-b005b160f63e tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c85251638bc64deca16008b696b11ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3edb8d53184b98b7055ffc145f186d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 14:00:10.793932 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-7a7403ec-e4e1-4f54-8916-b005b160f63e tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] 10.222.0.20 "GET /compute/v2.1/servers/3478e8af-1c05-4921-b7ee-e882acb9a65a" status: 200 len: 1722 microversion: 2.20 time: 0.154717 Jul 06 14:00:10.794491 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 620/1229] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 6 14:00:10 2022] GET /compute/v2.1/servers/3478e8af-1c05-4921-b7ee-e882acb9a65a => generated 1722 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 06 14:00:11.812874 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-6abca35d-a893-4ed7-820f-8d3c56dc155f tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 14:00:11.813515 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-6abca35d-a893-4ed7-820f-8d3c56dc155f tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] [instance: 3478e8af-1c05-4921-b7ee-e882acb9a65a] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 14:00:11.820367 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-6abca35d-a893-4ed7-820f-8d3c56dc155f tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 14:00:11.820516 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-6abca35d-a893-4ed7-820f-8d3c56dc155f tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 14:00:11.821202 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-6abca35d-a893-4ed7-820f-8d3c56dc155f tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 14:00:11.821632 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-6abca35d-a893-4ed7-820f-8d3c56dc155f tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 14:00:11.953701 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-6abca35d-a893-4ed7-820f-8d3c56dc155f tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c85251638bc64deca16008b696b11ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3edb8d53184b98b7055ffc145f186d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 14:00:11.962093 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-6abca35d-a893-4ed7-820f-8d3c56dc155f tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c85251638bc64deca16008b696b11ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3edb8d53184b98b7055ffc145f186d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 14:00:11.963580 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-6abca35d-a893-4ed7-820f-8d3c56dc155f tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c85251638bc64deca16008b696b11ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3edb8d53184b98b7055ffc145f186d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 14:00:11.964720 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-6abca35d-a893-4ed7-820f-8d3c56dc155f tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] 10.222.0.20 "GET /compute/v2.1/servers/3478e8af-1c05-4921-b7ee-e882acb9a65a" status: 200 len: 1722 microversion: 2.20 time: 0.155799 Jul 06 14:00:11.965307 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 610/1230] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 6 14:00:11 2022] GET /compute/v2.1/servers/3478e8af-1c05-4921-b7ee-e882acb9a65a => generated 1722 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 06 14:00:12.983040 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-1414fb15-ba6f-49f0-9a74-56802a92cca9 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Calling method '>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 14:00:12.983647 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-1414fb15-ba6f-49f0-9a74-56802a92cca9 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] [instance: 3478e8af-1c05-4921-b7ee-e882acb9a65a] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 14:00:12.990371 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-1414fb15-ba6f-49f0-9a74-56802a92cca9 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 14:00:12.990821 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-1414fb15-ba6f-49f0-9a74-56802a92cca9 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 14:00:12.992113 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-1414fb15-ba6f-49f0-9a74-56802a92cca9 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 14:00:12.992671 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-1414fb15-ba6f-49f0-9a74-56802a92cca9 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 14:00:13.120390 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-1414fb15-ba6f-49f0-9a74-56802a92cca9 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c85251638bc64deca16008b696b11ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3edb8d53184b98b7055ffc145f186d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 14:00:13.128218 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-1414fb15-ba6f-49f0-9a74-56802a92cca9 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c85251638bc64deca16008b696b11ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3edb8d53184b98b7055ffc145f186d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 14:00:13.129762 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-1414fb15-ba6f-49f0-9a74-56802a92cca9 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c85251638bc64deca16008b696b11ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3edb8d53184b98b7055ffc145f186d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 14:00:13.130922 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-1414fb15-ba6f-49f0-9a74-56802a92cca9 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] 10.222.0.20 "GET /compute/v2.1/servers/3478e8af-1c05-4921-b7ee-e882acb9a65a" status: 200 len: 1722 microversion: 2.20 time: 0.151813 Jul 06 14:00:13.131470 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 621/1231] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 6 14:00:12 2022] GET /compute/v2.1/servers/3478e8af-1c05-4921-b7ee-e882acb9a65a => generated 1722 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 06 14:00:14.150526 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-a86fcd87-384a-41f4-923b-f61e0223df85 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 14:00:14.151110 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-a86fcd87-384a-41f4-923b-f61e0223df85 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] [instance: 3478e8af-1c05-4921-b7ee-e882acb9a65a] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 14:00:14.157666 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-a86fcd87-384a-41f4-923b-f61e0223df85 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 14:00:14.158113 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-a86fcd87-384a-41f4-923b-f61e0223df85 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 14:00:14.158866 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-a86fcd87-384a-41f4-923b-f61e0223df85 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 14:00:14.159298 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-a86fcd87-384a-41f4-923b-f61e0223df85 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 14:00:14.286434 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-a86fcd87-384a-41f4-923b-f61e0223df85 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c85251638bc64deca16008b696b11ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3edb8d53184b98b7055ffc145f186d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 14:00:14.294995 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-a86fcd87-384a-41f4-923b-f61e0223df85 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c85251638bc64deca16008b696b11ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3edb8d53184b98b7055ffc145f186d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 14:00:14.296528 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-a86fcd87-384a-41f4-923b-f61e0223df85 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c85251638bc64deca16008b696b11ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3edb8d53184b98b7055ffc145f186d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 14:00:14.297735 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-a86fcd87-384a-41f4-923b-f61e0223df85 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] 10.222.0.20 "GET /compute/v2.1/servers/3478e8af-1c05-4921-b7ee-e882acb9a65a" status: 200 len: 1722 microversion: 2.20 time: 0.151728 Jul 06 14:00:14.298289 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 611/1232] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 6 14:00:14 2022] GET /compute/v2.1/servers/3478e8af-1c05-4921-b7ee-e882acb9a65a => generated 1722 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 06 14:00:15.317242 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-b60c508b-446b-4ce6-94aa-2a285473da6e tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Calling method '>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 14:00:15.317854 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-b60c508b-446b-4ce6-94aa-2a285473da6e tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] [instance: 3478e8af-1c05-4921-b7ee-e882acb9a65a] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 14:00:15.325080 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-b60c508b-446b-4ce6-94aa-2a285473da6e tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 14:00:15.325534 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-b60c508b-446b-4ce6-94aa-2a285473da6e tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 14:00:15.326303 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-b60c508b-446b-4ce6-94aa-2a285473da6e tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 14:00:15.326845 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-b60c508b-446b-4ce6-94aa-2a285473da6e tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 14:00:15.461287 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-b60c508b-446b-4ce6-94aa-2a285473da6e tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c85251638bc64deca16008b696b11ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3edb8d53184b98b7055ffc145f186d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 14:00:15.471698 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-b60c508b-446b-4ce6-94aa-2a285473da6e tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c85251638bc64deca16008b696b11ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3edb8d53184b98b7055ffc145f186d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 14:00:15.473250 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-b60c508b-446b-4ce6-94aa-2a285473da6e tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c85251638bc64deca16008b696b11ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3edb8d53184b98b7055ffc145f186d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 14:00:15.474408 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-b60c508b-446b-4ce6-94aa-2a285473da6e tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] 10.222.0.20 "GET /compute/v2.1/servers/3478e8af-1c05-4921-b7ee-e882acb9a65a" status: 200 len: 1743 microversion: 2.20 time: 0.161120 Jul 06 14:00:15.474961 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 622/1233] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 6 14:00:15 2022] GET /compute/v2.1/servers/3478e8af-1c05-4921-b7ee-e882acb9a65a => generated 1743 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 06 14:00:16.493585 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-3733fd0e-23d4-4e2f-9012-4f5c4d47fe88 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 14:00:16.494193 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-3733fd0e-23d4-4e2f-9012-4f5c4d47fe88 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] [instance: 3478e8af-1c05-4921-b7ee-e882acb9a65a] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 14:00:16.500629 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-3733fd0e-23d4-4e2f-9012-4f5c4d47fe88 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 14:00:16.501115 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-3733fd0e-23d4-4e2f-9012-4f5c4d47fe88 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 14:00:16.501883 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-3733fd0e-23d4-4e2f-9012-4f5c4d47fe88 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 14:00:16.502344 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-3733fd0e-23d4-4e2f-9012-4f5c4d47fe88 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 14:00:16.632267 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-3733fd0e-23d4-4e2f-9012-4f5c4d47fe88 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c85251638bc64deca16008b696b11ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3edb8d53184b98b7055ffc145f186d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 14:00:16.640256 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-3733fd0e-23d4-4e2f-9012-4f5c4d47fe88 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c85251638bc64deca16008b696b11ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3edb8d53184b98b7055ffc145f186d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 14:00:16.641809 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-3733fd0e-23d4-4e2f-9012-4f5c4d47fe88 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c85251638bc64deca16008b696b11ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3edb8d53184b98b7055ffc145f186d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 14:00:16.642991 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-3733fd0e-23d4-4e2f-9012-4f5c4d47fe88 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] 10.222.0.20 "GET /compute/v2.1/servers/3478e8af-1c05-4921-b7ee-e882acb9a65a" status: 200 len: 1743 microversion: 2.20 time: 0.153801 Jul 06 14:00:16.643555 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 612/1234] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 6 14:00:16 2022] GET /compute/v2.1/servers/3478e8af-1c05-4921-b7ee-e882acb9a65a => generated 1743 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 06 14:00:17.662090 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-074b77b8-c04c-49a2-856e-442665e5b63d tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Calling method '>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 14:00:17.662636 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-074b77b8-c04c-49a2-856e-442665e5b63d tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] [instance: 3478e8af-1c05-4921-b7ee-e882acb9a65a] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 14:00:17.669170 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-074b77b8-c04c-49a2-856e-442665e5b63d tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 14:00:17.669620 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-074b77b8-c04c-49a2-856e-442665e5b63d tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 14:00:17.670378 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-074b77b8-c04c-49a2-856e-442665e5b63d tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 14:00:17.670814 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-074b77b8-c04c-49a2-856e-442665e5b63d tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 14:00:17.797177 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-074b77b8-c04c-49a2-856e-442665e5b63d tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c85251638bc64deca16008b696b11ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3edb8d53184b98b7055ffc145f186d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 14:00:17.805347 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-074b77b8-c04c-49a2-856e-442665e5b63d tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c85251638bc64deca16008b696b11ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3edb8d53184b98b7055ffc145f186d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 14:00:17.806847 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-074b77b8-c04c-49a2-856e-442665e5b63d tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c85251638bc64deca16008b696b11ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3edb8d53184b98b7055ffc145f186d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 14:00:17.808001 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-074b77b8-c04c-49a2-856e-442665e5b63d tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] 10.222.0.20 "GET /compute/v2.1/servers/3478e8af-1c05-4921-b7ee-e882acb9a65a" status: 200 len: 1743 microversion: 2.20 time: 0.150217 Jul 06 14:00:17.808557 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 623/1235] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 6 14:00:17 2022] GET /compute/v2.1/servers/3478e8af-1c05-4921-b7ee-e882acb9a65a => generated 1743 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 06 14:00:18.826294 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-3d145571-4609-4cea-9283-fd931cf2d30c tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 14:00:18.826895 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-3d145571-4609-4cea-9283-fd931cf2d30c tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] [instance: 3478e8af-1c05-4921-b7ee-e882acb9a65a] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 14:00:18.833295 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-3d145571-4609-4cea-9283-fd931cf2d30c tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 14:00:18.833739 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-3d145571-4609-4cea-9283-fd931cf2d30c tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 14:00:18.834505 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-3d145571-4609-4cea-9283-fd931cf2d30c tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 14:00:18.834936 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-3d145571-4609-4cea-9283-fd931cf2d30c tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 14:00:18.900001 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [req-a1f0f943-9802-49a1-8ad3-f3a513dbc660 req-d296fdc2-ae12-40e2-ae45-04fad952edb5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3478e8af-1c05-4921-b7ee-e882acb9a65a", "name": "network-vif-plugged", "status": "completed", "tag": "1b7f73c8-d336-41e4-a894-3c448b223c00"}]} {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 06 14:00:18.908314 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [req-a1f0f943-9802-49a1-8ad3-f3a513dbc660 req-d296fdc2-ae12-40e2-ae45-04fad952edb5 service nova] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 14:00:18.908771 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [req-a1f0f943-9802-49a1-8ad3-f3a513dbc660 req-d296fdc2-ae12-40e2-ae45-04fad952edb5 service nova] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 14:00:18.926173 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.compute.server_external_events [req-a1f0f943-9802-49a1-8ad3-f3a513dbc660 req-d296fdc2-ae12-40e2-ae45-04fad952edb5 service nova] Creating event network-vif-plugged:1b7f73c8-d336-41e4-a894-3c448b223c00 for instance 3478e8af-1c05-4921-b7ee-e882acb9a65a on hv-cinder-81914 Jul 06 14:00:18.931692 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [req-a1f0f943-9802-49a1-8ad3-f3a513dbc660 req-d296fdc2-ae12-40e2-ae45-04fad952edb5 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036396 Jul 06 14:00:18.932671 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 624/1236] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 6 14:00:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 06 14:00:18.974508 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-3d145571-4609-4cea-9283-fd931cf2d30c tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c85251638bc64deca16008b696b11ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3edb8d53184b98b7055ffc145f186d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 14:00:18.984332 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-3d145571-4609-4cea-9283-fd931cf2d30c tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c85251638bc64deca16008b696b11ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3edb8d53184b98b7055ffc145f186d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 14:00:18.985847 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-3d145571-4609-4cea-9283-fd931cf2d30c tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c85251638bc64deca16008b696b11ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3edb8d53184b98b7055ffc145f186d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 14:00:18.987003 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-3d145571-4609-4cea-9283-fd931cf2d30c tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] 10.222.0.20 "GET /compute/v2.1/servers/3478e8af-1c05-4921-b7ee-e882acb9a65a" status: 200 len: 1743 microversion: 2.20 time: 0.164667 Jul 06 14:00:18.987721 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 613/1237] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 6 14:00:18 2022] GET /compute/v2.1/servers/3478e8af-1c05-4921-b7ee-e882acb9a65a => generated 1743 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 06 14:00:20.006096 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-6ee32baa-0aca-4fdc-b74a-b2b4775bb583 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Calling method '>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 14:00:20.006785 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-6ee32baa-0aca-4fdc-b74a-b2b4775bb583 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] [instance: 3478e8af-1c05-4921-b7ee-e882acb9a65a] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 14:00:20.013245 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-6ee32baa-0aca-4fdc-b74a-b2b4775bb583 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 14:00:20.013700 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-6ee32baa-0aca-4fdc-b74a-b2b4775bb583 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 14:00:20.014466 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-6ee32baa-0aca-4fdc-b74a-b2b4775bb583 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 14:00:20.014901 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-6ee32baa-0aca-4fdc-b74a-b2b4775bb583 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 14:00:20.147984 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-6ee32baa-0aca-4fdc-b74a-b2b4775bb583 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c85251638bc64deca16008b696b11ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3edb8d53184b98b7055ffc145f186d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 14:00:20.155872 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-6ee32baa-0aca-4fdc-b74a-b2b4775bb583 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c85251638bc64deca16008b696b11ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3edb8d53184b98b7055ffc145f186d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 14:00:20.157426 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-6ee32baa-0aca-4fdc-b74a-b2b4775bb583 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c85251638bc64deca16008b696b11ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3edb8d53184b98b7055ffc145f186d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 14:00:20.158588 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-6ee32baa-0aca-4fdc-b74a-b2b4775bb583 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] 10.222.0.20 "GET /compute/v2.1/servers/3478e8af-1c05-4921-b7ee-e882acb9a65a" status: 200 len: 1743 microversion: 2.20 time: 0.157263 Jul 06 14:00:20.159157 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 625/1238] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 6 14:00:19 2022] GET /compute/v2.1/servers/3478e8af-1c05-4921-b7ee-e882acb9a65a => generated 1743 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 06 14:00:21.178492 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-ae319cbe-493d-4896-9eee-598600c8280d tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 14:00:21.179874 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-ae319cbe-493d-4896-9eee-598600c8280d tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] [instance: 3478e8af-1c05-4921-b7ee-e882acb9a65a] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 14:00:21.187320 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-ae319cbe-493d-4896-9eee-598600c8280d tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 14:00:21.187857 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-ae319cbe-493d-4896-9eee-598600c8280d tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 14:00:21.188643 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-ae319cbe-493d-4896-9eee-598600c8280d tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 14:00:21.189282 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-ae319cbe-493d-4896-9eee-598600c8280d tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 14:00:21.329989 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-ae319cbe-493d-4896-9eee-598600c8280d tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c85251638bc64deca16008b696b11ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3edb8d53184b98b7055ffc145f186d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 14:00:21.341247 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-ae319cbe-493d-4896-9eee-598600c8280d tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c85251638bc64deca16008b696b11ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3edb8d53184b98b7055ffc145f186d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 14:00:21.343801 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-ae319cbe-493d-4896-9eee-598600c8280d tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c85251638bc64deca16008b696b11ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3edb8d53184b98b7055ffc145f186d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 14:00:21.345063 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-ae319cbe-493d-4896-9eee-598600c8280d tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] 10.222.0.20 "GET /compute/v2.1/servers/3478e8af-1c05-4921-b7ee-e882acb9a65a" status: 200 len: 1738 microversion: 2.20 time: 0.171846 Jul 06 14:00:21.346139 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 614/1239] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 6 14:00:21 2022] GET /compute/v2.1/servers/3478e8af-1c05-4921-b7ee-e882acb9a65a => generated 1738 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 06 14:00:22.364592 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-d96003ee-beed-4b2e-b902-f54ecb951ad7 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Calling method '>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 14:00:22.365244 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-d96003ee-beed-4b2e-b902-f54ecb951ad7 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] [instance: 3478e8af-1c05-4921-b7ee-e882acb9a65a] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 14:00:22.372848 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-d96003ee-beed-4b2e-b902-f54ecb951ad7 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 14:00:22.373751 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-d96003ee-beed-4b2e-b902-f54ecb951ad7 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 14:00:22.374801 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-d96003ee-beed-4b2e-b902-f54ecb951ad7 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 14:00:22.375471 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-d96003ee-beed-4b2e-b902-f54ecb951ad7 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 14:00:22.523178 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-d96003ee-beed-4b2e-b902-f54ecb951ad7 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c85251638bc64deca16008b696b11ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3edb8d53184b98b7055ffc145f186d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 14:00:22.532103 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-d96003ee-beed-4b2e-b902-f54ecb951ad7 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c85251638bc64deca16008b696b11ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3edb8d53184b98b7055ffc145f186d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 14:00:22.533647 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-d96003ee-beed-4b2e-b902-f54ecb951ad7 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c85251638bc64deca16008b696b11ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3edb8d53184b98b7055ffc145f186d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 14:00:22.534803 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-d96003ee-beed-4b2e-b902-f54ecb951ad7 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] 10.222.0.20 "GET /compute/v2.1/servers/3478e8af-1c05-4921-b7ee-e882acb9a65a" status: 200 len: 1738 microversion: 2.20 time: 0.174235 Jul 06 14:00:22.535362 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 626/1240] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 6 14:00:22 2022] GET /compute/v2.1/servers/3478e8af-1c05-4921-b7ee-e882acb9a65a => generated 1738 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 06 14:00:23.557927 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-1d00162d-6bc2-4d8c-bb0a-87b96b0a3ec1 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 14:00:23.558468 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-1d00162d-6bc2-4d8c-bb0a-87b96b0a3ec1 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] [instance: 3478e8af-1c05-4921-b7ee-e882acb9a65a] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 14:00:23.566094 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-1d00162d-6bc2-4d8c-bb0a-87b96b0a3ec1 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 14:00:23.566549 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-1d00162d-6bc2-4d8c-bb0a-87b96b0a3ec1 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 14:00:23.567323 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-1d00162d-6bc2-4d8c-bb0a-87b96b0a3ec1 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 14:00:23.567758 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-1d00162d-6bc2-4d8c-bb0a-87b96b0a3ec1 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 14:00:23.723972 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-1d00162d-6bc2-4d8c-bb0a-87b96b0a3ec1 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c85251638bc64deca16008b696b11ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3edb8d53184b98b7055ffc145f186d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 14:00:23.733772 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-1d00162d-6bc2-4d8c-bb0a-87b96b0a3ec1 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c85251638bc64deca16008b696b11ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3edb8d53184b98b7055ffc145f186d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 14:00:23.735653 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-1d00162d-6bc2-4d8c-bb0a-87b96b0a3ec1 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c85251638bc64deca16008b696b11ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3edb8d53184b98b7055ffc145f186d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 14:00:23.736812 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-1d00162d-6bc2-4d8c-bb0a-87b96b0a3ec1 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] 10.222.0.20 "GET /compute/v2.1/servers/3478e8af-1c05-4921-b7ee-e882acb9a65a" status: 200 len: 1738 microversion: 2.20 time: 0.186288 Jul 06 14:00:23.737391 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 615/1241] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 6 14:00:23 2022] GET /compute/v2.1/servers/3478e8af-1c05-4921-b7ee-e882acb9a65a => generated 1738 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 06 14:00:24.755074 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-c2b69ef3-d7fa-4b0a-b6fd-d6f988c2fe48 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Calling method '>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 14:00:24.756410 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-c2b69ef3-d7fa-4b0a-b6fd-d6f988c2fe48 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] [instance: 3478e8af-1c05-4921-b7ee-e882acb9a65a] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 14:00:24.763218 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-c2b69ef3-d7fa-4b0a-b6fd-d6f988c2fe48 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 14:00:24.764230 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-c2b69ef3-d7fa-4b0a-b6fd-d6f988c2fe48 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 14:00:24.765039 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-c2b69ef3-d7fa-4b0a-b6fd-d6f988c2fe48 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 14:00:24.765479 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-c2b69ef3-d7fa-4b0a-b6fd-d6f988c2fe48 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 14:00:24.904361 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-c2b69ef3-d7fa-4b0a-b6fd-d6f988c2fe48 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c85251638bc64deca16008b696b11ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3edb8d53184b98b7055ffc145f186d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 14:00:24.913285 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-c2b69ef3-d7fa-4b0a-b6fd-d6f988c2fe48 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c85251638bc64deca16008b696b11ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3edb8d53184b98b7055ffc145f186d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 14:00:24.914889 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-c2b69ef3-d7fa-4b0a-b6fd-d6f988c2fe48 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c85251638bc64deca16008b696b11ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3edb8d53184b98b7055ffc145f186d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 14:00:24.916150 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-c2b69ef3-d7fa-4b0a-b6fd-d6f988c2fe48 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] 10.222.0.20 "GET /compute/v2.1/servers/3478e8af-1c05-4921-b7ee-e882acb9a65a" status: 200 len: 1738 microversion: 2.20 time: 0.164995 Jul 06 14:00:24.916786 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 627/1242] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 6 14:00:24 2022] GET /compute/v2.1/servers/3478e8af-1c05-4921-b7ee-e882acb9a65a => generated 1738 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 06 14:00:25.935832 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-6c36874b-339a-4ddb-8e78-38bbbfcb7ad6 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 14:00:25.937226 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-6c36874b-339a-4ddb-8e78-38bbbfcb7ad6 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] [instance: 3478e8af-1c05-4921-b7ee-e882acb9a65a] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 14:00:25.945512 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-6c36874b-339a-4ddb-8e78-38bbbfcb7ad6 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 14:00:25.945969 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-6c36874b-339a-4ddb-8e78-38bbbfcb7ad6 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 14:00:25.946782 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-6c36874b-339a-4ddb-8e78-38bbbfcb7ad6 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 14:00:25.947222 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-6c36874b-339a-4ddb-8e78-38bbbfcb7ad6 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 14:00:26.084353 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-6c36874b-339a-4ddb-8e78-38bbbfcb7ad6 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c85251638bc64deca16008b696b11ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3edb8d53184b98b7055ffc145f186d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 14:00:26.093920 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-6c36874b-339a-4ddb-8e78-38bbbfcb7ad6 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c85251638bc64deca16008b696b11ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3edb8d53184b98b7055ffc145f186d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 14:00:26.095464 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-6c36874b-339a-4ddb-8e78-38bbbfcb7ad6 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c85251638bc64deca16008b696b11ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3edb8d53184b98b7055ffc145f186d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 14:00:26.096795 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-6c36874b-339a-4ddb-8e78-38bbbfcb7ad6 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] 10.222.0.20 "GET /compute/v2.1/servers/3478e8af-1c05-4921-b7ee-e882acb9a65a" status: 200 len: 1738 microversion: 2.20 time: 0.165324 Jul 06 14:00:26.102838 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 616/1243] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 6 14:00:25 2022] GET /compute/v2.1/servers/3478e8af-1c05-4921-b7ee-e882acb9a65a => generated 1738 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 06 14:00:27.115117 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-19e98b7e-af7b-4b2a-b2f5-b2cd68c2e9dc tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Calling method '>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 14:00:27.115803 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-19e98b7e-af7b-4b2a-b2f5-b2cd68c2e9dc tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] [instance: 3478e8af-1c05-4921-b7ee-e882acb9a65a] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 14:00:27.124002 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-19e98b7e-af7b-4b2a-b2f5-b2cd68c2e9dc tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 14:00:27.124467 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-19e98b7e-af7b-4b2a-b2f5-b2cd68c2e9dc tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 14:00:27.125300 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-19e98b7e-af7b-4b2a-b2f5-b2cd68c2e9dc tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 14:00:27.125770 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-19e98b7e-af7b-4b2a-b2f5-b2cd68c2e9dc tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 14:00:27.267269 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-19e98b7e-af7b-4b2a-b2f5-b2cd68c2e9dc tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c85251638bc64deca16008b696b11ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3edb8d53184b98b7055ffc145f186d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 14:00:27.275920 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-19e98b7e-af7b-4b2a-b2f5-b2cd68c2e9dc tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c85251638bc64deca16008b696b11ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3edb8d53184b98b7055ffc145f186d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 14:00:27.277472 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-19e98b7e-af7b-4b2a-b2f5-b2cd68c2e9dc tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c85251638bc64deca16008b696b11ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3edb8d53184b98b7055ffc145f186d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 14:00:27.278649 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-19e98b7e-af7b-4b2a-b2f5-b2cd68c2e9dc tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] 10.222.0.20 "GET /compute/v2.1/servers/3478e8af-1c05-4921-b7ee-e882acb9a65a" status: 200 len: 1738 microversion: 2.20 time: 0.167458 Jul 06 14:00:27.279435 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 628/1244] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 6 14:00:27 2022] GET /compute/v2.1/servers/3478e8af-1c05-4921-b7ee-e882acb9a65a => generated 1738 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 06 14:00:28.298379 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-3d2f0c7d-af7a-46a7-8d37-91d69829cf81 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 14:00:28.299033 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-3d2f0c7d-af7a-46a7-8d37-91d69829cf81 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] [instance: 3478e8af-1c05-4921-b7ee-e882acb9a65a] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 14:00:28.305704 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-3d2f0c7d-af7a-46a7-8d37-91d69829cf81 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 14:00:28.306808 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-3d2f0c7d-af7a-46a7-8d37-91d69829cf81 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 14:00:28.307215 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-3d2f0c7d-af7a-46a7-8d37-91d69829cf81 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 14:00:28.307692 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-3d2f0c7d-af7a-46a7-8d37-91d69829cf81 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 14:00:28.462477 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-3d2f0c7d-af7a-46a7-8d37-91d69829cf81 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c85251638bc64deca16008b696b11ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3edb8d53184b98b7055ffc145f186d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 14:00:28.471446 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-3d2f0c7d-af7a-46a7-8d37-91d69829cf81 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c85251638bc64deca16008b696b11ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3edb8d53184b98b7055ffc145f186d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 14:00:28.472948 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-3d2f0c7d-af7a-46a7-8d37-91d69829cf81 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c85251638bc64deca16008b696b11ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3edb8d53184b98b7055ffc145f186d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 14:00:28.474168 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-3d2f0c7d-af7a-46a7-8d37-91d69829cf81 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] 10.222.0.20 "GET /compute/v2.1/servers/3478e8af-1c05-4921-b7ee-e882acb9a65a" status: 200 len: 1738 microversion: 2.20 time: 0.180785 Jul 06 14:00:28.485386 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 617/1245] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 6 14:00:28 2022] GET /compute/v2.1/servers/3478e8af-1c05-4921-b7ee-e882acb9a65a => generated 1738 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 06 14:00:29.493715 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-afb85743-e358-40e6-8bf9-6cac8216c4e2 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Calling method '>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 14:00:29.494549 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-afb85743-e358-40e6-8bf9-6cac8216c4e2 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] [instance: 3478e8af-1c05-4921-b7ee-e882acb9a65a] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 14:00:29.502847 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-afb85743-e358-40e6-8bf9-6cac8216c4e2 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 14:00:29.503399 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-afb85743-e358-40e6-8bf9-6cac8216c4e2 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 14:00:29.504303 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-afb85743-e358-40e6-8bf9-6cac8216c4e2 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 14:00:29.504814 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-afb85743-e358-40e6-8bf9-6cac8216c4e2 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 14:00:29.652849 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-afb85743-e358-40e6-8bf9-6cac8216c4e2 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c85251638bc64deca16008b696b11ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3edb8d53184b98b7055ffc145f186d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 14:00:29.664028 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-afb85743-e358-40e6-8bf9-6cac8216c4e2 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c85251638bc64deca16008b696b11ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3edb8d53184b98b7055ffc145f186d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 14:00:29.665603 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-afb85743-e358-40e6-8bf9-6cac8216c4e2 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c85251638bc64deca16008b696b11ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3edb8d53184b98b7055ffc145f186d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 14:00:29.666783 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-afb85743-e358-40e6-8bf9-6cac8216c4e2 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] 10.222.0.20 "GET /compute/v2.1/servers/3478e8af-1c05-4921-b7ee-e882acb9a65a" status: 200 len: 1738 microversion: 2.20 time: 0.177611 Jul 06 14:00:29.667482 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 629/1246] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 6 14:00:29 2022] GET /compute/v2.1/servers/3478e8af-1c05-4921-b7ee-e882acb9a65a => generated 1738 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 06 14:00:30.686857 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-961871cb-b5c2-499a-a255-b87711293a25 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 14:00:30.687464 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-961871cb-b5c2-499a-a255-b87711293a25 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] [instance: 3478e8af-1c05-4921-b7ee-e882acb9a65a] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 14:00:30.694034 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-961871cb-b5c2-499a-a255-b87711293a25 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 14:00:30.694626 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-961871cb-b5c2-499a-a255-b87711293a25 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 14:00:30.695411 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-961871cb-b5c2-499a-a255-b87711293a25 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 14:00:30.695848 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-961871cb-b5c2-499a-a255-b87711293a25 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 14:00:30.826553 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-961871cb-b5c2-499a-a255-b87711293a25 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c85251638bc64deca16008b696b11ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3edb8d53184b98b7055ffc145f186d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 14:00:30.834948 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-961871cb-b5c2-499a-a255-b87711293a25 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c85251638bc64deca16008b696b11ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3edb8d53184b98b7055ffc145f186d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 14:00:30.836447 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-961871cb-b5c2-499a-a255-b87711293a25 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c85251638bc64deca16008b696b11ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3edb8d53184b98b7055ffc145f186d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 14:00:30.837624 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-961871cb-b5c2-499a-a255-b87711293a25 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] 10.222.0.20 "GET /compute/v2.1/servers/3478e8af-1c05-4921-b7ee-e882acb9a65a" status: 200 len: 1738 microversion: 2.20 time: 0.155346 Jul 06 14:00:30.838178 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 618/1247] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 6 14:00:30 2022] GET /compute/v2.1/servers/3478e8af-1c05-4921-b7ee-e882acb9a65a => generated 1738 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 06 14:00:31.856716 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-67785707-f0bb-4495-96d8-e14e0c59099a tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Calling method '>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 14:00:31.857392 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-67785707-f0bb-4495-96d8-e14e0c59099a tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] [instance: 3478e8af-1c05-4921-b7ee-e882acb9a65a] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 14:00:31.860276 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG dbcounter [-] [124368] Writing DB stats nova_api:SELECT=29 {{(pid=124368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 14:00:31.865447 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-67785707-f0bb-4495-96d8-e14e0c59099a tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 14:00:31.865894 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-67785707-f0bb-4495-96d8-e14e0c59099a tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 14:00:31.866657 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-67785707-f0bb-4495-96d8-e14e0c59099a tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 14:00:31.867091 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-67785707-f0bb-4495-96d8-e14e0c59099a tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 14:00:31.869801 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG dbcounter [-] [124368] Writing DB stats nova_cell1:SELECT=79 {{(pid=124368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 14:00:31.998830 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-67785707-f0bb-4495-96d8-e14e0c59099a tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c85251638bc64deca16008b696b11ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3edb8d53184b98b7055ffc145f186d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 14:00:32.007132 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-67785707-f0bb-4495-96d8-e14e0c59099a tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c85251638bc64deca16008b696b11ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3edb8d53184b98b7055ffc145f186d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 14:00:32.008634 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-67785707-f0bb-4495-96d8-e14e0c59099a tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c85251638bc64deca16008b696b11ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3edb8d53184b98b7055ffc145f186d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 14:00:32.009822 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-67785707-f0bb-4495-96d8-e14e0c59099a tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] 10.222.0.20 "GET /compute/v2.1/servers/3478e8af-1c05-4921-b7ee-e882acb9a65a" status: 200 len: 1720 microversion: 2.20 time: 0.156973 Jul 06 14:00:32.010377 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 630/1248] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 6 14:00:31 2022] GET /compute/v2.1/servers/3478e8af-1c05-4921-b7ee-e882acb9a65a => generated 1720 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 06 14:00:33.028738 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-1ac4ead9-c81a-49b6-9571-6cb196f4b72f tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 14:00:33.029462 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-1ac4ead9-c81a-49b6-9571-6cb196f4b72f tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] [instance: 3478e8af-1c05-4921-b7ee-e882acb9a65a] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 14:00:33.035955 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-1ac4ead9-c81a-49b6-9571-6cb196f4b72f tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 14:00:33.036396 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-1ac4ead9-c81a-49b6-9571-6cb196f4b72f tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 14:00:33.037195 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-1ac4ead9-c81a-49b6-9571-6cb196f4b72f tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 14:00:33.037634 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-1ac4ead9-c81a-49b6-9571-6cb196f4b72f tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 14:00:33.246760 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-1ac4ead9-c81a-49b6-9571-6cb196f4b72f tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c85251638bc64deca16008b696b11ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3edb8d53184b98b7055ffc145f186d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 14:00:33.255808 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-1ac4ead9-c81a-49b6-9571-6cb196f4b72f tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c85251638bc64deca16008b696b11ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3edb8d53184b98b7055ffc145f186d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 14:00:33.257339 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-1ac4ead9-c81a-49b6-9571-6cb196f4b72f tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c85251638bc64deca16008b696b11ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3edb8d53184b98b7055ffc145f186d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 14:00:33.258501 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-1ac4ead9-c81a-49b6-9571-6cb196f4b72f tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] 10.222.0.20 "GET /compute/v2.1/servers/3478e8af-1c05-4921-b7ee-e882acb9a65a" status: 200 len: 1723 microversion: 2.20 time: 0.233755 Jul 06 14:00:33.259051 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 619/1249] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 6 14:00:33 2022] GET /compute/v2.1/servers/3478e8af-1c05-4921-b7ee-e882acb9a65a => generated 1723 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 06 14:00:33.276817 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-179166d8-9b0e-4e96-8d48-c174b0f1e0c7 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0fad96b3-0220-4bf8-a280-ec3c258709e6"}} {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 06 14:00:33.277903 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-179166d8-9b0e-4e96-8d48-c174b0f1e0c7 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] [instance: 3478e8af-1c05-4921-b7ee-e882acb9a65a] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 14:00:33.284283 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-179166d8-9b0e-4e96-8d48-c174b0f1e0c7 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 14:00:33.284729 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-179166d8-9b0e-4e96-8d48-c174b0f1e0c7 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 14:00:33.285517 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-179166d8-9b0e-4e96-8d48-c174b0f1e0c7 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 14:00:33.285951 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-179166d8-9b0e-4e96-8d48-c174b0f1e0c7 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 14:00:33.593237 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-179166d8-9b0e-4e96-8d48-c174b0f1e0c7 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] 10.222.0.20 "POST /compute/v2.1/servers/3478e8af-1c05-4921-b7ee-e882acb9a65a/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.319443 Jul 06 14:00:33.593882 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 631/1250] 10.222.0.20 () {62 vars in 1363 bytes} [Wed Jul 6 14:00:33 2022] POST /compute/v2.1/servers/3478e8af-1c05-4921-b7ee-e882acb9a65a/os-volume_attachments => generated 188 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 06 14:00:33.717422 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-71c65c6f-a3e1-4bf5-9a6b-337dd7af8275 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 14:00:33.717914 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-71c65c6f-a3e1-4bf5-9a6b-337dd7af8275 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] [instance: 3478e8af-1c05-4921-b7ee-e882acb9a65a] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 14:00:33.719912 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG dbcounter [-] [124367] Writing DB stats nova_api:SELECT=29 {{(pid=124367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 14:00:33.725538 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-71c65c6f-a3e1-4bf5-9a6b-337dd7af8275 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 14:00:33.725981 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-71c65c6f-a3e1-4bf5-9a6b-337dd7af8275 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 14:00:33.726754 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-71c65c6f-a3e1-4bf5-9a6b-337dd7af8275 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 14:00:33.727182 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-71c65c6f-a3e1-4bf5-9a6b-337dd7af8275 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 14:00:33.729942 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG dbcounter [-] [124367] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 14:00:33.971800 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-71c65c6f-a3e1-4bf5-9a6b-337dd7af8275 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] 10.222.0.20 "DELETE /compute/v2.1/servers/3478e8af-1c05-4921-b7ee-e882acb9a65a/os-volume_attachments/0fad96b3-0220-4bf8-a280-ec3c258709e6" status: 202 len: 0 microversion: 2.20 time: 0.258290 Jul 06 14:00:33.972587 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 620/1251] 10.222.0.20 () {60 vars in 1456 bytes} [Wed Jul 6 14:00:33 2022] DELETE /compute/v2.1/servers/3478e8af-1c05-4921-b7ee-e882acb9a65a/os-volume_attachments/0fad96b3-0220-4bf8-a280-ec3c258709e6 => generated 0 bytes in 260 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 06 14:00:34.029131 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-82656862-8fe5-4892-b06c-a9f0b3c59b8f tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 06 14:00:34.030294 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-82656862-8fe5-4892-b06c-a9f0b3c59b8f tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] [instance: 3478e8af-1c05-4921-b7ee-e882acb9a65a] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 14:00:34.037091 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-82656862-8fe5-4892-b06c-a9f0b3c59b8f tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 14:00:34.037554 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-82656862-8fe5-4892-b06c-a9f0b3c59b8f tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 14:00:34.038331 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-82656862-8fe5-4892-b06c-a9f0b3c59b8f tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 14:00:34.038787 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-82656862-8fe5-4892-b06c-a9f0b3c59b8f tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 14:00:34.113382 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-82656862-8fe5-4892-b06c-a9f0b3c59b8f tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] 10.222.0.20 "POST /compute/v2.1/servers/3478e8af-1c05-4921-b7ee-e882acb9a65a/action" status: 202 len: 0 microversion: 2.20 time: 0.088201 Jul 06 14:00:34.113994 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 632/1252] 10.222.0.20 () {62 vars in 1318 bytes} [Wed Jul 6 14:00:34 2022] POST /compute/v2.1/servers/3478e8af-1c05-4921-b7ee-e882acb9a65a/action => generated 0 bytes in 90 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 06 14:00:34.122140 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-32fa1184-38bb-4f45-9b88-ea32b74db11a tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 14:00:34.122751 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-32fa1184-38bb-4f45-9b88-ea32b74db11a tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] [instance: 3478e8af-1c05-4921-b7ee-e882acb9a65a] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 14:00:34.130403 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-32fa1184-38bb-4f45-9b88-ea32b74db11a tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 14:00:34.131085 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-32fa1184-38bb-4f45-9b88-ea32b74db11a tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 14:00:34.131864 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-32fa1184-38bb-4f45-9b88-ea32b74db11a tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 14:00:34.132403 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-32fa1184-38bb-4f45-9b88-ea32b74db11a tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 14:00:34.287882 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-32fa1184-38bb-4f45-9b88-ea32b74db11a tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c85251638bc64deca16008b696b11ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3edb8d53184b98b7055ffc145f186d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 14:00:34.297481 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-32fa1184-38bb-4f45-9b88-ea32b74db11a tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c85251638bc64deca16008b696b11ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3edb8d53184b98b7055ffc145f186d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 14:00:34.299252 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-32fa1184-38bb-4f45-9b88-ea32b74db11a tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c85251638bc64deca16008b696b11ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3edb8d53184b98b7055ffc145f186d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 14:00:34.300542 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-32fa1184-38bb-4f45-9b88-ea32b74db11a tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] 10.222.0.20 "GET /compute/v2.1/servers/3478e8af-1c05-4921-b7ee-e882acb9a65a" status: 200 len: 1671 microversion: 2.20 time: 0.182416 Jul 06 14:00:34.301116 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 621/1253] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 6 14:00:34 2022] GET /compute/v2.1/servers/3478e8af-1c05-4921-b7ee-e882acb9a65a => generated 1671 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 06 14:00:34.965616 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [req-d404fd50-4298-4810-a529-f66281c435bd req-18744a67-0f84-4b6e-bf64-300da7616cc2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3478e8af-1c05-4921-b7ee-e882acb9a65a", "name": "network-vif-unplugged", "status": "completed", "tag": "1b7f73c8-d336-41e4-a894-3c448b223c00"}]} {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 06 14:00:34.976758 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [req-d404fd50-4298-4810-a529-f66281c435bd req-18744a67-0f84-4b6e-bf64-300da7616cc2 service nova] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 14:00:34.977802 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [req-d404fd50-4298-4810-a529-f66281c435bd req-18744a67-0f84-4b6e-bf64-300da7616cc2 service nova] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 14:00:34.990203 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.compute.server_external_events [req-d404fd50-4298-4810-a529-f66281c435bd req-18744a67-0f84-4b6e-bf64-300da7616cc2 service nova] Unable to find a host for instance 3478e8af-1c05-4921-b7ee-e882acb9a65a. Dropping event network-vif-unplugged {{(pid=124368) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jul 06 14:00:34.991098 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [req-d404fd50-4298-4810-a529-f66281c435bd req-18744a67-0f84-4b6e-bf64-300da7616cc2 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.030636 Jul 06 14:00:34.991691 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 633/1254] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 6 14:00:34 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 32 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Jul 06 14:00:35.319806 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-d99fef72-96dd-4e28-8c08-078c7838fed0 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 14:00:35.320395 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-d99fef72-96dd-4e28-8c08-078c7838fed0 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] [instance: 3478e8af-1c05-4921-b7ee-e882acb9a65a] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 14:00:35.327529 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-d99fef72-96dd-4e28-8c08-078c7838fed0 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 14:00:35.327937 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-d99fef72-96dd-4e28-8c08-078c7838fed0 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 14:00:35.328705 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-d99fef72-96dd-4e28-8c08-078c7838fed0 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 14:00:35.329190 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-d99fef72-96dd-4e28-8c08-078c7838fed0 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 14:00:35.521363 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-d99fef72-96dd-4e28-8c08-078c7838fed0 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c85251638bc64deca16008b696b11ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3edb8d53184b98b7055ffc145f186d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 14:00:35.530032 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-d99fef72-96dd-4e28-8c08-078c7838fed0 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c85251638bc64deca16008b696b11ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3edb8d53184b98b7055ffc145f186d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 14:00:35.531544 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-d99fef72-96dd-4e28-8c08-078c7838fed0 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c85251638bc64deca16008b696b11ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3edb8d53184b98b7055ffc145f186d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 14:00:35.532691 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-d99fef72-96dd-4e28-8c08-078c7838fed0 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] 10.222.0.20 "GET /compute/v2.1/servers/3478e8af-1c05-4921-b7ee-e882acb9a65a" status: 200 len: 1729 microversion: 2.20 time: 0.216809 Jul 06 14:00:35.533277 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 622/1255] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 6 14:00:35 2022] GET /compute/v2.1/servers/3478e8af-1c05-4921-b7ee-e882acb9a65a => generated 1729 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 06 14:00:36.551425 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-d66eb557-630e-4aac-a5c1-fcfb96c39491 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Calling method '>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 14:00:36.552042 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-d66eb557-630e-4aac-a5c1-fcfb96c39491 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] [instance: 3478e8af-1c05-4921-b7ee-e882acb9a65a] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 14:00:36.559459 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-d66eb557-630e-4aac-a5c1-fcfb96c39491 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 14:00:36.559921 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-d66eb557-630e-4aac-a5c1-fcfb96c39491 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 14:00:36.561252 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-d66eb557-630e-4aac-a5c1-fcfb96c39491 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 14:00:36.562243 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-d66eb557-630e-4aac-a5c1-fcfb96c39491 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 14:00:36.717372 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-d66eb557-630e-4aac-a5c1-fcfb96c39491 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c85251638bc64deca16008b696b11ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3edb8d53184b98b7055ffc145f186d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 14:00:36.727467 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-d66eb557-630e-4aac-a5c1-fcfb96c39491 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c85251638bc64deca16008b696b11ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3edb8d53184b98b7055ffc145f186d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 14:00:36.730387 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-d66eb557-630e-4aac-a5c1-fcfb96c39491 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c85251638bc64deca16008b696b11ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3edb8d53184b98b7055ffc145f186d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 14:00:36.733944 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-d66eb557-630e-4aac-a5c1-fcfb96c39491 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] 10.222.0.20 "GET /compute/v2.1/servers/3478e8af-1c05-4921-b7ee-e882acb9a65a" status: 200 len: 1729 microversion: 2.20 time: 0.184952 Jul 06 14:00:36.735294 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 634/1256] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 6 14:00:36 2022] GET /compute/v2.1/servers/3478e8af-1c05-4921-b7ee-e882acb9a65a => generated 1729 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 06 14:00:37.753575 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-3e33cc68-131d-4a03-b9a2-dd1d1d75bd34 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 14:00:37.754178 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-3e33cc68-131d-4a03-b9a2-dd1d1d75bd34 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] [instance: 3478e8af-1c05-4921-b7ee-e882acb9a65a] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 14:00:37.761844 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-3e33cc68-131d-4a03-b9a2-dd1d1d75bd34 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 14:00:37.762613 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-3e33cc68-131d-4a03-b9a2-dd1d1d75bd34 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 14:00:37.763730 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-3e33cc68-131d-4a03-b9a2-dd1d1d75bd34 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 14:00:37.764406 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-3e33cc68-131d-4a03-b9a2-dd1d1d75bd34 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 14:00:37.901951 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-3e33cc68-131d-4a03-b9a2-dd1d1d75bd34 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c85251638bc64deca16008b696b11ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3edb8d53184b98b7055ffc145f186d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 14:00:37.911198 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-3e33cc68-131d-4a03-b9a2-dd1d1d75bd34 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c85251638bc64deca16008b696b11ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3edb8d53184b98b7055ffc145f186d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 14:00:37.912702 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-3e33cc68-131d-4a03-b9a2-dd1d1d75bd34 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c85251638bc64deca16008b696b11ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3edb8d53184b98b7055ffc145f186d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 14:00:37.913893 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-3e33cc68-131d-4a03-b9a2-dd1d1d75bd34 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] 10.222.0.20 "GET /compute/v2.1/servers/3478e8af-1c05-4921-b7ee-e882acb9a65a" status: 200 len: 1729 microversion: 2.20 time: 0.164209 Jul 06 14:00:37.914447 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 623/1257] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 6 14:00:37 2022] GET /compute/v2.1/servers/3478e8af-1c05-4921-b7ee-e882acb9a65a => generated 1729 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 06 14:00:38.934178 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-21bfe5ce-6fda-46a2-8254-0c6495091121 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Calling method '>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 14:00:38.934793 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-21bfe5ce-6fda-46a2-8254-0c6495091121 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] [instance: 3478e8af-1c05-4921-b7ee-e882acb9a65a] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 14:00:38.941474 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-21bfe5ce-6fda-46a2-8254-0c6495091121 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 14:00:38.941938 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-21bfe5ce-6fda-46a2-8254-0c6495091121 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 14:00:38.942718 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-21bfe5ce-6fda-46a2-8254-0c6495091121 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 14:00:38.943167 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-21bfe5ce-6fda-46a2-8254-0c6495091121 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 14:00:39.113719 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-21bfe5ce-6fda-46a2-8254-0c6495091121 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c85251638bc64deca16008b696b11ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3edb8d53184b98b7055ffc145f186d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 14:00:39.127128 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-21bfe5ce-6fda-46a2-8254-0c6495091121 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c85251638bc64deca16008b696b11ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3edb8d53184b98b7055ffc145f186d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 14:00:39.128669 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-21bfe5ce-6fda-46a2-8254-0c6495091121 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c85251638bc64deca16008b696b11ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3edb8d53184b98b7055ffc145f186d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 14:00:39.134209 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-21bfe5ce-6fda-46a2-8254-0c6495091121 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] 10.222.0.20 "GET /compute/v2.1/servers/3478e8af-1c05-4921-b7ee-e882acb9a65a" status: 200 len: 1729 microversion: 2.20 time: 0.199698 Jul 06 14:00:39.134879 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 635/1258] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 6 14:00:38 2022] GET /compute/v2.1/servers/3478e8af-1c05-4921-b7ee-e882acb9a65a => generated 1729 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 06 14:00:40.152853 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-63bd42d8-f42b-44ea-9918-d52b7622b99f tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 14:00:40.153562 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-63bd42d8-f42b-44ea-9918-d52b7622b99f tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] [instance: 3478e8af-1c05-4921-b7ee-e882acb9a65a] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 14:00:40.160649 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-63bd42d8-f42b-44ea-9918-d52b7622b99f tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 14:00:40.161148 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-63bd42d8-f42b-44ea-9918-d52b7622b99f tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 14:00:40.161929 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-63bd42d8-f42b-44ea-9918-d52b7622b99f tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 14:00:40.162358 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-63bd42d8-f42b-44ea-9918-d52b7622b99f tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 14:00:40.309932 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-63bd42d8-f42b-44ea-9918-d52b7622b99f tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c85251638bc64deca16008b696b11ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3edb8d53184b98b7055ffc145f186d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 14:00:40.318982 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-63bd42d8-f42b-44ea-9918-d52b7622b99f tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c85251638bc64deca16008b696b11ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3edb8d53184b98b7055ffc145f186d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 14:00:40.320476 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-63bd42d8-f42b-44ea-9918-d52b7622b99f tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c85251638bc64deca16008b696b11ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3edb8d53184b98b7055ffc145f186d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 14:00:40.321685 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-63bd42d8-f42b-44ea-9918-d52b7622b99f tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] 10.222.0.20 "GET /compute/v2.1/servers/3478e8af-1c05-4921-b7ee-e882acb9a65a" status: 200 len: 1729 microversion: 2.20 time: 0.172810 Jul 06 14:00:40.322435 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 624/1259] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 6 14:00:40 2022] GET /compute/v2.1/servers/3478e8af-1c05-4921-b7ee-e882acb9a65a => generated 1729 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 06 14:00:41.346633 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-6bfb3146-7508-47c0-8f94-f6accf759cc1 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Calling method '>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 14:00:41.347254 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-6bfb3146-7508-47c0-8f94-f6accf759cc1 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] [instance: 3478e8af-1c05-4921-b7ee-e882acb9a65a] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 14:00:41.353963 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-6bfb3146-7508-47c0-8f94-f6accf759cc1 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 14:00:41.354416 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-6bfb3146-7508-47c0-8f94-f6accf759cc1 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 14:00:41.355189 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-6bfb3146-7508-47c0-8f94-f6accf759cc1 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 14:00:41.355657 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-6bfb3146-7508-47c0-8f94-f6accf759cc1 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 14:00:41.494220 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-6bfb3146-7508-47c0-8f94-f6accf759cc1 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c85251638bc64deca16008b696b11ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3edb8d53184b98b7055ffc145f186d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 14:00:41.503135 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-6bfb3146-7508-47c0-8f94-f6accf759cc1 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c85251638bc64deca16008b696b11ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3edb8d53184b98b7055ffc145f186d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 14:00:41.504656 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-6bfb3146-7508-47c0-8f94-f6accf759cc1 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c85251638bc64deca16008b696b11ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3edb8d53184b98b7055ffc145f186d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 14:00:41.505869 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-6bfb3146-7508-47c0-8f94-f6accf759cc1 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] 10.222.0.20 "GET /compute/v2.1/servers/3478e8af-1c05-4921-b7ee-e882acb9a65a" status: 200 len: 1729 microversion: 2.20 time: 0.168362 Jul 06 14:00:41.506414 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 636/1260] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 6 14:00:41 2022] GET /compute/v2.1/servers/3478e8af-1c05-4921-b7ee-e882acb9a65a => generated 1729 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 06 14:00:42.525180 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-2e9cf532-0adf-4f02-889f-01916653c57a tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 14:00:42.525780 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-2e9cf532-0adf-4f02-889f-01916653c57a tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] [instance: 3478e8af-1c05-4921-b7ee-e882acb9a65a] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 14:00:42.532911 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-2e9cf532-0adf-4f02-889f-01916653c57a tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 14:00:42.533412 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-2e9cf532-0adf-4f02-889f-01916653c57a tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 14:00:42.534188 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-2e9cf532-0adf-4f02-889f-01916653c57a tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 14:00:42.534622 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-2e9cf532-0adf-4f02-889f-01916653c57a tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 14:00:42.673555 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-2e9cf532-0adf-4f02-889f-01916653c57a tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c85251638bc64deca16008b696b11ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3edb8d53184b98b7055ffc145f186d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 14:00:42.682847 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-2e9cf532-0adf-4f02-889f-01916653c57a tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c85251638bc64deca16008b696b11ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3edb8d53184b98b7055ffc145f186d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 14:00:42.684482 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-2e9cf532-0adf-4f02-889f-01916653c57a tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c85251638bc64deca16008b696b11ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3edb8d53184b98b7055ffc145f186d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 14:00:42.685752 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-2e9cf532-0adf-4f02-889f-01916653c57a tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] 10.222.0.20 "GET /compute/v2.1/servers/3478e8af-1c05-4921-b7ee-e882acb9a65a" status: 200 len: 1729 microversion: 2.20 time: 0.164438 Jul 06 14:00:42.686941 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 625/1261] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 6 14:00:42 2022] GET /compute/v2.1/servers/3478e8af-1c05-4921-b7ee-e882acb9a65a => generated 1729 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 06 14:00:43.717959 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-458f589f-4d48-47d8-90cd-9fd99045813d tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Calling method '>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 14:00:43.718628 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-458f589f-4d48-47d8-90cd-9fd99045813d tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] [instance: 3478e8af-1c05-4921-b7ee-e882acb9a65a] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 14:00:43.725702 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-458f589f-4d48-47d8-90cd-9fd99045813d tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 14:00:43.726161 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-458f589f-4d48-47d8-90cd-9fd99045813d tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 14:00:43.726953 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-458f589f-4d48-47d8-90cd-9fd99045813d tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 14:00:43.727394 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-458f589f-4d48-47d8-90cd-9fd99045813d tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 14:00:43.863560 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-458f589f-4d48-47d8-90cd-9fd99045813d tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c85251638bc64deca16008b696b11ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3edb8d53184b98b7055ffc145f186d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 14:00:43.871597 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-458f589f-4d48-47d8-90cd-9fd99045813d tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c85251638bc64deca16008b696b11ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3edb8d53184b98b7055ffc145f186d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 14:00:43.873159 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-458f589f-4d48-47d8-90cd-9fd99045813d tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c85251638bc64deca16008b696b11ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3edb8d53184b98b7055ffc145f186d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 14:00:43.874307 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-458f589f-4d48-47d8-90cd-9fd99045813d tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] 10.222.0.20 "GET /compute/v2.1/servers/3478e8af-1c05-4921-b7ee-e882acb9a65a" status: 200 len: 1729 microversion: 2.20 time: 0.173399 Jul 06 14:00:43.874856 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 637/1262] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 6 14:00:43 2022] GET /compute/v2.1/servers/3478e8af-1c05-4921-b7ee-e882acb9a65a => generated 1729 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 06 14:00:44.894535 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-ef332447-a13b-461b-b66c-0c22f5e435c2 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 14:00:44.895155 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-ef332447-a13b-461b-b66c-0c22f5e435c2 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] [instance: 3478e8af-1c05-4921-b7ee-e882acb9a65a] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 14:00:44.901767 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-ef332447-a13b-461b-b66c-0c22f5e435c2 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 14:00:44.902204 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-ef332447-a13b-461b-b66c-0c22f5e435c2 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 14:00:44.902971 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-ef332447-a13b-461b-b66c-0c22f5e435c2 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 14:00:44.903405 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-ef332447-a13b-461b-b66c-0c22f5e435c2 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 14:00:45.036672 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-ef332447-a13b-461b-b66c-0c22f5e435c2 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c85251638bc64deca16008b696b11ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3edb8d53184b98b7055ffc145f186d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 14:00:45.044543 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-ef332447-a13b-461b-b66c-0c22f5e435c2 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c85251638bc64deca16008b696b11ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3edb8d53184b98b7055ffc145f186d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 14:00:45.046187 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-ef332447-a13b-461b-b66c-0c22f5e435c2 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c85251638bc64deca16008b696b11ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3edb8d53184b98b7055ffc145f186d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 14:00:45.047312 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-ef332447-a13b-461b-b66c-0c22f5e435c2 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] 10.222.0.20 "GET /compute/v2.1/servers/3478e8af-1c05-4921-b7ee-e882acb9a65a" status: 200 len: 1729 microversion: 2.20 time: 0.156964 Jul 06 14:00:45.047855 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 626/1263] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 6 14:00:44 2022] GET /compute/v2.1/servers/3478e8af-1c05-4921-b7ee-e882acb9a65a => generated 1729 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 06 14:00:46.066263 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-b5c6089f-f35c-4d38-9562-fa4fee7bb16c tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Calling method '>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 14:00:46.066872 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-b5c6089f-f35c-4d38-9562-fa4fee7bb16c tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] [instance: 3478e8af-1c05-4921-b7ee-e882acb9a65a] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 14:00:46.073425 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-b5c6089f-f35c-4d38-9562-fa4fee7bb16c tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 14:00:46.073875 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-b5c6089f-f35c-4d38-9562-fa4fee7bb16c tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 14:00:46.074635 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-b5c6089f-f35c-4d38-9562-fa4fee7bb16c tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 14:00:46.075065 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-b5c6089f-f35c-4d38-9562-fa4fee7bb16c tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 14:00:46.205801 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-b5c6089f-f35c-4d38-9562-fa4fee7bb16c tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c85251638bc64deca16008b696b11ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3edb8d53184b98b7055ffc145f186d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 14:00:46.213592 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-b5c6089f-f35c-4d38-9562-fa4fee7bb16c tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c85251638bc64deca16008b696b11ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3edb8d53184b98b7055ffc145f186d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 14:00:46.215098 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-b5c6089f-f35c-4d38-9562-fa4fee7bb16c tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c85251638bc64deca16008b696b11ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3edb8d53184b98b7055ffc145f186d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 14:00:46.216264 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-b5c6089f-f35c-4d38-9562-fa4fee7bb16c tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] 10.222.0.20 "GET /compute/v2.1/servers/3478e8af-1c05-4921-b7ee-e882acb9a65a" status: 200 len: 1729 microversion: 2.20 time: 0.153980 Jul 06 14:00:46.217589 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 638/1264] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 6 14:00:46 2022] GET /compute/v2.1/servers/3478e8af-1c05-4921-b7ee-e882acb9a65a => generated 1729 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 06 14:00:47.235943 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-c7b1b9ac-3253-4de2-a218-b06ccc5da04a tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 14:00:47.236574 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-c7b1b9ac-3253-4de2-a218-b06ccc5da04a tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] [instance: 3478e8af-1c05-4921-b7ee-e882acb9a65a] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 14:00:47.243006 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-c7b1b9ac-3253-4de2-a218-b06ccc5da04a tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 14:00:47.243449 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-c7b1b9ac-3253-4de2-a218-b06ccc5da04a tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 14:00:47.244208 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-c7b1b9ac-3253-4de2-a218-b06ccc5da04a tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 14:00:47.244635 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-c7b1b9ac-3253-4de2-a218-b06ccc5da04a tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 14:00:47.373291 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-c7b1b9ac-3253-4de2-a218-b06ccc5da04a tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c85251638bc64deca16008b696b11ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3edb8d53184b98b7055ffc145f186d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 14:00:47.381163 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-c7b1b9ac-3253-4de2-a218-b06ccc5da04a tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c85251638bc64deca16008b696b11ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3edb8d53184b98b7055ffc145f186d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 14:00:47.382643 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-c7b1b9ac-3253-4de2-a218-b06ccc5da04a tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c85251638bc64deca16008b696b11ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3edb8d53184b98b7055ffc145f186d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 14:00:47.383779 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-c7b1b9ac-3253-4de2-a218-b06ccc5da04a tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] 10.222.0.20 "GET /compute/v2.1/servers/3478e8af-1c05-4921-b7ee-e882acb9a65a" status: 200 len: 1729 microversion: 2.20 time: 0.152827 Jul 06 14:00:47.384335 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 627/1265] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 6 14:00:47 2022] GET /compute/v2.1/servers/3478e8af-1c05-4921-b7ee-e882acb9a65a => generated 1729 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 06 14:00:48.402343 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-a86ec4fa-7ed5-4910-bc7f-690121455684 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Calling method '>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 14:00:48.402946 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-a86ec4fa-7ed5-4910-bc7f-690121455684 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] [instance: 3478e8af-1c05-4921-b7ee-e882acb9a65a] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 14:00:48.409455 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-a86ec4fa-7ed5-4910-bc7f-690121455684 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 14:00:48.409897 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-a86ec4fa-7ed5-4910-bc7f-690121455684 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 14:00:48.410651 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-a86ec4fa-7ed5-4910-bc7f-690121455684 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 14:00:48.411080 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-a86ec4fa-7ed5-4910-bc7f-690121455684 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 14:00:48.538397 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-a86ec4fa-7ed5-4910-bc7f-690121455684 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c85251638bc64deca16008b696b11ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3edb8d53184b98b7055ffc145f186d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 14:00:48.546995 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-a86ec4fa-7ed5-4910-bc7f-690121455684 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c85251638bc64deca16008b696b11ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3edb8d53184b98b7055ffc145f186d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 14:00:48.548441 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-a86ec4fa-7ed5-4910-bc7f-690121455684 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c85251638bc64deca16008b696b11ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3edb8d53184b98b7055ffc145f186d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 14:00:48.549626 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-a86ec4fa-7ed5-4910-bc7f-690121455684 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] 10.222.0.20 "GET /compute/v2.1/servers/3478e8af-1c05-4921-b7ee-e882acb9a65a" status: 200 len: 1729 microversion: 2.20 time: 0.151171 Jul 06 14:00:48.550184 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 639/1266] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 6 14:00:48 2022] GET /compute/v2.1/servers/3478e8af-1c05-4921-b7ee-e882acb9a65a => generated 1729 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 06 14:00:49.568587 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-832b9fb2-e0f3-4327-a960-c646288b14ce tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 14:00:49.569122 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-832b9fb2-e0f3-4327-a960-c646288b14ce tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] [instance: 3478e8af-1c05-4921-b7ee-e882acb9a65a] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 14:00:49.575631 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-832b9fb2-e0f3-4327-a960-c646288b14ce tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 14:00:49.577496 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-832b9fb2-e0f3-4327-a960-c646288b14ce tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 14:00:49.578262 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-832b9fb2-e0f3-4327-a960-c646288b14ce tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 14:00:49.578690 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-832b9fb2-e0f3-4327-a960-c646288b14ce tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 14:00:49.711547 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-832b9fb2-e0f3-4327-a960-c646288b14ce tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c85251638bc64deca16008b696b11ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3edb8d53184b98b7055ffc145f186d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 14:00:49.719643 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-832b9fb2-e0f3-4327-a960-c646288b14ce tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c85251638bc64deca16008b696b11ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3edb8d53184b98b7055ffc145f186d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 14:00:49.721159 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-832b9fb2-e0f3-4327-a960-c646288b14ce tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c85251638bc64deca16008b696b11ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3edb8d53184b98b7055ffc145f186d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 14:00:49.722300 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-832b9fb2-e0f3-4327-a960-c646288b14ce tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] 10.222.0.20 "GET /compute/v2.1/servers/3478e8af-1c05-4921-b7ee-e882acb9a65a" status: 200 len: 1729 microversion: 2.20 time: 0.157777 Jul 06 14:00:49.722849 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 628/1267] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 6 14:00:49 2022] GET /compute/v2.1/servers/3478e8af-1c05-4921-b7ee-e882acb9a65a => generated 1729 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 06 14:00:50.741019 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-1ab9a88b-90f1-4ffb-a8cf-5f7a695075eb tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Calling method '>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 14:00:50.741643 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-1ab9a88b-90f1-4ffb-a8cf-5f7a695075eb tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] [instance: 3478e8af-1c05-4921-b7ee-e882acb9a65a] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 14:00:50.748649 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-1ab9a88b-90f1-4ffb-a8cf-5f7a695075eb tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 14:00:50.749129 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-1ab9a88b-90f1-4ffb-a8cf-5f7a695075eb tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 14:00:50.750021 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-1ab9a88b-90f1-4ffb-a8cf-5f7a695075eb tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 14:00:50.750532 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-1ab9a88b-90f1-4ffb-a8cf-5f7a695075eb tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 14:00:50.890747 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-1ab9a88b-90f1-4ffb-a8cf-5f7a695075eb tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c85251638bc64deca16008b696b11ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3edb8d53184b98b7055ffc145f186d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 14:00:50.898654 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-1ab9a88b-90f1-4ffb-a8cf-5f7a695075eb tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c85251638bc64deca16008b696b11ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3edb8d53184b98b7055ffc145f186d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 14:00:50.900156 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-1ab9a88b-90f1-4ffb-a8cf-5f7a695075eb tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c85251638bc64deca16008b696b11ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3edb8d53184b98b7055ffc145f186d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 14:00:50.901317 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-1ab9a88b-90f1-4ffb-a8cf-5f7a695075eb tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] 10.222.0.20 "GET /compute/v2.1/servers/3478e8af-1c05-4921-b7ee-e882acb9a65a" status: 200 len: 1729 microversion: 2.20 time: 0.164227 Jul 06 14:00:50.901877 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 640/1268] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 6 14:00:50 2022] GET /compute/v2.1/servers/3478e8af-1c05-4921-b7ee-e882acb9a65a => generated 1729 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 06 14:00:51.919631 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-38015b8e-8d8e-479d-9d40-6bb6642161e4 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 14:00:51.920324 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-38015b8e-8d8e-479d-9d40-6bb6642161e4 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] [instance: 3478e8af-1c05-4921-b7ee-e882acb9a65a] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 14:00:51.926951 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-38015b8e-8d8e-479d-9d40-6bb6642161e4 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 14:00:51.927400 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-38015b8e-8d8e-479d-9d40-6bb6642161e4 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 14:00:51.928420 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-38015b8e-8d8e-479d-9d40-6bb6642161e4 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 14:00:51.928850 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-38015b8e-8d8e-479d-9d40-6bb6642161e4 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 14:00:52.105879 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-38015b8e-8d8e-479d-9d40-6bb6642161e4 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c85251638bc64deca16008b696b11ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3edb8d53184b98b7055ffc145f186d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 14:00:52.113795 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-38015b8e-8d8e-479d-9d40-6bb6642161e4 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c85251638bc64deca16008b696b11ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3edb8d53184b98b7055ffc145f186d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 14:00:52.115285 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-38015b8e-8d8e-479d-9d40-6bb6642161e4 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c85251638bc64deca16008b696b11ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3edb8d53184b98b7055ffc145f186d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 14:00:52.116419 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-38015b8e-8d8e-479d-9d40-6bb6642161e4 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] 10.222.0.20 "GET /compute/v2.1/servers/3478e8af-1c05-4921-b7ee-e882acb9a65a" status: 200 len: 1729 microversion: 2.20 time: 0.200763 Jul 06 14:00:52.116967 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 629/1269] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 6 14:00:51 2022] GET /compute/v2.1/servers/3478e8af-1c05-4921-b7ee-e882acb9a65a => generated 1729 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 06 14:00:53.134570 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-b2648ff5-9820-48b6-a018-109eabd83893 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Calling method '>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 14:00:53.135190 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-b2648ff5-9820-48b6-a018-109eabd83893 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] [instance: 3478e8af-1c05-4921-b7ee-e882acb9a65a] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 14:00:53.142414 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-b2648ff5-9820-48b6-a018-109eabd83893 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 14:00:53.142876 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-b2648ff5-9820-48b6-a018-109eabd83893 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 14:00:53.143689 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-b2648ff5-9820-48b6-a018-109eabd83893 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 14:00:53.144196 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-b2648ff5-9820-48b6-a018-109eabd83893 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 14:00:53.275197 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-b2648ff5-9820-48b6-a018-109eabd83893 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c85251638bc64deca16008b696b11ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3edb8d53184b98b7055ffc145f186d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 14:00:53.283722 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-b2648ff5-9820-48b6-a018-109eabd83893 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c85251638bc64deca16008b696b11ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3edb8d53184b98b7055ffc145f186d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 14:00:53.285250 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-b2648ff5-9820-48b6-a018-109eabd83893 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c85251638bc64deca16008b696b11ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3edb8d53184b98b7055ffc145f186d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 14:00:53.286394 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-b2648ff5-9820-48b6-a018-109eabd83893 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] 10.222.0.20 "GET /compute/v2.1/servers/3478e8af-1c05-4921-b7ee-e882acb9a65a" status: 200 len: 1729 microversion: 2.20 time: 0.155882 Jul 06 14:00:53.286950 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 641/1270] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 6 14:00:53 2022] GET /compute/v2.1/servers/3478e8af-1c05-4921-b7ee-e882acb9a65a => generated 1729 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 06 14:00:54.304993 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-8a3fb253-c09c-4142-a51a-a80b3242b8bf tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 14:00:54.305628 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-8a3fb253-c09c-4142-a51a-a80b3242b8bf tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] [instance: 3478e8af-1c05-4921-b7ee-e882acb9a65a] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 14:00:54.312823 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-8a3fb253-c09c-4142-a51a-a80b3242b8bf tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 14:00:54.313298 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-8a3fb253-c09c-4142-a51a-a80b3242b8bf tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 14:00:54.314059 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-8a3fb253-c09c-4142-a51a-a80b3242b8bf tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 14:00:54.314486 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-8a3fb253-c09c-4142-a51a-a80b3242b8bf tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 14:00:54.440868 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-8a3fb253-c09c-4142-a51a-a80b3242b8bf tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c85251638bc64deca16008b696b11ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3edb8d53184b98b7055ffc145f186d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 14:00:54.448916 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-8a3fb253-c09c-4142-a51a-a80b3242b8bf tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c85251638bc64deca16008b696b11ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3edb8d53184b98b7055ffc145f186d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 14:00:54.450439 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-8a3fb253-c09c-4142-a51a-a80b3242b8bf tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c85251638bc64deca16008b696b11ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3edb8d53184b98b7055ffc145f186d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 14:00:54.451722 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-8a3fb253-c09c-4142-a51a-a80b3242b8bf tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] 10.222.0.20 "GET /compute/v2.1/servers/3478e8af-1c05-4921-b7ee-e882acb9a65a" status: 200 len: 1729 microversion: 2.20 time: 0.150871 Jul 06 14:00:54.452282 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 630/1271] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 6 14:00:54 2022] GET /compute/v2.1/servers/3478e8af-1c05-4921-b7ee-e882acb9a65a => generated 1729 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 06 14:00:55.237916 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [req-e3e8b63b-ff89-4599-8621-f12137304282 req-f3f071ca-e601-40fd-88ee-2b255b865820 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3478e8af-1c05-4921-b7ee-e882acb9a65a", "name": "network-vif-plugged", "status": "completed", "tag": "1b7f73c8-d336-41e4-a894-3c448b223c00"}]} {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 06 14:00:55.246596 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [req-e3e8b63b-ff89-4599-8621-f12137304282 req-f3f071ca-e601-40fd-88ee-2b255b865820 service nova] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 14:00:55.247036 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [req-e3e8b63b-ff89-4599-8621-f12137304282 req-f3f071ca-e601-40fd-88ee-2b255b865820 service nova] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 14:00:55.258408 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.compute.server_external_events [req-e3e8b63b-ff89-4599-8621-f12137304282 req-f3f071ca-e601-40fd-88ee-2b255b865820 service nova] Creating event network-vif-plugged:1b7f73c8-d336-41e4-a894-3c448b223c00 for instance 3478e8af-1c05-4921-b7ee-e882acb9a65a on hv-cinder-81914 Jul 06 14:00:55.264161 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [req-e3e8b63b-ff89-4599-8621-f12137304282 req-f3f071ca-e601-40fd-88ee-2b255b865820 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029352 Jul 06 14:00:55.264740 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 642/1272] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 6 14:00:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 06 14:00:55.470066 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-fdce58d5-25d3-4fd6-bc84-7a13875cd329 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 14:00:55.470622 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-fdce58d5-25d3-4fd6-bc84-7a13875cd329 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] [instance: 3478e8af-1c05-4921-b7ee-e882acb9a65a] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 14:00:55.477022 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-fdce58d5-25d3-4fd6-bc84-7a13875cd329 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 14:00:55.477482 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-fdce58d5-25d3-4fd6-bc84-7a13875cd329 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 14:00:55.478240 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-fdce58d5-25d3-4fd6-bc84-7a13875cd329 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 14:00:55.478673 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-fdce58d5-25d3-4fd6-bc84-7a13875cd329 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 14:00:55.624593 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-fdce58d5-25d3-4fd6-bc84-7a13875cd329 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c85251638bc64deca16008b696b11ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3edb8d53184b98b7055ffc145f186d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 14:00:55.632434 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-fdce58d5-25d3-4fd6-bc84-7a13875cd329 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c85251638bc64deca16008b696b11ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3edb8d53184b98b7055ffc145f186d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 14:00:55.633947 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-fdce58d5-25d3-4fd6-bc84-7a13875cd329 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c85251638bc64deca16008b696b11ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3edb8d53184b98b7055ffc145f186d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 14:00:55.635085 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-fdce58d5-25d3-4fd6-bc84-7a13875cd329 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] 10.222.0.20 "GET /compute/v2.1/servers/3478e8af-1c05-4921-b7ee-e882acb9a65a" status: 200 len: 1729 microversion: 2.20 time: 0.169255 Jul 06 14:00:55.635639 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 631/1273] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 6 14:00:55 2022] GET /compute/v2.1/servers/3478e8af-1c05-4921-b7ee-e882acb9a65a => generated 1729 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 06 14:00:56.656729 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-f84dc3e6-7e99-445f-a2aa-25090ffdd06d tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Calling method '>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 14:00:56.657369 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-f84dc3e6-7e99-445f-a2aa-25090ffdd06d tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] [instance: 3478e8af-1c05-4921-b7ee-e882acb9a65a] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 14:00:56.663590 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-f84dc3e6-7e99-445f-a2aa-25090ffdd06d tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 14:00:56.664040 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-f84dc3e6-7e99-445f-a2aa-25090ffdd06d tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 14:00:56.664814 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-f84dc3e6-7e99-445f-a2aa-25090ffdd06d tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 14:00:56.665283 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-f84dc3e6-7e99-445f-a2aa-25090ffdd06d tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 14:00:56.850388 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-f84dc3e6-7e99-445f-a2aa-25090ffdd06d tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c85251638bc64deca16008b696b11ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3edb8d53184b98b7055ffc145f186d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 14:00:56.858862 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-f84dc3e6-7e99-445f-a2aa-25090ffdd06d tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c85251638bc64deca16008b696b11ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3edb8d53184b98b7055ffc145f186d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 14:00:56.860376 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-f84dc3e6-7e99-445f-a2aa-25090ffdd06d tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c85251638bc64deca16008b696b11ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3edb8d53184b98b7055ffc145f186d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 14:00:56.861598 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-f84dc3e6-7e99-445f-a2aa-25090ffdd06d tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] 10.222.0.20 "GET /compute/v2.1/servers/3478e8af-1c05-4921-b7ee-e882acb9a65a" status: 200 len: 1729 microversion: 2.20 time: 0.210781 Jul 06 14:00:56.862160 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 643/1274] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 6 14:00:56 2022] GET /compute/v2.1/servers/3478e8af-1c05-4921-b7ee-e882acb9a65a => generated 1729 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 06 14:00:57.879834 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-ac82d019-cb83-4f4a-97ea-1d5b8e0bfcd1 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 14:00:57.880413 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-ac82d019-cb83-4f4a-97ea-1d5b8e0bfcd1 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] [instance: 3478e8af-1c05-4921-b7ee-e882acb9a65a] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 14:00:57.887003 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-ac82d019-cb83-4f4a-97ea-1d5b8e0bfcd1 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 14:00:57.887446 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-ac82d019-cb83-4f4a-97ea-1d5b8e0bfcd1 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 14:00:57.888736 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-ac82d019-cb83-4f4a-97ea-1d5b8e0bfcd1 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 14:00:57.889205 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-ac82d019-cb83-4f4a-97ea-1d5b8e0bfcd1 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 14:00:58.023669 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-ac82d019-cb83-4f4a-97ea-1d5b8e0bfcd1 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c85251638bc64deca16008b696b11ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3edb8d53184b98b7055ffc145f186d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 14:00:58.032110 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-ac82d019-cb83-4f4a-97ea-1d5b8e0bfcd1 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c85251638bc64deca16008b696b11ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3edb8d53184b98b7055ffc145f186d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 14:00:58.033658 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-ac82d019-cb83-4f4a-97ea-1d5b8e0bfcd1 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c85251638bc64deca16008b696b11ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3edb8d53184b98b7055ffc145f186d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 14:00:58.034799 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-ac82d019-cb83-4f4a-97ea-1d5b8e0bfcd1 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] 10.222.0.20 "GET /compute/v2.1/servers/3478e8af-1c05-4921-b7ee-e882acb9a65a" status: 200 len: 1716 microversion: 2.20 time: 0.158994 Jul 06 14:00:58.035350 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 632/1275] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 6 14:00:57 2022] GET /compute/v2.1/servers/3478e8af-1c05-4921-b7ee-e882acb9a65a => generated 1716 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 06 14:01:53.215216 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-bd911edd-dec3-45b4-8286-b2fc31421da5 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Calling method '>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 14:01:53.216150 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-bd911edd-dec3-45b4-8286-b2fc31421da5 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] [instance: 3478e8af-1c05-4921-b7ee-e882acb9a65a] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 14:01:53.218526 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG dbcounter [-] [124368] Writing DB stats nova_api:SELECT=29 {{(pid=124368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 14:01:53.219313 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG dbcounter [-] [124368] Writing DB stats nova_cell1:SELECT=88,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=124368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 14:01:53.225194 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-bd911edd-dec3-45b4-8286-b2fc31421da5 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 14:01:53.225650 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-bd911edd-dec3-45b4-8286-b2fc31421da5 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 14:01:53.226416 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-bd911edd-dec3-45b4-8286-b2fc31421da5 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 14:01:53.226857 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-bd911edd-dec3-45b4-8286-b2fc31421da5 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 14:01:53.256189 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-bd911edd-dec3-45b4-8286-b2fc31421da5 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] 10.222.0.20 "GET /compute/v2.1/servers/3478e8af-1c05-4921-b7ee-e882acb9a65a/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.044867 Jul 06 14:01:53.256730 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 644/1276] 10.222.0.20 () {60 vars in 1342 bytes} [Wed Jul 6 14:01:53 2022] GET /compute/v2.1/servers/3478e8af-1c05-4921-b7ee-e882acb9a65a/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 14:01:53.313801 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-961d3c54-cfdf-4757-bb31-bfc2c75b2b2e tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 14:01:53.314296 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-961d3c54-cfdf-4757-bb31-bfc2c75b2b2e tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] [instance: 3478e8af-1c05-4921-b7ee-e882acb9a65a] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 14:01:53.316246 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG dbcounter [-] [124367] Writing DB stats nova_api:SELECT=25 {{(pid=124367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 14:01:53.316893 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG dbcounter [-] [124367] Writing DB stats nova_cell1:SELECT=86,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=124367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 14:01:53.322419 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-961d3c54-cfdf-4757-bb31-bfc2c75b2b2e tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 14:01:53.322858 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-961d3c54-cfdf-4757-bb31-bfc2c75b2b2e tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 14:01:53.323611 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-961d3c54-cfdf-4757-bb31-bfc2c75b2b2e tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 14:01:53.324037 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-961d3c54-cfdf-4757-bb31-bfc2c75b2b2e tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 14:01:53.350015 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-961d3c54-cfdf-4757-bb31-bfc2c75b2b2e tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] [instance: 3478e8af-1c05-4921-b7ee-e882acb9a65a] Going to try to terminate instance {{(pid=124367) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 06 14:01:53.423650 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-961d3c54-cfdf-4757-bb31-bfc2c75b2b2e tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] 10.222.0.20 "DELETE /compute/v2.1/servers/3478e8af-1c05-4921-b7ee-e882acb9a65a" status: 204 len: 0 microversion: 2.20 time: 0.114055 Jul 06 14:01:53.424238 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 633/1277] 10.222.0.20 () {60 vars in 1279 bytes} [Wed Jul 6 14:01:53 2022] DELETE /compute/v2.1/servers/3478e8af-1c05-4921-b7ee-e882acb9a65a => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 06 14:01:53.432866 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-560bed4a-db83-4c2e-8f81-90324c3872f1 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Calling method '>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 14:01:53.433603 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-560bed4a-db83-4c2e-8f81-90324c3872f1 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] [instance: 3478e8af-1c05-4921-b7ee-e882acb9a65a] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 14:01:53.440215 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-560bed4a-db83-4c2e-8f81-90324c3872f1 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 14:01:53.440666 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-560bed4a-db83-4c2e-8f81-90324c3872f1 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 14:01:53.441458 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-560bed4a-db83-4c2e-8f81-90324c3872f1 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 14:01:53.441895 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-560bed4a-db83-4c2e-8f81-90324c3872f1 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 14:01:53.566725 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-560bed4a-db83-4c2e-8f81-90324c3872f1 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c85251638bc64deca16008b696b11ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3edb8d53184b98b7055ffc145f186d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 14:01:53.574550 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-560bed4a-db83-4c2e-8f81-90324c3872f1 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c85251638bc64deca16008b696b11ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3edb8d53184b98b7055ffc145f186d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 14:01:53.576071 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-560bed4a-db83-4c2e-8f81-90324c3872f1 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c85251638bc64deca16008b696b11ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3edb8d53184b98b7055ffc145f186d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 14:01:53.577240 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-560bed4a-db83-4c2e-8f81-90324c3872f1 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] 10.222.0.20 "GET /compute/v2.1/servers/3478e8af-1c05-4921-b7ee-e882acb9a65a" status: 200 len: 1722 microversion: 2.20 time: 0.148669 Jul 06 14:01:53.577799 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 645/1278] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 6 14:01:53 2022] GET /compute/v2.1/servers/3478e8af-1c05-4921-b7ee-e882acb9a65a => generated 1722 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 06 14:01:54.596096 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-bbe3b58a-96f8-445c-ab91-6f0242e03938 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 14:01:54.596740 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-bbe3b58a-96f8-445c-ab91-6f0242e03938 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] [instance: 3478e8af-1c05-4921-b7ee-e882acb9a65a] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 14:01:54.603294 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-bbe3b58a-96f8-445c-ab91-6f0242e03938 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 14:01:54.603739 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-bbe3b58a-96f8-445c-ab91-6f0242e03938 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 14:01:54.604521 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-bbe3b58a-96f8-445c-ab91-6f0242e03938 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 14:01:54.604951 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-bbe3b58a-96f8-445c-ab91-6f0242e03938 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 14:01:54.737435 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-bbe3b58a-96f8-445c-ab91-6f0242e03938 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c85251638bc64deca16008b696b11ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3edb8d53184b98b7055ffc145f186d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 14:01:54.745326 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-bbe3b58a-96f8-445c-ab91-6f0242e03938 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c85251638bc64deca16008b696b11ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3edb8d53184b98b7055ffc145f186d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 14:01:54.746828 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-bbe3b58a-96f8-445c-ab91-6f0242e03938 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c85251638bc64deca16008b696b11ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3edb8d53184b98b7055ffc145f186d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 14:01:54.749013 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-bbe3b58a-96f8-445c-ab91-6f0242e03938 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] 10.222.0.20 "GET /compute/v2.1/servers/3478e8af-1c05-4921-b7ee-e882acb9a65a" status: 200 len: 1722 microversion: 2.20 time: 0.157349 Jul 06 14:01:54.749584 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 634/1279] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 6 14:01:54 2022] GET /compute/v2.1/servers/3478e8af-1c05-4921-b7ee-e882acb9a65a => generated 1722 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 06 14:01:55.768207 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-581ad106-536f-4b27-b162-5369a2698100 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Calling method '>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 14:01:55.768994 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-581ad106-536f-4b27-b162-5369a2698100 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] [instance: 3478e8af-1c05-4921-b7ee-e882acb9a65a] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 14:01:55.775962 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-581ad106-536f-4b27-b162-5369a2698100 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 14:01:55.776426 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-581ad106-536f-4b27-b162-5369a2698100 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 14:01:55.777237 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-581ad106-536f-4b27-b162-5369a2698100 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 14:01:55.777704 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-581ad106-536f-4b27-b162-5369a2698100 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 14:01:55.847573 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-581ad106-536f-4b27-b162-5369a2698100 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c85251638bc64deca16008b696b11ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3edb8d53184b98b7055ffc145f186d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 14:01:55.859964 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-581ad106-536f-4b27-b162-5369a2698100 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c85251638bc64deca16008b696b11ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3edb8d53184b98b7055ffc145f186d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 14:01:55.861923 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.policy [None req-581ad106-536f-4b27-b162-5369a2698100 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c85251638bc64deca16008b696b11ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3edb8d53184b98b7055ffc145f186d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124368) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 14:01:55.863130 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-581ad106-536f-4b27-b162-5369a2698100 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] 10.222.0.20 "GET /compute/v2.1/servers/3478e8af-1c05-4921-b7ee-e882acb9a65a" status: 200 len: 1656 microversion: 2.20 time: 0.099002 Jul 06 14:01:55.863692 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 646/1280] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 6 14:01:55 2022] GET /compute/v2.1/servers/3478e8af-1c05-4921-b7ee-e882acb9a65a => generated 1656 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 06 14:01:55.917625 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [req-278eed90-970e-4aee-9522-dd7953d576f5 req-c11f5dea-0031-4552-95a9-090ebd989da6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3478e8af-1c05-4921-b7ee-e882acb9a65a", "name": "network-vif-deleted", "tag": "1b7f73c8-d336-41e4-a894-3c448b223c00"}]} {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 06 14:01:55.927502 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [req-278eed90-970e-4aee-9522-dd7953d576f5 req-c11f5dea-0031-4552-95a9-090ebd989da6 service nova] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 14:01:55.928666 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [req-278eed90-970e-4aee-9522-dd7953d576f5 req-c11f5dea-0031-4552-95a9-090ebd989da6 service nova] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 14:01:55.945380 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.compute.server_external_events [req-278eed90-970e-4aee-9522-dd7953d576f5 req-c11f5dea-0031-4552-95a9-090ebd989da6 service nova] Creating event network-vif-deleted:1b7f73c8-d336-41e4-a894-3c448b223c00 for instance 3478e8af-1c05-4921-b7ee-e882acb9a65a on hv-cinder-81914 Jul 06 14:01:55.953954 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [req-278eed90-970e-4aee-9522-dd7953d576f5 req-c11f5dea-0031-4552-95a9-090ebd989da6 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.115246 Jul 06 14:01:55.955153 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 635/1281] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 6 14:01:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 06 14:01:56.881710 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-aee94128-8248-4aa2-a030-81487da46fd3 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Calling method '>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 14:01:56.882331 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-aee94128-8248-4aa2-a030-81487da46fd3 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] [instance: 3478e8af-1c05-4921-b7ee-e882acb9a65a] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 14:01:56.889582 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-aee94128-8248-4aa2-a030-81487da46fd3 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 14:01:56.890043 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-aee94128-8248-4aa2-a030-81487da46fd3 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 14:01:56.890820 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-aee94128-8248-4aa2-a030-81487da46fd3 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 14:01:56.891264 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-aee94128-8248-4aa2-a030-81487da46fd3 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 14:01:56.905800 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.wsgi [None req-aee94128-8248-4aa2-a030-81487da46fd3 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] HTTP exception thrown: Instance 3478e8af-1c05-4921-b7ee-e882acb9a65a could not be found. Jul 06 14:01:56.907449 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-aee94128-8248-4aa2-a030-81487da46fd3 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Request method failure captured: Jul 06 14:01:56.907449 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: request: GET /compute/v2.1/servers/3478e8af-1c05-4921-b7ee-e882acb9a65a HTTP/1.1 Jul 06 14:01:56.907449 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: Accept: application/json Jul 06 14:01:56.907449 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: Accept-Encoding: identity Jul 06 14:01:56.907449 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: Connection: close Jul 06 14:01:56.907449 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: Content-Length: 0 Jul 06 14:01:56.907449 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: Content-Type: application/json Jul 06 14:01:56.907449 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: Host: 10.222.0.20 Jul 06 14:01:56.907449 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: Openstack-System-Scope: None Jul 06 14:01:56.907449 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: User-Agent: python-urllib3/1.26.9 Jul 06 14:01:56.907449 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Auth-Token: gAAAAABixZPHZzfL86iQ6aiHUdSt9XB68ycnnakbcV9q5EPB3cmHjGD6e8kIzqA1KpjnI9V4rWu7N0dexJrUVmzpN63EITVTlBuvDk09HPF5d7NT79J5QcDjpZ5WthhRJWqNfVyh-iB7RySsnOyxETRcrR2U8zJnwO3LcnAkPJGROSlueh8XhJE Jul 06 14:01:56.907449 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Domain-Id: None Jul 06 14:01:56.907449 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Domain-Name: None Jul 06 14:01:56.907449 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Identity-Status: Confirmed Jul 06 14:01:56.907449 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Is-Admin-Project: True Jul 06 14:01:56.907449 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Openstack-Nova-Api-Version: 2.20 Jul 06 14:01:56.907449 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Project-Domain-Id: default Jul 06 14:01:56.907449 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Project-Domain-Name: Default Jul 06 14:01:56.907449 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Project-Id: 9e3edb8d53184b98b7055ffc145f186d Jul 06 14:01:56.907449 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-667316018 Jul 06 14:01:56.907449 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Role: reader,member Jul 06 14:01:56.907449 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Roles: reader,member Jul 06 14:01:56.909376 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_9e3edb8d53184b98b7055ffc145f186d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/9e3edb8d53184b98b7055ffc145f186d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/9e3edb8d53184b98b7055ffc145f186d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/9e3edb8d53184b98b7055ffc145f186d"}]}] Jul 06 14:01:56.909376 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Tenant: tempest-AttachVolumeShelveTestJSON-667316018 Jul 06 14:01:56.909376 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Tenant-Id: 9e3edb8d53184b98b7055ffc145f186d Jul 06 14:01:56.909376 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-667316018 Jul 06 14:01:56.909376 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-User: tempest-AttachVolumeShelveTestJSON-667316018-project Jul 06 14:01:56.909376 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-User-Domain-Id: default Jul 06 14:01:56.909376 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-User-Domain-Name: Default Jul 06 14:01:56.909376 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-User-Id: c85251638bc64deca16008b696b11ea4 Jul 06 14:01:56.909376 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-User-Name: tempest-AttachVolumeShelveTestJSON-667316018-project Jul 06 14:01:56.909376 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: method: > Jul 06 14:01:56.909376 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: exception: Instance 3478e8af-1c05-4921-b7ee-e882acb9a65a could not be found. Jul 06 14:01:56.909376 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: action_args: {'id': '3478e8af-1c05-4921-b7ee-e882acb9a65a'} Jul 06 14:01:56.910408 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 06 14:01:56.910408 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 06 14:01:56.910408 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 06 14:01:56.910408 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 06 14:01:56.910408 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 06 14:01:56.910408 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 06 14:01:56.910408 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 06 14:01:56.910408 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 06 14:01:56.910408 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 06 14:01:56.910408 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 06 14:01:56.910408 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3478e8af-1c05-4921-b7ee-e882acb9a65a could not be found. Jul 06 14:01:56.910408 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi Jul 06 14:01:56.910408 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 06 14:01:56.910408 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi Jul 06 14:01:56.910408 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 06 14:01:56.910408 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 06 14:01:56.910408 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 06 14:01:56.910408 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 06 14:01:56.910408 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 06 14:01:56.910408 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 06 14:01:56.911827 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 06 14:01:56.911827 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 06 14:01:56.911827 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 06 14:01:56.911827 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 06 14:01:56.911827 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 06 14:01:56.911827 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 06 14:01:56.911827 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 06 14:01:56.911827 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3478e8af-1c05-4921-b7ee-e882acb9a65a could not be found. Jul 06 14:01:56.911827 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi Jul 06 14:01:56.911827 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 06 14:01:56.911827 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi Jul 06 14:01:56.911827 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 06 14:01:56.911827 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 06 14:01:56.911827 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 06 14:01:56.911827 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 06 14:01:56.911827 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 06 14:01:56.911827 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3478e8af-1c05-4921-b7ee-e882acb9a65a could not be found. Jul 06 14:01:56.911827 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi Jul 06 14:01:56.913737 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-aee94128-8248-4aa2-a030-81487da46fd3 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Returning 404 to user: Instance 3478e8af-1c05-4921-b7ee-e882acb9a65a could not be found. {{(pid=124368) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 06 14:01:56.913737 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-aee94128-8248-4aa2-a030-81487da46fd3 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] 10.222.0.20 "GET /compute/v2.1/servers/3478e8af-1c05-4921-b7ee-e882acb9a65a" status: 404 len: 111 microversion: 2.20 time: 0.031232 Jul 06 14:01:56.913737 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 647/1282] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 6 14:01:56 2022] GET /compute/v2.1/servers/3478e8af-1c05-4921-b7ee-e882acb9a65a => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 06 14:01:56.920790 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-5fcd70f6-f659-4463-972f-a28bc43614c7 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Calling method '.version_select at 0x7ffbc431d310>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 14:01:56.938083 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-5fcd70f6-f659-4463-972f-a28bc43614c7 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-189311326" status: 204 len: 0 microversion: 2.20 time: 0.022703 Jul 06 14:01:56.938644 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 636/1283] 10.222.0.20 () {60 vars in 1258 bytes} [Wed Jul 6 14:01:56 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-189311326 => generated 0 bytes in 25 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Jul 06 14:01:58.682146 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-87b5b7b3-f301-49d3-946d-13e391d82b61 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Calling method '>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 14:01:58.682643 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-87b5b7b3-f301-49d3-946d-13e391d82b61 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] [instance: 3478e8af-1c05-4921-b7ee-e882acb9a65a] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 14:01:58.689384 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-87b5b7b3-f301-49d3-946d-13e391d82b61 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 14:01:58.689834 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-87b5b7b3-f301-49d3-946d-13e391d82b61 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 14:01:58.690596 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-87b5b7b3-f301-49d3-946d-13e391d82b61 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 14:01:58.691029 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-87b5b7b3-f301-49d3-946d-13e391d82b61 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 14:01:58.704801 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.wsgi [None req-87b5b7b3-f301-49d3-946d-13e391d82b61 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] HTTP exception thrown: Instance 3478e8af-1c05-4921-b7ee-e882acb9a65a could not be found. Jul 06 14:01:58.706363 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-87b5b7b3-f301-49d3-946d-13e391d82b61 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Request method failure captured: Jul 06 14:01:58.706363 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: request: DELETE /compute/v2.1/servers/3478e8af-1c05-4921-b7ee-e882acb9a65a HTTP/1.1 Jul 06 14:01:58.706363 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: Accept: application/json Jul 06 14:01:58.706363 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: Accept-Encoding: identity Jul 06 14:01:58.706363 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: Connection: close Jul 06 14:01:58.706363 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: Content-Length: 0 Jul 06 14:01:58.706363 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: Content-Type: application/json Jul 06 14:01:58.706363 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: Host: 10.222.0.20 Jul 06 14:01:58.706363 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: Openstack-System-Scope: None Jul 06 14:01:58.706363 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: User-Agent: python-urllib3/1.26.9 Jul 06 14:01:58.706363 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Auth-Token: gAAAAABixZPHZzfL86iQ6aiHUdSt9XB68ycnnakbcV9q5EPB3cmHjGD6e8kIzqA1KpjnI9V4rWu7N0dexJrUVmzpN63EITVTlBuvDk09HPF5d7NT79J5QcDjpZ5WthhRJWqNfVyh-iB7RySsnOyxETRcrR2U8zJnwO3LcnAkPJGROSlueh8XhJE Jul 06 14:01:58.706363 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Domain-Id: None Jul 06 14:01:58.706363 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Domain-Name: None Jul 06 14:01:58.706363 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Identity-Status: Confirmed Jul 06 14:01:58.706363 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Is-Admin-Project: True Jul 06 14:01:58.706363 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Openstack-Nova-Api-Version: 2.20 Jul 06 14:01:58.706363 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Project-Domain-Id: default Jul 06 14:01:58.706363 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Project-Domain-Name: Default Jul 06 14:01:58.706363 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Project-Id: 9e3edb8d53184b98b7055ffc145f186d Jul 06 14:01:58.706363 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-667316018 Jul 06 14:01:58.706363 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Role: reader,member Jul 06 14:01:58.706363 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Roles: reader,member Jul 06 14:01:58.708093 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_9e3edb8d53184b98b7055ffc145f186d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/9e3edb8d53184b98b7055ffc145f186d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/9e3edb8d53184b98b7055ffc145f186d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/9e3edb8d53184b98b7055ffc145f186d"}]}] Jul 06 14:01:58.708093 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Tenant: tempest-AttachVolumeShelveTestJSON-667316018 Jul 06 14:01:58.708093 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Tenant-Id: 9e3edb8d53184b98b7055ffc145f186d Jul 06 14:01:58.708093 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-667316018 Jul 06 14:01:58.708093 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-User: tempest-AttachVolumeShelveTestJSON-667316018-project Jul 06 14:01:58.708093 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-User-Domain-Id: default Jul 06 14:01:58.708093 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-User-Domain-Name: Default Jul 06 14:01:58.708093 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-User-Id: c85251638bc64deca16008b696b11ea4 Jul 06 14:01:58.708093 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-User-Name: tempest-AttachVolumeShelveTestJSON-667316018-project Jul 06 14:01:58.708093 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: method: > Jul 06 14:01:58.708093 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: exception: Instance 3478e8af-1c05-4921-b7ee-e882acb9a65a could not be found. Jul 06 14:01:58.708093 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: action_args: {'id': '3478e8af-1c05-4921-b7ee-e882acb9a65a'} Jul 06 14:01:58.709052 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 06 14:01:58.709052 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 06 14:01:58.709052 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 06 14:01:58.709052 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 06 14:01:58.709052 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 06 14:01:58.709052 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 06 14:01:58.709052 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 06 14:01:58.709052 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 06 14:01:58.709052 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 06 14:01:58.709052 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 06 14:01:58.709052 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3478e8af-1c05-4921-b7ee-e882acb9a65a could not be found. Jul 06 14:01:58.709052 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi Jul 06 14:01:58.709052 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 06 14:01:58.709052 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi Jul 06 14:01:58.709052 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 06 14:01:58.709052 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 06 14:01:58.709052 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 06 14:01:58.709052 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 06 14:01:58.709052 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 06 14:01:58.709052 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 06 14:01:58.710599 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 06 14:01:58.710599 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 06 14:01:58.710599 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 06 14:01:58.710599 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 06 14:01:58.710599 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 06 14:01:58.710599 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 06 14:01:58.710599 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 06 14:01:58.710599 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 06 14:01:58.710599 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 06 14:01:58.710599 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3478e8af-1c05-4921-b7ee-e882acb9a65a could not be found. Jul 06 14:01:58.710599 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi Jul 06 14:01:58.710599 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 06 14:01:58.710599 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi Jul 06 14:01:58.710599 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 06 14:01:58.710599 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 06 14:01:58.710599 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 06 14:01:58.710599 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 06 14:01:58.710599 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 06 14:01:58.710599 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3478e8af-1c05-4921-b7ee-e882acb9a65a could not be found. Jul 06 14:01:58.710599 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi Jul 06 14:01:58.712245 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-87b5b7b3-f301-49d3-946d-13e391d82b61 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Returning 404 to user: Instance 3478e8af-1c05-4921-b7ee-e882acb9a65a could not be found. {{(pid=124368) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 06 14:01:58.712245 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-87b5b7b3-f301-49d3-946d-13e391d82b61 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] 10.222.0.20 "DELETE /compute/v2.1/servers/3478e8af-1c05-4921-b7ee-e882acb9a65a" status: 404 len: 111 microversion: 2.20 time: 0.029702 Jul 06 14:01:58.712245 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 648/1284] 10.222.0.20 () {60 vars in 1279 bytes} [Wed Jul 6 14:01:58 2022] DELETE /compute/v2.1/servers/3478e8af-1c05-4921-b7ee-e882acb9a65a => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 06 14:01:58.717332 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-3a530fd1-65db-4dd8-b8b1-1860b56a5af9 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 14:01:58.718073 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-3a530fd1-65db-4dd8-b8b1-1860b56a5af9 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] [instance: 3478e8af-1c05-4921-b7ee-e882acb9a65a] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 14:01:58.724712 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-3a530fd1-65db-4dd8-b8b1-1860b56a5af9 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 14:01:58.725175 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-3a530fd1-65db-4dd8-b8b1-1860b56a5af9 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 14:01:58.725942 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-3a530fd1-65db-4dd8-b8b1-1860b56a5af9 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 14:01:58.726381 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-3a530fd1-65db-4dd8-b8b1-1860b56a5af9 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 14:01:58.739553 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.wsgi [None req-3a530fd1-65db-4dd8-b8b1-1860b56a5af9 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] HTTP exception thrown: Instance 3478e8af-1c05-4921-b7ee-e882acb9a65a could not be found. Jul 06 14:01:58.741209 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-3a530fd1-65db-4dd8-b8b1-1860b56a5af9 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Request method failure captured: Jul 06 14:01:58.741209 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: request: GET /compute/v2.1/servers/3478e8af-1c05-4921-b7ee-e882acb9a65a HTTP/1.1 Jul 06 14:01:58.741209 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: Accept: application/json Jul 06 14:01:58.741209 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: Accept-Encoding: identity Jul 06 14:01:58.741209 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: Connection: close Jul 06 14:01:58.741209 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: Content-Length: 0 Jul 06 14:01:58.741209 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: Content-Type: application/json Jul 06 14:01:58.741209 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: Host: 10.222.0.20 Jul 06 14:01:58.741209 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: Openstack-System-Scope: None Jul 06 14:01:58.741209 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: User-Agent: python-urllib3/1.26.9 Jul 06 14:01:58.741209 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: X-Auth-Token: gAAAAABixZPHZzfL86iQ6aiHUdSt9XB68ycnnakbcV9q5EPB3cmHjGD6e8kIzqA1KpjnI9V4rWu7N0dexJrUVmzpN63EITVTlBuvDk09HPF5d7NT79J5QcDjpZ5WthhRJWqNfVyh-iB7RySsnOyxETRcrR2U8zJnwO3LcnAkPJGROSlueh8XhJE Jul 06 14:01:58.741209 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: X-Domain-Id: None Jul 06 14:01:58.741209 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: X-Domain-Name: None Jul 06 14:01:58.741209 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: X-Identity-Status: Confirmed Jul 06 14:01:58.741209 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: X-Is-Admin-Project: True Jul 06 14:01:58.741209 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: X-Openstack-Nova-Api-Version: 2.20 Jul 06 14:01:58.741209 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: X-Project-Domain-Id: default Jul 06 14:01:58.741209 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: X-Project-Domain-Name: Default Jul 06 14:01:58.741209 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: X-Project-Id: 9e3edb8d53184b98b7055ffc145f186d Jul 06 14:01:58.741209 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-667316018 Jul 06 14:01:58.741209 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: X-Role: reader,member Jul 06 14:01:58.741209 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: X-Roles: reader,member Jul 06 14:01:58.742906 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_9e3edb8d53184b98b7055ffc145f186d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/9e3edb8d53184b98b7055ffc145f186d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/9e3edb8d53184b98b7055ffc145f186d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/9e3edb8d53184b98b7055ffc145f186d"}]}] Jul 06 14:01:58.742906 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: X-Tenant: tempest-AttachVolumeShelveTestJSON-667316018 Jul 06 14:01:58.742906 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: X-Tenant-Id: 9e3edb8d53184b98b7055ffc145f186d Jul 06 14:01:58.742906 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-667316018 Jul 06 14:01:58.742906 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: X-User: tempest-AttachVolumeShelveTestJSON-667316018-project Jul 06 14:01:58.742906 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: X-User-Domain-Id: default Jul 06 14:01:58.742906 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: X-User-Domain-Name: Default Jul 06 14:01:58.742906 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: X-User-Id: c85251638bc64deca16008b696b11ea4 Jul 06 14:01:58.742906 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: X-User-Name: tempest-AttachVolumeShelveTestJSON-667316018-project Jul 06 14:01:58.742906 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: method: > Jul 06 14:01:58.742906 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: exception: Instance 3478e8af-1c05-4921-b7ee-e882acb9a65a could not be found. Jul 06 14:01:58.742906 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: action_args: {'id': '3478e8af-1c05-4921-b7ee-e882acb9a65a'} Jul 06 14:01:58.743847 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 06 14:01:58.743847 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 06 14:01:58.743847 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 06 14:01:58.743847 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 06 14:01:58.743847 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 06 14:01:58.743847 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 06 14:01:58.743847 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 06 14:01:58.743847 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 06 14:01:58.743847 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 06 14:01:58.743847 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 06 14:01:58.743847 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3478e8af-1c05-4921-b7ee-e882acb9a65a could not be found. Jul 06 14:01:58.743847 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi Jul 06 14:01:58.743847 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 06 14:01:58.743847 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi Jul 06 14:01:58.743847 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 06 14:01:58.743847 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 06 14:01:58.743847 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 06 14:01:58.743847 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 06 14:01:58.743847 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 06 14:01:58.743847 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 06 14:01:58.745421 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 06 14:01:58.745421 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 06 14:01:58.745421 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 06 14:01:58.745421 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 06 14:01:58.745421 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 06 14:01:58.745421 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 06 14:01:58.745421 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 06 14:01:58.745421 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3478e8af-1c05-4921-b7ee-e882acb9a65a could not be found. Jul 06 14:01:58.745421 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi Jul 06 14:01:58.745421 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 06 14:01:58.745421 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi Jul 06 14:01:58.745421 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 06 14:01:58.745421 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 06 14:01:58.745421 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 06 14:01:58.745421 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 06 14:01:58.745421 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 06 14:01:58.745421 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3478e8af-1c05-4921-b7ee-e882acb9a65a could not be found. Jul 06 14:01:58.745421 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi Jul 06 14:01:58.746766 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-3a530fd1-65db-4dd8-b8b1-1860b56a5af9 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Returning 404 to user: Instance 3478e8af-1c05-4921-b7ee-e882acb9a65a could not be found. {{(pid=124367) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 06 14:01:58.746766 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-3a530fd1-65db-4dd8-b8b1-1860b56a5af9 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] 10.222.0.20 "GET /compute/v2.1/servers/3478e8af-1c05-4921-b7ee-e882acb9a65a" status: 404 len: 111 microversion: 2.20 time: 0.030387 Jul 06 14:01:58.746766 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 637/1285] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 6 14:01:58 2022] GET /compute/v2.1/servers/3478e8af-1c05-4921-b7ee-e882acb9a65a => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Jul 06 14:01:59.876175 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-cafcdd58-4886-4103-b8cd-d0b8bf0368e0 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Calling method '>' {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 14:01:59.876687 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.compute.api [None req-cafcdd58-4886-4103-b8cd-d0b8bf0368e0 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] [instance: 4c0c4bb6-269f-46bc-b460-7d0299277753] Fetching instance by UUID {{(pid=124368) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 14:01:59.883113 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-cafcdd58-4886-4103-b8cd-d0b8bf0368e0 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 14:01:59.883570 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-cafcdd58-4886-4103-b8cd-d0b8bf0368e0 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 14:01:59.884345 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-cafcdd58-4886-4103-b8cd-d0b8bf0368e0 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 14:01:59.884792 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG oslo_concurrency.lockutils [None req-cafcdd58-4886-4103-b8cd-d0b8bf0368e0 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 14:01:59.898037 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.wsgi [None req-cafcdd58-4886-4103-b8cd-d0b8bf0368e0 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] HTTP exception thrown: Instance 4c0c4bb6-269f-46bc-b460-7d0299277753 could not be found. Jul 06 14:01:59.899684 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-cafcdd58-4886-4103-b8cd-d0b8bf0368e0 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Request method failure captured: Jul 06 14:01:59.899684 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: request: DELETE /compute/v2.1/servers/4c0c4bb6-269f-46bc-b460-7d0299277753 HTTP/1.1 Jul 06 14:01:59.899684 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: Accept: application/json Jul 06 14:01:59.899684 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: Accept-Encoding: identity Jul 06 14:01:59.899684 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: Connection: close Jul 06 14:01:59.899684 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: Content-Length: 0 Jul 06 14:01:59.899684 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: Content-Type: application/json Jul 06 14:01:59.899684 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: Host: 10.222.0.20 Jul 06 14:01:59.899684 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: Openstack-System-Scope: None Jul 06 14:01:59.899684 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: User-Agent: python-urllib3/1.26.9 Jul 06 14:01:59.899684 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Auth-Token: gAAAAABixZPHZzfL86iQ6aiHUdSt9XB68ycnnakbcV9q5EPB3cmHjGD6e8kIzqA1KpjnI9V4rWu7N0dexJrUVmzpN63EITVTlBuvDk09HPF5d7NT79J5QcDjpZ5WthhRJWqNfVyh-iB7RySsnOyxETRcrR2U8zJnwO3LcnAkPJGROSlueh8XhJE Jul 06 14:01:59.899684 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Domain-Id: None Jul 06 14:01:59.899684 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Domain-Name: None Jul 06 14:01:59.899684 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Identity-Status: Confirmed Jul 06 14:01:59.899684 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Is-Admin-Project: True Jul 06 14:01:59.899684 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Openstack-Nova-Api-Version: 2.20 Jul 06 14:01:59.899684 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Project-Domain-Id: default Jul 06 14:01:59.899684 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Project-Domain-Name: Default Jul 06 14:01:59.899684 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Project-Id: 9e3edb8d53184b98b7055ffc145f186d Jul 06 14:01:59.899684 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-667316018 Jul 06 14:01:59.899684 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Role: reader,member Jul 06 14:01:59.899684 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Roles: reader,member Jul 06 14:01:59.901321 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_9e3edb8d53184b98b7055ffc145f186d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/9e3edb8d53184b98b7055ffc145f186d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/9e3edb8d53184b98b7055ffc145f186d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/9e3edb8d53184b98b7055ffc145f186d"}]}] Jul 06 14:01:59.901321 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Tenant: tempest-AttachVolumeShelveTestJSON-667316018 Jul 06 14:01:59.901321 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Tenant-Id: 9e3edb8d53184b98b7055ffc145f186d Jul 06 14:01:59.901321 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-667316018 Jul 06 14:01:59.901321 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-User: tempest-AttachVolumeShelveTestJSON-667316018-project Jul 06 14:01:59.901321 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-User-Domain-Id: default Jul 06 14:01:59.901321 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-User-Domain-Name: Default Jul 06 14:01:59.901321 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-User-Id: c85251638bc64deca16008b696b11ea4 Jul 06 14:01:59.901321 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: X-User-Name: tempest-AttachVolumeShelveTestJSON-667316018-project Jul 06 14:01:59.901321 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: method: > Jul 06 14:01:59.901321 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: exception: Instance 4c0c4bb6-269f-46bc-b460-7d0299277753 could not be found. Jul 06 14:01:59.901321 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: action_args: {'id': '4c0c4bb6-269f-46bc-b460-7d0299277753'} Jul 06 14:01:59.902141 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: {{(pid=124368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 06 14:01:59.902141 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 06 14:01:59.902141 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 06 14:01:59.902141 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 06 14:01:59.902141 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 06 14:01:59.902141 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 06 14:01:59.902141 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 06 14:01:59.902141 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 06 14:01:59.902141 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 06 14:01:59.902141 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 06 14:01:59.902141 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4c0c4bb6-269f-46bc-b460-7d0299277753 could not be found. Jul 06 14:01:59.902141 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi Jul 06 14:01:59.902141 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 06 14:01:59.902141 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi Jul 06 14:01:59.902141 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 06 14:01:59.902141 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 06 14:01:59.902141 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 06 14:01:59.902141 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 06 14:01:59.902141 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 06 14:01:59.902141 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 06 14:01:59.904000 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 06 14:01:59.904000 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 06 14:01:59.904000 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 06 14:01:59.904000 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 06 14:01:59.904000 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 06 14:01:59.904000 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 06 14:01:59.904000 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 06 14:01:59.904000 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 06 14:01:59.904000 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 06 14:01:59.904000 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4c0c4bb6-269f-46bc-b460-7d0299277753 could not be found. Jul 06 14:01:59.904000 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi Jul 06 14:01:59.904000 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 06 14:01:59.904000 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi Jul 06 14:01:59.904000 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 06 14:01:59.904000 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 06 14:01:59.904000 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 06 14:01:59.904000 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 06 14:01:59.904000 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 06 14:01:59.904000 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4c0c4bb6-269f-46bc-b460-7d0299277753 could not be found. Jul 06 14:01:59.904000 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: ERROR nova.api.openstack.wsgi Jul 06 14:01:59.905713 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: DEBUG nova.api.openstack.wsgi [None req-cafcdd58-4886-4103-b8cd-d0b8bf0368e0 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Returning 404 to user: Instance 4c0c4bb6-269f-46bc-b460-7d0299277753 could not be found. {{(pid=124368) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 06 14:01:59.905713 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO nova.api.openstack.requestlog [None req-cafcdd58-4886-4103-b8cd-d0b8bf0368e0 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] 10.222.0.20 "DELETE /compute/v2.1/servers/4c0c4bb6-269f-46bc-b460-7d0299277753" status: 404 len: 111 microversion: 2.20 time: 0.029039 Jul 06 14:01:59.905713 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: [pid: 124368|app: 0|req: 649/1286] 10.222.0.20 () {60 vars in 1279 bytes} [Wed Jul 6 14:01:59 2022] DELETE /compute/v2.1/servers/4c0c4bb6-269f-46bc-b460-7d0299277753 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 06 14:01:59.909921 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-070c5423-6fe7-48a8-9c79-73bb81b4dd93 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 14:01:59.910562 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-070c5423-6fe7-48a8-9c79-73bb81b4dd93 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] [instance: 4c0c4bb6-269f-46bc-b460-7d0299277753] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 14:01:59.916696 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-070c5423-6fe7-48a8-9c79-73bb81b4dd93 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 14:01:59.917178 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-070c5423-6fe7-48a8-9c79-73bb81b4dd93 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 14:01:59.917935 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-070c5423-6fe7-48a8-9c79-73bb81b4dd93 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 14:01:59.918370 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-070c5423-6fe7-48a8-9c79-73bb81b4dd93 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Lock "85888416-be16-475e-b2e8-70b53709e325" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 14:01:59.933050 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.wsgi [None req-070c5423-6fe7-48a8-9c79-73bb81b4dd93 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] HTTP exception thrown: Instance 4c0c4bb6-269f-46bc-b460-7d0299277753 could not be found. Jul 06 14:01:59.934804 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-070c5423-6fe7-48a8-9c79-73bb81b4dd93 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Request method failure captured: Jul 06 14:01:59.934804 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: request: GET /compute/v2.1/servers/4c0c4bb6-269f-46bc-b460-7d0299277753 HTTP/1.1 Jul 06 14:01:59.934804 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: Accept: application/json Jul 06 14:01:59.934804 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: Accept-Encoding: identity Jul 06 14:01:59.934804 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: Connection: close Jul 06 14:01:59.934804 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: Content-Length: 0 Jul 06 14:01:59.934804 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: Content-Type: application/json Jul 06 14:01:59.934804 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: Host: 10.222.0.20 Jul 06 14:01:59.934804 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: Openstack-System-Scope: None Jul 06 14:01:59.934804 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: User-Agent: python-urllib3/1.26.9 Jul 06 14:01:59.934804 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: X-Auth-Token: gAAAAABixZPHZzfL86iQ6aiHUdSt9XB68ycnnakbcV9q5EPB3cmHjGD6e8kIzqA1KpjnI9V4rWu7N0dexJrUVmzpN63EITVTlBuvDk09HPF5d7NT79J5QcDjpZ5WthhRJWqNfVyh-iB7RySsnOyxETRcrR2U8zJnwO3LcnAkPJGROSlueh8XhJE Jul 06 14:01:59.934804 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: X-Domain-Id: None Jul 06 14:01:59.934804 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: X-Domain-Name: None Jul 06 14:01:59.934804 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: X-Identity-Status: Confirmed Jul 06 14:01:59.934804 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: X-Is-Admin-Project: True Jul 06 14:01:59.934804 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: X-Openstack-Nova-Api-Version: 2.20 Jul 06 14:01:59.934804 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: X-Project-Domain-Id: default Jul 06 14:01:59.934804 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: X-Project-Domain-Name: Default Jul 06 14:01:59.934804 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: X-Project-Id: 9e3edb8d53184b98b7055ffc145f186d Jul 06 14:01:59.934804 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-667316018 Jul 06 14:01:59.934804 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: X-Role: reader,member Jul 06 14:01:59.934804 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: X-Roles: reader,member Jul 06 14:01:59.936554 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_9e3edb8d53184b98b7055ffc145f186d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/9e3edb8d53184b98b7055ffc145f186d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/9e3edb8d53184b98b7055ffc145f186d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/9e3edb8d53184b98b7055ffc145f186d"}]}] Jul 06 14:01:59.936554 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: X-Tenant: tempest-AttachVolumeShelveTestJSON-667316018 Jul 06 14:01:59.936554 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: X-Tenant-Id: 9e3edb8d53184b98b7055ffc145f186d Jul 06 14:01:59.936554 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-667316018 Jul 06 14:01:59.936554 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: X-User: tempest-AttachVolumeShelveTestJSON-667316018-project Jul 06 14:01:59.936554 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: X-User-Domain-Id: default Jul 06 14:01:59.936554 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: X-User-Domain-Name: Default Jul 06 14:01:59.936554 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: X-User-Id: c85251638bc64deca16008b696b11ea4 Jul 06 14:01:59.936554 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: X-User-Name: tempest-AttachVolumeShelveTestJSON-667316018-project Jul 06 14:01:59.936554 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: method: > Jul 06 14:01:59.936554 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: exception: Instance 4c0c4bb6-269f-46bc-b460-7d0299277753 could not be found. Jul 06 14:01:59.936554 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: action_args: {'id': '4c0c4bb6-269f-46bc-b460-7d0299277753'} Jul 06 14:01:59.937532 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 06 14:01:59.937532 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 06 14:01:59.937532 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 06 14:01:59.937532 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 06 14:01:59.937532 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 06 14:01:59.937532 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 06 14:01:59.937532 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 06 14:01:59.937532 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 06 14:01:59.937532 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 06 14:01:59.937532 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 06 14:01:59.937532 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4c0c4bb6-269f-46bc-b460-7d0299277753 could not be found. Jul 06 14:01:59.937532 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi Jul 06 14:01:59.937532 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 06 14:01:59.937532 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi Jul 06 14:01:59.937532 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 06 14:01:59.937532 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 06 14:01:59.937532 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 06 14:01:59.937532 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 06 14:01:59.937532 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 06 14:01:59.937532 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 06 14:01:59.939056 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 06 14:01:59.939056 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 06 14:01:59.939056 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 06 14:01:59.939056 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 06 14:01:59.939056 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 06 14:01:59.939056 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 06 14:01:59.939056 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 06 14:01:59.939056 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4c0c4bb6-269f-46bc-b460-7d0299277753 could not be found. Jul 06 14:01:59.939056 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi Jul 06 14:01:59.939056 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 06 14:01:59.939056 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi Jul 06 14:01:59.939056 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 06 14:01:59.939056 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 06 14:01:59.939056 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 06 14:01:59.939056 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 06 14:01:59.939056 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 06 14:01:59.939056 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4c0c4bb6-269f-46bc-b460-7d0299277753 could not be found. Jul 06 14:01:59.939056 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi Jul 06 14:01:59.940459 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-070c5423-6fe7-48a8-9c79-73bb81b4dd93 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] Returning 404 to user: Instance 4c0c4bb6-269f-46bc-b460-7d0299277753 could not be found. {{(pid=124367) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 06 14:01:59.940459 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-070c5423-6fe7-48a8-9c79-73bb81b4dd93 tempest-AttachVolumeShelveTestJSON-667316018 tempest-AttachVolumeShelveTestJSON-667316018-project] 10.222.0.20 "GET /compute/v2.1/servers/4c0c4bb6-269f-46bc-b460-7d0299277753" status: 404 len: 111 microversion: 2.20 time: 0.030330 Jul 06 14:01:59.940459 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 638/1287] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 6 14:01:59 2022] GET /compute/v2.1/servers/4c0c4bb6-269f-46bc-b460-7d0299277753 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 06 14:03:20.457514 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 06 14:03:20.458062 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: Wed Jul 6 14:03:20 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 06 14:03:46.916843 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 06 14:03:46.917457 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: Wed Jul 6 14:03:46 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 06 14:04:10.213323 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 06 14:04:10.213954 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: Wed Jul 6 14:04:10 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 06 14:05:42.468682 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 06 14:05:42.469351 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: Wed Jul 6 14:05:42 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 06 14:06:40.465808 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 06 14:06:40.466504 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: Wed Jul 6 14:06:40 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 06 14:07:06.927640 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 06 14:07:06.928262 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: Wed Jul 6 14:07:06 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 06 14:07:09.737974 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 06 14:07:09.738572 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: Wed Jul 6 14:07:09 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 06 14:07:30.222553 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 06 14:07:30.223144 dv-cinder-819149-8-iscsi devstack@n-api.service[124368]: Wed Jul 6 14:07:30 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 06 14:07:34.412614 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 06 14:07:34.413211 dv-cinder-819149-8-iscsi devstack@n-api.service[124367]: Wed Jul 6 14:07:34 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!